Sebastian Ruder

14.7k total citations · 1 hit paper
46 papers, 1.5k citations indexed

About

Sebastian Ruder is a scholar working on Artificial Intelligence, Computer Vision and Pattern Recognition and Language and Linguistics. According to data from OpenAlex, Sebastian Ruder has authored 46 papers receiving a total of 1.5k indexed citations (citations by other indexed papers that have themselves been cited), including 43 papers in Artificial Intelligence, 11 papers in Computer Vision and Pattern Recognition and 4 papers in Language and Linguistics. Recurrent topics in Sebastian Ruder's work include Topic Modeling (35 papers), Natural Language Processing Techniques (33 papers) and Multimodal Machine Learning Applications (11 papers). Sebastian Ruder is often cited by papers focused on Topic Modeling (35 papers), Natural Language Processing Techniques (33 papers) and Multimodal Machine Learning Applications (11 papers). Sebastian Ruder collaborates with scholars based in United States, United Kingdom and Denmark. Sebastian Ruder's co-authors include Anders Søgaard, Ivan Vulić, Swabha Swayamdipta, Thomas Wolf, Matthew E. Peters, Graham Neubig, Isabelle Augenstein, Orhan Fırat, Junjie Hu and Melvin Johnson and has published in prestigious journals such as Transactions of the Association for Computational Linguistics, Edinburgh Research Explorer (University of Edinburgh) and Research at the University of Copenhagen (University of Copenhagen).

In The Last Decade

Sebastian Ruder

44 papers receiving 1.4k citations

Hit Papers

1 papers align trajectories

What are hit papers?

Hit papers significantly outperform the citation benchmark for their cohort. A paper qualifies if it has ≥500 total citations, achieves ≥1.5× the top-1% citation threshold for papers in the same subfield and year (this is the minimum needed to enter the top 1%, not the average within it), or reaches the top citation threshold in at least one of its specific research topics.

Transfer Learning in Natural Language Processing

2019 311 citations Sebastian Ruder, Matthew E. Peters et al. profile →

Peers — A (Enhanced Table)

Peers by citation overlap · career bar shows stage (early→late) cites · hero ref

Name	h						Papers	Cites
Sebastian Ruder United States	17	1.3k	292	142	46	45	46	1.5k
Zhuosheng Zhang China	20	1.3k 1.0×	365 1.3×	125 0.9×	32 0.7×	59 1.3×	73	1.5k
Rami Al‐Rfou United States	10	1.3k 1.1×	349 1.2×	114 0.8×	58 1.3×	46 1.0×	18	1.6k
Marjan Ghazvininejad United States	15	1.1k 0.9×	421 1.4×	78 0.5×	51 1.1×	34 0.8×	32	1.3k
Loïc Barrault France	11	1.4k 1.1×	405 1.4×	158 1.1×	52 1.1×	75 1.7×	36	1.6k
Mitesh M. Khapra India	19	1.2k 1.0×	442 1.5×	141 1.0×	61 1.3×	29 0.6×	86	1.5k
Daniel Khashabi United States	20	1.3k 1.0×	432 1.5×	152 1.1×	35 0.8×	39 0.9×	46	1.5k
Ting Liu China	21	1.2k 0.9×	180 0.6×	179 1.3×	31 0.7×	85 1.9×	74	1.4k
Steffen Eger Germany	14	816 0.6×	142 0.5×	125 0.9×	27 0.6×	39 0.9×	74	993
Swabha Swayamdipta United States	12	885 0.7×	132 0.5×	98 0.7×	25 0.5×	53 1.2×	31	1.0k
Jason Wei United States	11	1.1k 0.9×	203 0.7×	173 1.2×	72 1.6×	58 1.3×	16	1.4k

Countries citing papers authored by Sebastian Ruder

Since Specialization

Citations

This map shows the geographic impact of Sebastian Ruder's research. It shows the number of citations coming from papers published by authors working in each country. You can also color the map by specialization and compare the number of citations received by Sebastian Ruder with the expected number of citations based on a country's size and research output (numbers larger than one mean the country cites Sebastian Ruder more than expected).

Fields of papers citing papers by Sebastian Ruder

Since Specialization

Physical SciencesHealth SciencesLife SciencesSocial Sciences

This network shows the impact of papers produced by Sebastian Ruder. Nodes represent research fields, and links connect fields that are likely to share authors. Colored nodes show fields that tend to cite the papers produced by Sebastian Ruder. The network helps show where Sebastian Ruder may publish in the future.

Co-authorship network of co-authors of Sebastian Ruder

This figure shows the co-authorship network connecting the top 25 collaborators of Sebastian Ruder. A scholar is included among the top collaborators of Sebastian Ruder based on the total number of citations received by their joint publications. Widths of edges represent the number of papers authors have co-authored together. Node borders signify the number of papers an author published with Sebastian Ruder. Sebastian Ruder is excluded from the visualization to improve readability, since they are connected to all nodes in the network.

All Works

Sort: Min cites: Since: Top N: Style:

20 of 20 papers shown

Ruder, Sebastian, et al.. (2025). AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal Arabic. 22048–22065. 1 indexed citations

Asai, Akari, Sneha Kudugunta, Hila Gonen, et al.. (2024). BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer. 1771–1800. 3 indexed citations

Müller, Benjamin, John Wieting, Jonathan H. Clark, et al.. (2023). Evaluating and Modeling Attribution for Cross-Lingual Question Answering. 144–157. 1 indexed citations

Pfeiffer, Jonas, et al.. (2023). mmT5: Modular Multilingual Pre-Training Solves Source Language Hallucinations. 1978–2008. 4 indexed citations

Winata, Genta Indra, Alham Fikri Aji, Samuel Cahyawijaya, et al.. (2023). NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages. Rare & Special e-Zone (The Hong Kong University of Science and Technology). 815–834. 25 indexed citations

Ruder, Sebastian, et al.. (2023). Adapters: A Unified Library for Parameter-Efficient and Modular Transfer Learning. TUbilio (Technical University of Darmstadt). 149–160. 7 indexed citations

Tänzer, Michael, Sebastian Ruder, & Marek Rei. (2022). Memorisation versus Generalisation in Pre-trained Language Models. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 7564–7578. 26 indexed citations

Aji, Alham Fikri, Genta Indra Winata, Fajri Koto, et al.. (2022). One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 7226–7249. 45 indexed citations

Ruder, Sebastian, Jonas Pfeiffer, & Ivan Vulić. (2022). Modular and Parameter-Efficient Fine-Tuning for NLP Models. 23–29. 4 indexed citations

10.

Üstün, Ahmet, Arianna Bisazza, Gosse Bouma, Gertjan van Noord, & Sebastian Ruder. (2022). Hyper-X: A Unified Hypernetwork for Multi-Task Multilingual Transfer. 7934–7949. 9 indexed citations

11.

Zheng, Yanan, Jing Zhou, Yujie Qian, et al.. (2022). FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 501–516. 8 indexed citations

12.

Wang, Xinyi, Sebastian Ruder, & Graham Neubig. (2022). Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 863–877. 18 indexed citations

13.

Stan, Adriana, Traian Rebedea, Dani Yogatama, et al.. (2021). LiRo: Benchmark and leaderboard for Romanian language tasks. Neural Information Processing Systems. 10 indexed citations

14.

Wang, Xinyi, Sebastian Ruder, & Graham Neubig. (2021). Multi-view Subword Regularization. 473–482. 23 indexed citations

15.

Tay, Yi, Mostafa Dehghani, Samira Abnar, et al.. (2021). Long Range Arena : A Benchmark for Efficient Transformers. 15 indexed citations

16.

Hu, Junjie, Sebastian Ruder, Aditya Siddhant, et al.. (2020). XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation. International Conference on Machine Learning. 1. 4411–4421. 202 indexed citations

17.

Ruder, Sebastian, Matthew E. Peters, Swabha Swayamdipta, & Thomas Wolf. (2019). Transfer Learning in Natural Language Processing. 15–18. 311 indexed citations breakdown →

18.

Augenstein, Isabelle, Sebastian Ruder, & Anders Søgaard. (2018). . arXiv (Cornell University). 39 indexed citations

19.

Ruder, Sebastian, Joachim Bingel, Isabelle Augenstein, & Anders Søgaard. (2017). Sluice networks: Learning what to share between loosely related tasks.. arXiv (Cornell University). 61 indexed citations

20.

Ruder, Sebastian, Joachim Bingel, Isabelle Augenstein, & Anders Søgaard. (2017). Learning what to share between loosely related tasks. Research at the University of Copenhagen (University of Copenhagen). 25 indexed citations

Rankless uses publication and citation data sourced from OpenAlex, an open and comprehensive bibliographic database. While OpenAlex provides broad and valuable coverage of the global research landscape, it—like all bibliographic datasets—has inherent limitations. These include incomplete records, variations in author disambiguation, differences in journal indexing, and delays in data updates. As a result, some metrics and network relationships displayed in Rankless may not fully capture the entirety of a scholar's output or impact.

Explore authors with similar magnitude of impact