Sleepers · Computer Science

Sleepers in Computation and Language (cs.CL)

A sleeper is an older paper whose citations suddenly took off: at least five years old, and cited far more in the last year than it used to be. Ranked by how sharp the take-off is (last year’s citations against the paper’s earlier yearly rate); see also the canon, the most-cited of all time.

Provisional: citations here are counted from the reference lists collected so far, which cover 8% of arXiv papers, so the chart fills in as the collection runs. Rebuilt nightly; as of 15 November 2026.

More archives

Computer Science by category

24 more categories

Showing 1–50 of 399 sleepers in cs.CL RSS

Sleepers in cs.CL: older papers whose citations took off in the last year
Rank#	Paper	Year	The take-off
1	Attention Is All You Need Ashish Vaswani, Noam Shazeer, Niki Parmar +5 more 20173,293 citations last year · ~0 a year before	2017	3,293 citations in the last year vs ~0 a year before
2	LoRA: Low-Rank Adaptation of Large Language Models Edward J. Hu, Yelong Shen, Phillip Wallis +5 more 20211,949 citations last year · ~0 a year before	2021	1,949 citations in the last year vs ~0 a year before
3	Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks Patrick Lewis, Ethan Perez, Aleksandra Piktus +9 more 20201,571 citations last year · ~0 a year before	2020	1,571 citations in the last year vs ~0 a year before
4	Language Models are Few-Shot Learners Tom B. Brown, Benjamin Mann, Nick Ryder +28 more 20201,326 citations last year · ~0 a year before	2020	1,326 citations in the last year vs ~0 a year before
5	BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin, Ming-Wei Chang, Kenton Lee +1 more 20181,158 citations last year · ~0 a year before	2018	1,158 citations in the last year vs ~0 a year before
6	Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers, Iryna Gurevych 2019964 citations last year · ~0 a year before	2019	964 citations in the last year vs ~0 a year before
7	RoFormer: Enhanced Transformer with Rotary Position Embedding Jianlin Su, Yu Lu, Shengfeng Pan +3 more 2021823 citations last year · ~0 a year before	2021	823 citations in the last year vs ~0 a year before
8	HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering Zhilin Yang, Peng Qi, Saizheng Zhang +4 more 2018608 citations last year · ~0 a year before	2018	608 citations in the last year vs ~0 a year before
9	HellaSwag: Can a Machine Really Finish Your Sentence? Rowan Zellers, Ari Holtzman, Yonatan Bisk +2 more 2019549 citations last year · ~0 a year before	2019	549 citations in the last year vs ~0 a year before
10	Dense Passage Retrieval for Open-Domain Question Answering Vladimir Karpukhin, Barlas Oğuz, Sewon Min +5 more 2020534 citations last year · ~0 a year before	2020	534 citations in the last year vs ~0 a year before
11	Pointer Sentinel Mixture Models Stephen Merity, Caiming Xiong, James Bradbury +1 more 2016470 citations last year · ~0 a year before	2016	470 citations in the last year vs ~0 a year before
12	RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu, Myle Ott, Naman Goyal +7 more 2019407 citations last year · ~0 a year before	2019	407 citations in the last year vs ~0 a year before
13	ALFWorld: Aligning Text and Embodied Environments for Interactive Learning Mohit Shridhar, Xingdi Yuan, Marc-Alexandre Côté +3 more 2020399 citations last year · ~0 a year before	2020	399 citations in the last year vs ~0 a year before
14	PIQA: Reasoning about Physical Commonsense in Natural Language Yonatan Bisk, Rowan Zellers, Ronan Le Bras +2 more 2019389 citations last year · ~0 a year before	2019	389 citations in the last year vs ~0 a year before
15	BERTScore: Evaluating Text Generation with BERT Tianyi Zhang, Varsha Kishore, Felix Wu +2 more 2019381 citations last year · ~0 a year before	2019	381 citations in the last year vs ~0 a year before
16	WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing Sanyuan Chen, Chengyi Wang, Zhengyang Chen +16 more 2021340 citations last year · ~0 a year before	2021	340 citations in the last year vs ~0 a year before
17	wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations Alexei Baevski, Henry Zhou, Abdelrahman Mohamed +1 more 2020336 citations last year · ~0 a year before	2020	336 citations in the last year vs ~0 a year before
18	TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension Mandar Joshi, Eunsol Choi, Daniel S. Weld +1 more 2017331 citations last year · ~0 a year before	2017	331 citations in the last year vs ~0 a year before
19	TruthfulQA: Measuring How Models Mimic Human Falsehoods Stephanie Lin, Jacob Hilton, Owain Evans 2021330 citations last year · ~0 a year before	2021	330 citations in the last year vs ~0 a year before
20	Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation Kyunghyun Cho, Bart van Merrienboer, Caglar Gulcehre +4 more 2014311 citations last year · ~0 a year before	2014	311 citations in the last year vs ~0 a year before
21	Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Steps Xanh Ho, Anh-Khoa Duong Nguyen, Saku Sugawara +1 more 2020297 citations last year · ~0 a year before	2020	297 citations in the last year vs ~0 a year before
22	MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers Wenhui Wang, Furu Wei, Li Dong +3 more 2020270 citations last year · ~0 a year before	2020	270 citations in the last year vs ~0 a year before
23	Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering Todor Mihaylov, Peter Clark, Tushar Khot +1 more 2018267 citations last year · ~0 a year before	2018	267 citations in the last year vs ~0 a year before
24	MuSiQue: Multihop Questions via Single-hop Question Composition Harsh Trivedi, Niranjan Balasubramanian, Tushar Khot +1 more 2021265 citations last year · ~0 a year before	2021	265 citations in the last year vs ~0 a year before
25	BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions Christopher Clark, Kenton Lee, Ming-Wei Chang +3 more 2019256 citations last year · ~0 a year before	2019	256 citations in the last year vs ~0 a year before
26	HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units Wei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai +3 more 2021251 citations last year · ~0 a year before	2021	251 citations in the last year vs ~0 a year before
27	Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism Mohammad Shoeybi, Mostofa Patwary, Raul Puri +3 more 2019243 citations last year · ~0 a year before	2019	243 citations in the last year vs ~0 a year before
28	Sequence-Level Knowledge Distillation Yoon Kim, Alexander M. Rush 2016241 citations last year · ~0 a year before	2016	241 citations in the last year vs ~0 a year before
29	DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter Victor Sanh, Lysandre Debut, Julien Chaumond +1 more 2019240 citations last year · ~0 a year before	2019	240 citations in the last year vs ~0 a year before
30	GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding Dmitry Lepikhin, HyoukJoong Lee, Yuanzhong Xu +6 more 2020240 citations last year · ~0 a year before	2020	240 citations in the last year vs ~0 a year before
31	What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Exams Di Jin, Eileen Pan, Nassim Oufattole +3 more 2020239 citations last year · ~0 a year before	2020	239 citations in the last year vs ~0 a year before
32	Prefix-Tuning: Optimizing Continuous Prompts for Generation Xiang Lisa Li, Percy Liang 2021229 citations last year · ~0 a year before	2021	229 citations in the last year vs ~0 a year before
33	Probing Classifiers: Promises, Shortcomings, and Advances Yonatan Belinkov 2021228 citations last year · ~0 a year before	2021	228 citations in the last year vs ~0 a year before
34	Designing and Interpreting Probes with Control Tasks John Hewitt, Percy Liang 2019222 citations last year · ~0 a year before	2019	222 citations in the last year vs ~0 a year before
35	The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester, Rami Al-Rfou, Noah Constant 2021215 citations last year · ~0 a year before	2021	215 citations in the last year vs ~0 a year before
36	Longformer: The Long-Document Transformer Iz Beltagy, Matthew E. Peters, Arman Cohan 2020205 citations last year · ~0 a year before	2020	205 citations in the last year vs ~0 a year before
37	Towards VQA Models That Can Read Amanpreet Singh, Vivek Natarajan, Meet Shah +5 more 2019202 citations last year · ~0 a year before	2019	202 citations in the last year vs ~0 a year before
38	Unsupervised Cross-lingual Representation Learning at Scale Alexis Conneau, Kartikay Khandelwal, Naman Goyal +7 more 2019201 citations last year · ~0 a year before	2019	201 citations in the last year vs ~0 a year before
39	GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Wang, Amanpreet Singh, Julian Michael +3 more 2018196 citations last year · ~0 a year before	2018	196 citations in the last year vs ~0 a year before
40	SQuAD: 100,000+ Questions for Machine Comprehension of Text Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev +1 more 2016195 citations last year · ~0 a year before	2016	195 citations in the last year vs ~0 a year before
41	The Curious Case of Neural Text Degeneration Ari Holtzman, Jan Buys, Li Du +2 more 2019186 citations last year · ~0 a year before	2019	186 citations in the last year vs ~0 a year before
42	Beyond Accuracy: Behavioral Testing of NLP models with CheckList Marco Tulio Ribeiro, Tongshuang Wu, Carlos Guestrin +1 more 2020184 citations last year · ~0 a year before	2020	184 citations in the last year vs ~0 a year before
43	Universal Transformers Mostafa Dehghani, Stephan Gouws, Oriol Vinyals +2 more 2018179 citations last year · ~0 a year before	2018	179 citations in the last year vs ~0 a year before
44	Transformer Feed-Forward Layers Are Key-Value Memories Mor Geva, Roei Schuster, Jonathan Berant +1 more 2020174 citations last year · ~0 a year before	2020	174 citations in the last year vs ~0 a year before
45	Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Task Tao Yu, Rui Zhang, Kai Yang +9 more 2018171 citations last year · ~0 a year before	2018	171 citations in the last year vs ~0 a year before
46	PubMedQA: A Dataset for Biomedical Research Question Answering Qiao Jin, Bhuwan Dhingra, Zhengping Liu +2 more 2019165 citations last year · ~0 a year before	2019	165 citations in the last year vs ~0 a year before
47	Common Voice: A Massively-Multilingual Speech Corpus Rosana Ardila, Megan Branson, Kelly Davis +7 more 2019165 citations last year · ~0 a year before	2019	165 citations in the last year vs ~0 a year before
48	Learning to summarize from human feedback Nisan Stiennon, Long Ouyang, Jeff Wu +6 more 2020164 citations last year · ~0 a year before	2020	164 citations in the last year vs ~0 a year before
49	REALM: Retrieval-Augmented Language Model Pre-Training Kelvin Guu, Kenton Lee, Zora Tung +2 more 2020159 citations last year · ~0 a year before	2020	159 citations in the last year vs ~0 a year before
50	DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing Pengcheng He, Jianfeng Gao, Weizhu Chen 2021159 citations last year · ~0 a year before	2021	159 citations in the last year vs ~0 a year before