Sleepers · All of arXiv

Sleepers on arXiv

A sleeper is an older paper whose citations suddenly took off: at least five years old, and cited far more in the last year than it used to be. Ranked by how sharp the take-off is (last year’s citations against the paper’s earlier yearly rate); see also the canon, the most-cited of all time.

Provisional: citations here are counted from the reference lists collected so far, which cover 8% of arXiv papers, so the chart fills in as the collection runs. Rebuilt nightly; as of 15 November 2026.

Showing 1–50 of 5,000 sleepers RSS

Sleepers: older papers whose citations took off in the last year
Rank#	Paper	Year	The take-off
1	Attention Is All You Need Ashish Vaswani, Noam Shazeer, Niki Parmar +5 more cs.CL20173,293 citations last year · ~0 a year before	2017	3,293 citations in the last year vs ~0 a year before
2	Learning Transferable Visual Models From Natural Language Supervision Alec Radford, Jong Wook Kim, Chris Hallacy +9 more cs.CV20212,707 citations last year · ~0 a year before	2021	2,707 citations in the last year vs ~0 a year before
3	Deep Residual Learning for Image Recognition Kaiming He, Xiangyu Zhang, Shaoqing Ren +1 more cs.CV20151,988 citations last year · ~0 a year before	2015	1,988 citations in the last year vs ~0 a year before
4	LoRA: Low-Rank Adaptation of Large Language Models Edward J. Hu, Yelong Shen, Phillip Wallis +5 more cs.CL20211,949 citations last year · ~0 a year before	2021	1,949 citations in the last year vs ~0 a year before
5	Proximal Policy Optimization Algorithms John Schulman, Filip Wolski, Prafulla Dhariwal +2 more cs.LG20171,897 citations last year · ~0 a year before	2017	1,897 citations in the last year vs ~0 a year before
6	Denoising Diffusion Probabilistic Models Jonathan Ho, Ajay Jain, Pieter Abbeel cs.LG20201,762 citations last year · ~0 a year before	2020	1,762 citations in the last year vs ~0 a year before
7	An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov +9 more cs.CV20201,685 citations last year · ~0 a year before	2020	1,685 citations in the last year vs ~0 a year before
8	Training Verifiers to Solve Math Word Problems Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian +9 more cs.LG20211,643 citations last year · ~0 a year before	2021	1,643 citations in the last year vs ~0 a year before
9	Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks Patrick Lewis, Ethan Perez, Aleksandra Piktus +9 more cs.CL20201,571 citations last year · ~0 a year before	2020	1,571 citations in the last year vs ~0 a year before
10	Language Models are Few-Shot Learners Tom B. Brown, Benjamin Mann, Nick Ryder +28 more cs.CL20201,326 citations last year · ~0 a year before	2020	1,326 citations in the last year vs ~0 a year before
11	The Unreasonable Effectiveness of Deep Features as a Perceptual Metric Richard Zhang, Phillip Isola, Alexei A. Efros +2 more cs.CV20181,218 citations last year · ~0 a year before	2018	1,218 citations in the last year vs ~0 a year before
12	Evaluating Large Language Models Trained on Code Mark Chen, Jerry Tworek, Heewoo Jun +55 more cs.LG20211,188 citations last year · ~0 a year before	2021	1,188 citations in the last year vs ~0 a year before
13	BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin, Ming-Wei Chang, Kenton Lee +1 more cs.CL20181,158 citations last year · ~0 a year before	2018	1,158 citations in the last year vs ~0 a year before
14	Adam: A Method for Stochastic Optimization Diederik P. Kingma, Jimmy Ba cs.LG20141,085 citations last year · ~0 a year before	2014	1,085 citations in the last year vs ~0 a year before
15	PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke, Sam Gross, Francisco Massa +18 more cs.LG20191,015 citations last year · ~0 a year before	2019	1,015 citations in the last year vs ~0 a year before
16	Distilling the Knowledge in a Neural Network Geoffrey Hinton, Oriol Vinyals, Jeff Dean stat.ML20151,003 citations last year · ~0 a year before	2015	1,003 citations in the last year vs ~0 a year before
17	Measuring Massive Multitask Language Understanding Dan Hendrycks, Collin Burns, Steven Basart +4 more cs.CY2020986 citations last year · ~0 a year before	2020	986 citations in the last year vs ~0 a year before
18	Measuring Mathematical Problem Solving With the MATH Dataset Dan Hendrycks, Collin Burns, Saurav Kadavath +5 more cs.LG2021981 citations last year · ~0 a year before	2021	981 citations in the last year vs ~0 a year before
19	Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers, Iryna Gurevych cs.CL2019964 citations last year · ~0 a year before	2019	964 citations in the last year vs ~0 a year before
20	U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger, Philipp Fischer, Thomas Brox cs.CV2015959 citations last year · ~0 a year before	2015	959 citations in the last year vs ~0 a year before
21	On Calibration of Modern Neural Networks Chuan Guo, Geoff Pleiss, Yu Sun +1 more cs.LG2017915 citations last year · ~0 a year before	2017	915 citations in the last year vs ~0 a year before
22	Microsoft COCO: Common Objects in Context Tsung-Yi Lin, Michael Maire, Serge Belongie +7 more cs.CV2014872 citations last year · ~0 a year before	2014	872 citations in the last year vs ~0 a year before
23	Score-Based Generative Modeling through Stochastic Differential Equations Yang Song, Jascha Sohl-Dickstein, Diederik P. Kingma +3 more cs.LG2020863 citations last year · ~0 a year before	2020	863 citations in the last year vs ~0 a year before
24	RoFormer: Enhanced Transformer with Rotary Position Embedding Jianlin Su, Yu Lu, Shengfeng Pan +3 more cs.CL2021823 citations last year · ~0 a year before	2021	823 citations in the last year vs ~0 a year before
25	Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge Peter Clark, Isaac Cowhey, Oren Etzioni +4 more cs.AI2018739 citations last year · ~0 a year before	2018	739 citations in the last year vs ~0 a year before
26	Scikit-learn: Machine Learning in Python Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort +16 more cs.LG2012728 citations last year · ~0 a year before	2012	728 citations in the last year vs ~0 a year before
27	Denoising Diffusion Implicit Models Jiaming Song, Chenlin Meng, Stefano Ermon cs.LG2020721 citations last year · ~0 a year before	2020	721 citations in the last year vs ~0 a year before
28	XGBoost: A Scalable Tree Boosting System Tianqi Chen, Carlos Guestrin cs.LG2016651 citations last year · ~0 a year before	2016	651 citations in the last year vs ~0 a year before
29	SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python Pauli Virtanen, Ralf Gommers, Travis E. Oliphant +32 more cs.MS2019613 citations last year · ~0 a year before	2019	613 citations in the last year vs ~0 a year before
30	HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering Zhilin Yang, Peng Qi, Saizheng Zhang +4 more cs.CL2018608 citations last year · ~0 a year before	2018	608 citations in the last year vs ~0 a year before
31	Program Synthesis with Large Language Models Jacob Austin, Augustus Odena, Maxwell Nye +8 more cs.PL2021607 citations last year · ~0 a year before	2021	607 citations in the last year vs ~0 a year before
32	A Unified Approach to Interpreting Model Predictions Scott Lundberg, Su-In Lee cs.AI2017598 citations last year · ~0 a year before	2017	598 citations in the last year vs ~0 a year before
33	Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz +4 more cs.LG2017597 citations last year · ~0 a year before	2017	597 citations in the last year vs ~0 a year before
34	Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel, Noam Shazeer, Adam Roberts +6 more cs.LG2019591 citations last year · ~0 a year before	2019	591 citations in the last year vs ~0 a year before
35	FiLM: Visual Reasoning with a General Conditioning Layer Ethan Perez, Florian Strub, Harm de Vries +2 more cs.CV2017590 citations last year · ~0 a year before	2017	590 citations in the last year vs ~0 a year before
36	Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron, Hugo Touvron, Ishan Misra +4 more cs.CV2021587 citations last year · ~0 a year before	2021	587 citations in the last year vs ~0 a year before
37	Representation Learning with Contrastive Predictive Coding Aaron van den Oord, Yazhe Li, Oriol Vinyals cs.LG2018566 citations last year · ~0 a year before	2018	566 citations in the last year vs ~0 a year before
38	A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning Stephane Ross, Geoffrey J. Gordon, J. Andrew Bagnell cs.LG2010564 citations last year · ~0 a year before	2010	564 citations in the last year vs ~0 a year before
39	HellaSwag: Can a Machine Really Finish Your Sentence? Rowan Zellers, Ari Holtzman, Yonatan Bisk +2 more cs.CL2019549 citations last year · ~0 a year before	2019	549 citations in the last year vs ~0 a year before
40	Masked Autoencoders Are Scalable Vision Learners Kaiming He, Xinlei Chen, Saining Xie +3 more cs.CV2021548 citations last year · ~0 a year before	2021	548 citations in the last year vs ~0 a year before
41	Scaling Laws for Neural Language Models Jared Kaplan, Sam McCandlish, Tom Henighan +7 more cs.LG2020541 citations last year · ~0 a year before	2020	541 citations in the last year vs ~0 a year before
42	Communication-Efficient Learning of Deep Networks from Decentralized Data H. Brendan McMahan, Eider Moore, Daniel Ramage +2 more cs.LG2016539 citations last year · ~0 a year before	2016	539 citations in the last year vs ~0 a year before
43	Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity William Fedus, Barret Zoph, Noam Shazeer cs.LG2021537 citations last year · ~0 a year before	2021	537 citations in the last year vs ~0 a year before
44	Dense Passage Retrieval for Open-Domain Question Answering Vladimir Karpukhin, Barlas Oğuz, Sewon Min +5 more cs.CL2020534 citations last year · ~0 a year before	2020	534 citations in the last year vs ~0 a year before
45	Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu, Yutong Lin, Yue Cao +5 more cs.CV2021528 citations last year · ~0 a year before	2021	528 citations in the last year vs ~0 a year before
46	A Simple Framework for Contrastive Learning of Visual Representations Ting Chen, Simon Kornblith, Mohammad Norouzi +1 more cs.LG2020507 citations last year · ~0 a year before	2020	507 citations in the last year vs ~0 a year before
47	Array Programming with NumPy Charles R. Harris, K. Jarrod Millman, Stéfan J. van der Walt +23 more cs.MS2020504 citations last year · ~0 a year before	2020	504 citations in the last year vs ~0 a year before
48	Fourier Neural Operator for Parametric Partial Differential Equations Zongyi Li, Nikola Kovachki, Kamyar Azizzadenesheli +4 more cs.LG2020497 citations last year · ~0 a year before	2020	497 citations in the last year vs ~0 a year before
49	Diffusion Models Beat GANs on Image Synthesis Prafulla Dhariwal, Alex Nichol cs.LG2021493 citations last year · ~0 a year before	2021	493 citations in the last year vs ~0 a year before
50	Semi-Supervised Classification with Graph Convolutional Networks Thomas N. Kipf, Max Welling cs.LG2016485 citations last year · ~0 a year before	2016	485 citations in the last year vs ~0 a year before