Sleepers · Computer Science
Sleepers in Machine Learning (cs.LG)
A sleeper is an older paper whose citations suddenly took off: at least five years old, and cited far more in the last year than it used to be. Ranked by how sharp the take-off is (last year’s citations against the paper’s earlier yearly rate); see also the canon, the most-cited of all time.
Provisional: citations here are counted from the reference lists collected so far, which cover 8% of arXiv papers, so the chart fills in as the collection runs. Rebuilt nightly; as of 16 November 2026.
- All of arXiv
- Computer Science cs
- Mathematics math
- Astrophysics astro-ph
- Condensed Matter cond-mat
- HEP Phenomenology hep-ph
- HEP Theory hep-th
- Quantum Physics quant-ph
- General Relativity gr-qc
- Statistics stat
- Electrical Engineering eess
- Physics physics
- Quant. Biology q-bio
- Quant. Finance q-fin
- Economics econ
- Nonlinear Sciences nlin
- Math. Physics math-ph
More archives
Computer Science by category
- Artificial Intelligence cs.AI
- Hardware Architecture cs.AR
- Computational Complexity cs.CC
- Computational Engineering cs.CE
- Computational Geometry cs.CG
- Computation and Language cs.CL
- Cryptography and Security cs.CR
- Computer Vision cs.CV
- Computers and Society cs.CY
- Databases cs.DB
- Distributed Computing cs.DC
- Digital Libraries cs.DL
- Discrete Mathematics cs.DM
- Data Structures and Algorithms cs.DS
- Machine Learning cs.LG
23 more categories
- Emerging Technologies cs.ET
- Formal Languages cs.FL
- Graphics cs.GR
- Game Theory cs.GT
- Human-Computer Interaction cs.HC
- Information Retrieval cs.IR
- Information Theory cs.IT
- Logic in Computer Science cs.LO
- Multiagent Systems cs.MA
- Multimedia cs.MM
- Mathematical Software cs.MS
- Numerical Analysis cs.NA
- Neural and Evolutionary Computing cs.NE
- Networking and Internet Architecture cs.NI
- Operating Systems cs.OS
- Performance cs.PF
- Programming Languages cs.PL
- Robotics cs.RO
- Symbolic Computation cs.SC
- Sound cs.SD
- Software Engineering cs.SE
- Social and Information Networks cs.SI
- Systems and Control cs.SY
Showing 1–50 of 955 sleepers in cs.LG RSS
| Rank# | Paper | Year | The take-off |
|---|---|---|---|
| 1 | Proximal Policy Optimization Algorithms John Schulman, Filip Wolski, Prafulla Dhariwal +2 more 20171,897 citations last year · ~0 a year before | 2017 | 1,897 citations in the last year vs ~0 a year before |
| 2 | Denoising Diffusion Probabilistic Models Jonathan Ho, Ajay Jain, Pieter Abbeel 20201,762 citations last year · ~0 a year before | 2020 | 1,762 citations in the last year vs ~0 a year before |
| 3 | Training Verifiers to Solve Math Word Problems Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian +9 more 20211,643 citations last year · ~0 a year before | 2021 | 1,643 citations in the last year vs ~0 a year before |
| 4 | Evaluating Large Language Models Trained on Code Mark Chen, Jerry Tworek, Heewoo Jun +55 more 20211,188 citations last year · ~0 a year before | 2021 | 1,188 citations in the last year vs ~0 a year before |
| 5 | Adam: A Method for Stochastic Optimization 20141,085 citations last year · ~0 a year before | 2014 | 1,085 citations in the last year vs ~0 a year before |
| 6 | PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke, Sam Gross, Francisco Massa +18 more 20191,015 citations last year · ~0 a year before | 2019 | 1,015 citations in the last year vs ~0 a year before |
| 7 | Measuring Mathematical Problem Solving With the MATH Dataset Dan Hendrycks, Collin Burns, Saurav Kadavath +5 more 2021981 citations last year · ~0 a year before | 2021 | 981 citations in the last year vs ~0 a year before |
| 8 | On Calibration of Modern Neural Networks Chuan Guo, Geoff Pleiss, Yu Sun +1 more 2017915 citations last year · ~0 a year before | 2017 | 915 citations in the last year vs ~0 a year before |
| 9 | Score-Based Generative Modeling through Stochastic Differential Equations Yang Song, Jascha Sohl-Dickstein, Diederik P. Kingma +3 more 2020863 citations last year · ~0 a year before | 2020 | 863 citations in the last year vs ~0 a year before |
| 10 | Scikit-learn: Machine Learning in Python Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort +16 more 2012728 citations last year · ~0 a year before | 2012 | 728 citations in the last year vs ~0 a year before |
| 11 | Denoising Diffusion Implicit Models Jiaming Song, Chenlin Meng, Stefano Ermon 2020721 citations last year · ~0 a year before | 2020 | 721 citations in the last year vs ~0 a year before |
| 12 | XGBoost: A Scalable Tree Boosting System 2016651 citations last year · ~0 a year before | 2016 | 651 citations in the last year vs ~0 a year before |
| 13 | Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz +4 more 2017597 citations last year · ~0 a year before | 2017 | 597 citations in the last year vs ~0 a year before |
| 14 | Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel, Noam Shazeer, Adam Roberts +6 more 2019591 citations last year · ~0 a year before | 2019 | 591 citations in the last year vs ~0 a year before |
| 15 | Representation Learning with Contrastive Predictive Coding Aaron van den Oord, Yazhe Li, Oriol Vinyals 2018566 citations last year · ~0 a year before | 2018 | 566 citations in the last year vs ~0 a year before |
| 16 | A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning Stephane Ross, Geoffrey J. Gordon, J. Andrew Bagnell 2010564 citations last year · ~0 a year before | 2010 | 564 citations in the last year vs ~0 a year before |
| 17 | Scaling Laws for Neural Language Models Jared Kaplan, Sam McCandlish, Tom Henighan +7 more 2020541 citations last year · ~0 a year before | 2020 | 541 citations in the last year vs ~0 a year before |
| 18 | Communication-Efficient Learning of Deep Networks from Decentralized Data H. Brendan McMahan, Eider Moore, Daniel Ramage +2 more 2016539 citations last year · ~0 a year before | 2016 | 539 citations in the last year vs ~0 a year before |
| 19 | Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity William Fedus, Barret Zoph, Noam Shazeer 2021537 citations last year · ~0 a year before | 2021 | 537 citations in the last year vs ~0 a year before |
| 20 | A Simple Framework for Contrastive Learning of Visual Representations Ting Chen, Simon Kornblith, Mohammad Norouzi +1 more 2020507 citations last year · ~0 a year before | 2020 | 507 citations in the last year vs ~0 a year before |
| 21 | Fourier Neural Operator for Parametric Partial Differential Equations Zongyi Li, Nikola Kovachki, Kamyar Azizzadenesheli +4 more 2020497 citations last year · ~0 a year before | 2020 | 497 citations in the last year vs ~0 a year before |
| 22 | Diffusion Models Beat GANs on Image Synthesis Prafulla Dhariwal, Alex Nichol 2021493 citations last year · ~0 a year before | 2021 | 493 citations in the last year vs ~0 a year before |
| 23 | Semi-Supervised Classification with Graph Convolutional Networks 2016485 citations last year · ~0 a year before | 2016 | 485 citations in the last year vs ~0 a year before |
| 24 | Overcoming catastrophic forgetting in neural networks James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz +11 more 2016448 citations last year · ~0 a year before | 2016 | 448 citations in the last year vs ~0 a year before |
| 25 | Selective Classification for Deep Neural Networks 2017416 citations last year · ~0 a year before | 2017 | 416 citations in the last year vs ~0 a year before |
| 26 | nuScenes: A multimodal dataset for autonomous driving Holger Caesar, Varun Bankiti, Alex H. Lang +7 more 2019383 citations last year · ~0 a year before | 2019 | 383 citations in the last year vs ~0 a year before |
| 27 | Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor Tuomas Haarnoja, Aurick Zhou, Pieter Abbeel +1 more 2018382 citations last year · ~0 a year before | 2018 | 382 citations in the last year vs ~0 a year before |
| 28 | Neural Ordinary Differential Equations Ricky T. Q. Chen, Yulia Rubanova, Jesse Bettencourt +1 more 2018373 citations last year · ~0 a year before | 2018 | 373 citations in the last year vs ~0 a year before |
| 29 | Neural Discrete Representation Learning Aaron van den Oord, Oriol Vinyals, Koray Kavukcuoglu 2017370 citations last year · ~0 a year before | 2017 | 370 citations in the last year vs ~0 a year before |
| 30 | Optuna: A Next-generation Hyperparameter Optimization Framework Takuya Akiba, Shotaro Sano, Toshihiko Yanase +2 more 2019367 citations last year · ~0 a year before | 2019 | 367 citations in the last year vs ~0 a year before |
| 31 | DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators Lu Lu, Pengzhan Jin, George Em Karniadakis 2019365 citations last year · ~0 a year before | 2019 | 365 citations in the last year vs ~0 a year before |
| 32 | Deep Unsupervised Learning using Nonequilibrium Thermodynamics Jascha Sohl-Dickstein, Eric A. Weiss, Niru Maheswaranathan +1 more 2015362 citations last year · ~0 a year before | 2015 | 362 citations in the last year vs ~0 a year before |
| 33 | Similarity of Neural Network Representations Revisited Simon Kornblith, Mohammad Norouzi, Honglak Lee +1 more 2019351 citations last year · ~0 a year before | 2019 | 351 citations in the last year vs ~0 a year before |
| 34 | Dream to Control: Learning Behaviors by Latent Imagination Danijar Hafner, Timothy Lillicrap, Jimmy Ba +1 more 2019348 citations last year · ~0 a year before | 2019 | 348 citations in the last year vs ~0 a year before |
| 35 | Parameter-Efficient Transfer Learning for NLP Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzebski +5 more 2019331 citations last year · ~0 a year before | 2019 | 331 citations in the last year vs ~0 a year before |
| 36 | Structured Denoising Diffusion Models in Discrete State-Spaces Jacob Austin, Daniel D. Johnson, Jonathan Ho +2 more 2021322 citations last year · ~0 a year before | 2021 | 322 citations in the last year vs ~0 a year before |
| 37 | 2018 | 321 citations in the last year vs ~0 a year before | |
| 38 | Learning Latent Dynamics for Planning from Pixels Danijar Hafner, Timothy Lillicrap, Ian Fischer +4 more 2018307 citations last year · ~0 a year before | 2018 | 307 citations in the last year vs ~0 a year before |
| 39 | SGDR: Stochastic Gradient Descent with Warm Restarts 2016296 citations last year · ~0 a year before | 2016 | 296 citations in the last year vs ~0 a year before |
| 40 | Root Mean Square Layer Normalization 2019287 citations last year · ~0 a year before | 2019 | 287 citations in the last year vs ~0 a year before |
| 41 | High-Dimensional Continuous Control Using Generalized Advantage Estimation John Schulman, Philipp Moritz, Sergey Levine +2 more 2015280 citations last year · ~0 a year before | 2015 | 280 citations in the last year vs ~0 a year before |
| 42 | Axiomatic Attribution for Deep Networks Mukund Sundararajan, Ankur Taly, Qiqi Yan 2017274 citations last year · ~0 a year before | 2017 | 274 citations in the last year vs ~0 a year before |
| 43 | 2020 | 266 citations in the last year vs ~0 a year before | |
| 44 | EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks 2019265 citations last year · ~0 a year before | 2019 | 265 citations in the last year vs ~0 a year before |
| 45 | "Why Should I Trust You?": Explaining the Predictions of Any Classifier Marco Tulio Ribeiro, Sameer Singh, Carlos Guestrin 2016261 citations last year · ~0 a year before | 2016 | 261 citations in the last year vs ~0 a year before |
| 46 | Efficiently Modeling Long Sequences with Structured State Spaces Albert Gu, Karan Goel, Christopher Ré 2021258 citations last year · ~0 a year before | 2021 | 258 citations in the last year vs ~0 a year before |
| 47 | Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention Angelos Katharopoulos, Apoorv Vyas, Nikolaos Pappas +1 more 2020256 citations last year · ~0 a year before | 2020 | 256 citations in the last year vs ~0 a year before |
| 48 | Gaussian Error Linear Units (GELUs) 2016256 citations last year · ~0 a year before | 2016 | 256 citations in the last year vs ~0 a year before |
| 49 | Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill, Florian Strub, Florent Altché +11 more 2020232 citations last year · ~0 a year before | 2020 | 232 citations in the last year vs ~0 a year before |
| 50 | Gradient Surgery for Multi-Task Learning Tianhe Yu, Saurabh Kumar, Abhishek Gupta +3 more 2020231 citations last year · ~0 a year before | 2020 | 231 citations in the last year vs ~0 a year before |