The Canon · Computer Science

The most-cited papers in Machine Learning cs.LG

Ranked by citation count from Semantic Scholar; papers count in their primary category only. The top 250, fifty to a page. For papers whose citations only just took off, see the sleepers.

Provisional: built from 480,031 of about 3.2 million arXiv papers with fresh Semantic Scholar citation counts so far (most-cited first), so some classics are still missing. Counts as of 15 November 2026.

More archives

Retired archives

Computer Science by category

8 more categories

Showing 1–50 of the top 250 · 29,178 papers in cs.LG counted so far

The most-cited papers in cs.LG, ranked by Semantic Scholar citations
Rank#	Paper	Year	Citations	Influential	Per year
1	Adam: A Method for Stochastic Optimization Diederik P. Kingma, Jimmy Ba 2014171,737 citations, 13,210 a year	2014	171,737	27,147	13,210
2	Scikit-learn: Machine Learning in Python Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort +16 more 201295,273 citations, 6,352 a year	2012	95,273	8,559	6,352
3	XGBoost: A Scalable Tree Boosting System Tianqi Chen, Carlos Guestrin 201662,950 citations, 5,723 a year	2016	62,950	4,658	5,723
4	PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke, Sam Gross, Francisco Massa +18 more 201955,920 citations, 6,990 a year	2019	55,920	6,066	6,990
5	Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe, Christian Szegedy 201547,880 citations, 3,990 a year	2015	47,880	2,327	3,990
6	Semi-Supervised Classification with Graph Convolutional Networks Thomas N. Kipf, Max Welling 201637,450 citations, 3,404 a year	2016	37,450	7,537	3,404
7	Denoising Diffusion Probabilistic Models Jonathan Ho, Ajay Jain, Pieter Abbeel 202035,735 citations, 5,105 a year	2020	35,735	4,958	5,105
8	Proximal Policy Optimization Algorithms John Schulman, Filip Wolski, Prafulla Dhariwal +2 more 201731,666 citations, 3,167 a year	2017	31,666	5,239	3,167
9	Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel, Noam Shazeer, Adam Roberts +6 more 201927,534 citations, 3,442 a year	2019	27,534	2,639	3,442
10	Communication-Efficient Learning of Deep Networks from Decentralized Data H. Brendan McMahan, Eider Moore, Daniel Ramage +2 more 201627,503 citations, 2,500 a year	2016	27,503	5,374	2,500
11	EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks Mingxing Tan, Quoc V. Le 201926,549 citations, 3,319 a year	2019	26,549	2,687	3,319
12	A Simple Framework for Contrastive Learning of Visual Representations Ting Chen, Simon Kornblith, Mohammad Norouzi +1 more 202026,445 citations, 3,778 a year	2020	26,445	4,213	3,778
13	"Why Should I Trust You?": Explaining the Predictions of Any Classifier Marco Tulio Ribeiro, Sameer Singh, Carlos Guestrin 201624,614 citations, 2,238 a year	2016	24,614	2,288	2,238
14	Continuous control with deep reinforcement learning Timothy P. Lillicrap, Jonathan J. Hunt, Alexander Pritzel +5 more 201516,113 citations, 1,343 a year	2015	16,113	2,240	1,343
15	Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks Alec Radford, Luke Metz, Soumith Chintala 201515,302 citations, 1,275 a year	2015	15,302	1,759	1,275
16	Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn, Pieter Abbeel, Sergey Levine 201715,239 citations, 1,524 a year	2017	15,239	2,753	1,524
17	Representation Learning with Contrastive Predictive Coding Aaron van den Oord, Yazhe Li, Oriol Vinyals 201814,652 citations, 1,628 a year	2018	14,652	1,614	1,628
18	Playing Atari with Deep Reinforcement Learning Volodymyr Mnih, Koray Kavukcuoglu, David Silver +4 more 201314,043 citations, 1,003 a year	2013	14,043	1,499	1,003
19	Denoising Diffusion Implicit Models Jiaming Song, Chenlin Meng, Stefano Ermon 202013,692 citations, 1,956 a year	2020	13,692	1,829	1,956
20	Diffusion Models Beat GANs on Image Synthesis Prafulla Dhariwal, Alex Nichol 202113,153 citations, 2,192 a year	2021	13,153	1,191	2,192
21	Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor Tuomas Haarnoja, Aurick Zhou, Pieter Abbeel +1 more 201812,512 citations, 1,390 a year	2018	12,512	2,133	1,390
22	mixup: Beyond Empirical Risk Minimization Hongyi Zhang, Moustapha Cisse, Yann N. Dauphin +1 more 201712,448 citations, 1,245 a year	2017	12,448	1,823	1,245
23	Score-Based Generative Modeling through Stochastic Differential Equations Yang Song, Jascha Sohl-Dickstein, Diederik P. Kingma +3 more 202012,312 citations, 1,759 a year	2020	12,312	2,009	1,759
24	A Comprehensive Survey on Graph Neural Networks Zonghan Wu, Shirui Pan, Fengwen Chen +3 more 201912,103 citations, 1,513 a year	2019	12,103	532	1,513
25	Conditional Generative Adversarial Nets Mehdi Mirza, Simon Osindero 201411,881 citations, 914 a year	2014	11,881	1,146	914
26	Optuna: A Next-generation Hyperparameter Optimization Framework Takuya Akiba, Shotaro Sano, Toshihiko Yanase +2 more 201911,852 citations, 1,482 a year	2019	11,852	691	1,482
27	Evaluating Large Language Models Trained on Code Mark Chen, Jerry Tworek, Heewoo Jun +55 more 202111,833 citations, 1,972 a year	2021	11,833	1,771	1,972
28	SGDR: Stochastic Gradient Descent with Warm Restarts Ilya Loshchilov, Frank Hutter 201611,429 citations, 1,039 a year	2016	11,429	1,554	1,039
29	Improved Training of Wasserstein GANs Ishaan Gulrajani, Faruk Ahmed, Martin Arjovsky +2 more 201711,267 citations, 1,127 a year	2017	11,267	1,589	1,127
30	Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms Han Xiao, Kashif Rasul, Roland Vollgraf 201711,205 citations, 1,120 a year	2017	11,205	1,706	1,120
31	Overcoming catastrophic forgetting in neural networks James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz +11 more 201611,091 citations, 1,008 a year	2016	11,091	1,484	1,008
32	Training Verifiers to Solve Math Word Problems Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian +9 more 202111,014 citations, 1,836 a year	2021	11,014	2,436	1,836
33	Show, Attend and Tell: Neural Image Caption Generation with Visual Attention Kelvin Xu, Jimmy Ba, Ryan Kiros +5 more 201510,951 citations, 913 a year	2015	10,951	824	913
34	Direct Preference Optimization: Your Language Model is Secretly a Reward Model Rafael Rafailov, Archit Sharma, Eric Mitchell +3 more 202310,844 citations, 2,711 a year	2023	10,844	2,245	2,711
35	Improved Techniques for Training GANs Tim Salimans, Ian Goodfellow, Wojciech Zaremba +3 more 201610,700 citations, 973 a year	2016	10,700	991	973
36	Prototypical Networks for Few-shot Learning Jake Snell, Kevin Swersky, Richard S. Zemel 201710,656 citations, 1,066 a year	2017	10,656	1,940	1,066
37	How Powerful are Graph Neural Networks? Keyulu Xu, Weihua Hu, Jure Leskovec +1 more 201810,562 citations, 1,174 a year	2018	10,562	1,833	1,174
38	Asynchronous Methods for Deep Reinforcement Learning Volodymyr Mnih, Adrià Puigdomènech Badia, Mehdi Mirza +5 more 201610,384 citations, 944 a year	2016	10,384	1,342	944
39	On Calibration of Modern Neural Networks Chuan Guo, Geoff Pleiss, Yu Sun +1 more 201710,157 citations, 1,016 a year	2017	10,157	1,676	1,016
40	Advances and Open Problems in Federated Learning Peter Kairouz, H. Brendan McMahan, Brendan Avent +56 more 20199,691 citations, 1,211 a year	2019	9,691	611	1,211
41	Neural Message Passing for Quantum Chemistry Justin Gilmer, Samuel S. Schoenholz, Patrick F. Riley +2 more 20179,612 citations, 961 a year	2017	9,612	883	961
42	How transferable are features in deep neural networks? Jason Yosinski, Jeff Clune, Yoshua Bengio +1 more 20149,570 citations, 736 a year	2014	9,570	467	736
43	Deep Reinforcement Learning with Double Q-learning Hado van Hasselt, Arthur Guez, David Silver 20159,557 citations, 796 a year	2015	9,557	981	796
44	Mamba: Linear-Time Sequence Modeling with Selective State Spaces Albert Gu, Tri Dao 20239,356 citations, 2,339 a year	2023	9,356	1,330	2,339
45	Scaling Laws for Neural Language Models Jared Kaplan, Sam McCandlish, Tom Henighan +7 more 20209,184 citations, 1,312 a year	2020	9,184	636	1,312
46	Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill, Florian Strub, Florent Altché +11 more 20209,145 citations, 1,306 a year	2020	9,145	1,351	1,306
47	nuScenes: A multimodal dataset for autonomous driving Holger Caesar, Varun Bankiti, Alex H. Lang +7 more 20199,088 citations, 1,136 a year	2019	9,088	1,424	1,136
48	Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting Haoyi Zhou, Shanghang Zhang, Jieqi Peng +4 more 20209,088 citations, 1,298 a year	2020	9,088	818	1,298
49	Federated Optimization in Heterogeneous Networks Tian Li, Anit Kumar Sahu, Manzil Zaheer +3 more 20189,084 citations, 1,009 a year	2018	9,084	1,416	1,009
50	Axiomatic Attribution for Deep Networks Mukund Sundararajan, Ankur Taly, Qiqi Yan 20178,871 citations, 887 a year	2017	8,871	1,126	887

Citation data from Semantic Scholar, via the Semantic Scholar Academic Graph API.