The Canon · Statistics

The most-cited papers in Machine Learning (Statistics) stat.ML

Ranked by citation count from Semantic Scholar; papers count in their primary category only. The top 250, fifty to a page. For papers whose citations only just took off, see the sleepers.

Provisional: built from 480,031 of about 3.2 million arXiv papers with fresh Semantic Scholar citation counts so far (most-cited first), so some classics are still missing. Counts as of 15 November 2026.

More archives

Retired archives

Statistics by category

Showing 1–50 of the top 250 · 4,714 papers in stat.ML counted so far

The most-cited papers in stat.ML, ranked by Semantic Scholar citations
Rank#	Paper	Year	Citations	Influential	Per year
1	Graph Attention Networks Petar Veličković, Guillem Cucurull, Arantxa Casanova +3 more 201728,659 citations, 2,866 a year	2017	28,659	3,945	2,866
2	Distilling the Knowledge in a Neural Network Geoffrey Hinton, Oriol Vinyals, Jeff Dean 201526,484 citations, 2,207 a year	2015	26,484	2,934	2,207
3	Explaining and Harnessing Adversarial Examples Ian J. Goodfellow, Jonathon Shlens, Christian Szegedy 201423,240 citations, 1,788 a year	2014	23,240	4,270	1,788
4	Auto-Encoding Variational Bayes Diederik P Kingma, Max Welling 201317,336 citations, 1,238 a year	2013	17,336	3,118	1,238
5	Towards Deep Learning Models Resistant to Adversarial Attacks Aleksander Madry, Aleksandar Makelov, Ludwig Schmidt +2 more 201715,670 citations, 1,567 a year	2017	15,670	3,977	1,567
6	UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction Leland McInnes, John Healy, James Melville 201813,480 citations, 1,498 a year	2018	13,480	1,799	1,498
7	Layer Normalization Jimmy Lei Ba, Jamie Ryan Kiros, Geoffrey E. Hinton 201613,225 citations, 1,202 a year	2016	13,225	579	1,202
8	Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning Yarin Gal, Zoubin Ghahramani 201513,068 citations, 1,089 a year	2015	13,068	1,743	1,089
9	Domain-Adversarial Training of Neural Networks Yaroslav Ganin, Evgeniya Ustinova, Hana Ajakan +5 more 201512,302 citations, 1,025 a year	2015	12,302	1,708	1,025
10	Practical Bayesian Optimization of Machine Learning Algorithms Jasper Snoek, Hugo Larochelle, Ryan P. Adams 20129,998 citations, 666 a year	2012	9,998	649	666
11	Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan, Alexander Pritzel, Charles Blundell 20168,723 citations, 793 a year	2016	8,723	942	793
12	Deep Learning with Differential Privacy Martín Abadi, Andy Chu, Ian Goodfellow +4 more 20168,500 citations, 773 a year	2016	8,500	1,472	773
13	Unsupervised Domain Adaptation by Backpropagation Yaroslav Ganin, Victor Lempitsky 20147,189 citations, 553 a year	2014	7,189	1,156	553
14	Categorical Reparameterization with Gumbel-Softmax Eric Jang, Shixiang Gu, Ben Poole 20166,766 citations, 615 a year	2016	6,766	699	615
15	Modeling Relational Data with Graph Convolutional Networks Michael Schlichtkrull, Thomas N. Kipf, Peter Bloem +3 more 20176,381 citations, 638 a year	2017	6,381	920	638
16	Deep reinforcement learning from human preferences Paul Christiano, Jan Leike, Tom B. Brown +3 more 20176,096 citations, 610 a year	2017	6,096	677	610
17	Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distances Marco Cuturi 20135,929 citations, 424 a year	2013	5,929	804	424
18	Towards A Rigorous Science of Interpretable Machine Learning Finale Doshi-Velez, Been Kim 20175,620 citations, 562 a year	2017	5,620	394	562
19	Wasserstein GAN Martin Arjovsky, Soumith Chintala, Léon Bottou 20175,212 citations, 521 a year	2017	5,212	750	521
20	Variational Graph Auto-Encoders Thomas N. Kipf, Max Welling 20164,524 citations, 411 a year	2016	4,524	886	411
21	Self-Attention Generative Adversarial Networks Han Zhang, Ian Goodfellow, Dimitris Metaxas +1 more 20184,196 citations, 466 a year	2018	4,196	339	466
22	Optimization Methods for Large-Scale Machine Learning Léon Bottou, Frank E. Curtis, Jorge Nocedal 20164,068 citations, 370 a year	2016	4,068	514	370
23	Understanding Black-box Predictions via Influence Functions Pang Wei Koh, Percy Liang 20173,884 citations, 388 a year	2017	3,884	556	388
24	Glow: Generative Flow with Invertible 1x1 Convolutions Diederik P. Kingma, Prafulla Dhariwal 20183,712 citations, 412 a year	2018	3,712	539	412
25	Pointer Networks Oriol Vinyals, Meire Fortunato, Navdeep Jaitly 20153,617 citations, 301 a year	2015	3,617	328	301
26	Ward's Hierarchical Clustering Method: Clustering Criterion and Agglomerative Algorithm Fionn Murtagh, Pierre Legendre 20113,575 citations, 223 a year	2011	3,575	94	223
27	Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecasting Bryan Lim, Sercan O. Arik, Nicolas Loeff +1 more 20193,417 citations, 427 a year	2019	3,417	290	427
28	Deep Graph Infomax Petar Veličković, William Fedus, William L. Hamilton +3 more 20183,156 citations, 351 a year	2018	3,156	568	351
29	On the Convergence of FedAvg on Non-IID Data Xiang Li, Kaixuan Huang, Wenhao Yang +2 more 20193,150 citations, 394 a year	2019	3,150	430	394
30	Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learning Takeru Miyato, Shin-ichi Maeda, Masanori Koyama +1 more 20173,128 citations, 313 a year	2017	3,128	374	313
31	Ensemble Adversarial Training: Attacks and Defenses Florian Tramèr, Alexey Kurakin, Nicolas Papernot +3 more 20173,116 citations, 312 a year	2017	3,116	278	312
32	Learning deep representations by mutual information estimation and maximization R Devon Hjelm, Alex Fedorov, Samuel Lavoie-Marchildon +4 more 20183,069 citations, 341 a year	2018	3,069	296	341
33	Invariant Risk Minimization Martin Arjovsky, Léon Bottou, Ishaan Gulrajani +1 more 20193,023 citations, 378 a year	2019	3,023	648	378
34	Computational Optimal Transport Gabriel Peyré, Marco Cuturi 20182,929 citations, 325 a year	2018	2,929	266	325
35	Stochastic Variational Inference Matt Hoffman, David M. Blei, Chong Wang +1 more 20122,897 citations, 193 a year	2012	2,897	351	193
36	A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attacks Kimin Lee, Kibok Lee, Honglak Lee +1 more 20182,886 citations, 321 a year	2018	2,886	510	321
37	On the Spectral Bias of Neural Networks Nasim Rahaman, Aristide Baratin, Devansh Arpit +5 more 20182,723 citations, 303 a year	2018	2,723	98	303
38	Deeply-Supervised Nets Chen-Yu Lee, Saining Xie, Patrick Gallagher +2 more 20142,557 citations, 197 a year	2014	2,557	178	197
39	Normalizing Flows for Probabilistic Modeling and Inference George Papamakarios, Eric Nalisnick, Danilo Jimenez Rezende +2 more 20192,552 citations, 319 a year	2019	2,552	150	319
40	Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV) Been Kim, Martin Wattenberg, Justin Gilmer +4 more 20172,535 citations, 254 a year	2017	2,535	313	254
41	A Tutorial on Bayesian Optimization Peter I. Frazier 20182,523 citations, 280 a year	2018	2,523	160	280
42	Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift Yaniv Ovadia, Emily Fertig, Jie Ren +6 more 20192,504 citations, 313 a year	2019	2,504	197	313
43	ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision Wonjae Kim, Bokyung Son, Ildoo Kim 20212,442 citations, 407 a year	2021	2,442	234	407
44	Deep Interest Network for Click-Through Rate Prediction Guorui Zhou, Chengru Song, Xiaoqiang Zhu +7 more 20172,409 citations, 241 a year	2017	2,409	368	241
45	Certifying and removing disparate impact Michael Feldman, Sorelle Friedler, John Moeller +2 more 20142,352 citations, 181 a year	2014	2,352	247	181
46	Introduction to Machine Learning Laurent Younes 20242,317 citations, 772 a year	2024	2,317	189	772
47	Towards Principled Methods for Training Generative Adversarial Networks Martin Arjovsky, Léon Bottou 20172,299 citations, 230 a year	2017	2,299	258	230
48	European Union regulations on algorithmic decision-making and a "right to explanation" Bryce Goodman, Seth Flaxman 20162,297 citations, 209 a year	2016	2,297	58	209
49	A Closer Look at Memorization in Deep Networks Devansh Arpit, Stanisław Jastrzębski, Nicolas Ballas +8 more 20172,282 citations, 228 a year	2017	2,282	186	228
50	ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural Networks without Training Substitute Models Pin-Yu Chen, Huan Zhang, Yash Sharma +2 more 20172,268 citations, 227 a year	2017	2,268	160	227

Citation data from Semantic Scholar, via the Semantic Scholar Academic Graph API.