The Canon · Computer Science

The most-cited papers in Neural and Evolutionary Computing cs.NE

Ranked by citation count from Semantic Scholar; papers count in their primary category only. The top 250, fifty to a page. For papers whose citations only just took off, see the sleepers.

Provisional: built from 480,031 of about 3.2 million arXiv papers with fresh Semantic Scholar citation counts so far (most-cited first), so some classics are still missing. Counts as of 15 November 2026.

More archives

Retired archives

Computer Science by category

8 more categories

Showing 1–50 of the top 250 · 1,543 papers in cs.NE counted so far

The most-cited papers in cs.NE, ranked by Semantic Scholar citations
Rank#	Paper	Year	Citations	Influential	Per year
1	Deep Learning in Neural Networks: An Overview Juergen Schmidhuber 201417,804 citations, 1,370 a year	2014	17,804	478	1,370
2	Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling Junyoung Chung, Caglar Gulcehre, KyungHyun Cho +1 more 201415,147 citations, 1,165 a year	2014	15,147	1,592	1,165
3	A Style-Based Generator Architecture for Generative Adversarial Networks Tero Karras, Samuli Laine, Timo Aila 201813,621 citations, 1,513 a year	2018	13,621	2,119	1,513
4	Speech Recognition with Deep Recurrent Neural Networks Alex Graves, Abdel-rahman Mohamed, Geoffrey Hinton 20139,107 citations, 650 a year	2013	9,107	437	650
5	Progressive Growing of GANs for Improved Quality, Stability, and Variation Tero Karras, Timo Aila, Samuli Laine +1 more 20178,809 citations, 881 a year	2017	8,809	1,203	881
6	Improving neural networks by preventing co-adaptation of feature detectors Geoffrey E. Hinton, Nitish Srivastava, Alex Krizhevsky +2 more 20128,092 citations, 540 a year	2012	8,092	739	540
7	Learning both Weights and Connections for Efficient Neural Networks Song Han, Jeff Pool, John Tran +1 more 20158,047 citations, 671 a year	2015	8,047	751	671
8	Network In Network Min Lin, Qiang Chen, Shuicheng Yan 20136,807 citations, 486 a year	2013	6,807	595	486
9	LSTM: A Search Space Odyssey Klaus Greff, Rupesh Kumar Srivastava, Jan Koutník +2 more 20156,421 citations, 535 a year	2015	6,421	310	535
10	A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks Dan Hendrycks, Kevin Gimpel 20164,731 citations, 430 a year	2016	4,731	876	430
11	Generating Sequences With Recurrent Neural Networks Alex Graves 20134,353 citations, 311 a year	2013	4,353	355	311
12	An Introduction to Convolutional Neural Networks Keiron O'Shea, Ryan Nash 20154,252 citations, 354 a year	2015	4,252	207	354
13	Generative Adversarial Text to Image Synthesis Scott Reed, Zeynep Akata, Xinchen Yan +3 more 20163,459 citations, 314 a year	2016	3,459	222	314
14	Regularized Evolution for Image Classifier Architecture Search Esteban Real, Alok Aggarwal, Yanping Huang +1 more 20183,454 citations, 384 a year	2018	3,454	438	384
15	Recurrent Neural Network Regularization Wojciech Zaremba, Ilya Sutskever, Oriol Vinyals 20143,040 citations, 234 a year	2014	3,040	352	234
16	Temporal Ensembling for Semi-Supervised Learning Samuli Laine, Timo Aila 20162,957 citations, 269 a year	2016	2,957	326	269
17	Neural Turing Machines Alex Graves, Greg Wayne, Ivo Danihelka 20142,632 citations, 202 a year	2014	2,632	239	202
18	Learning Structured Sparsity in Deep Neural Networks Wei Wen, Chunpeng Wu, Yandan Wang +2 more 20162,533 citations, 230 a year	2016	2,533	242	230
19	All-Optical Machine Learning Using Diffractive Deep Neural Networks Xing Lin, Yair Rivenson, Nezih T. Yardimci +3 more 20182,438 citations, 271 a year	2018	2,438	109	271
20	PlatEMO: A MATLAB Platform for Evolutionary Multi-Objective Optimization Ye Tian, Ran Cheng, Xingyi Zhang +1 more 20172,323 citations, 232 a year	2017	2,323	120	232
21	DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradients Shuchang Zhou, Yuxin Wu, Zekun Ni +3 more 20162,305 citations, 210 a year	2016	2,305	351	210
22	Learning to learn by gradient descent by gradient descent Marcin Andrychowicz, Misha Denil, Sergio Gomez +5 more 20162,263 citations, 206 a year	2016	2,263	191	206
23	Gate-Variants of Gated Recurrent Unit (GRU) Neural Networks Rahul Dey, Fathi M. Salem 20172,209 citations, 221 a year	2017	2,209	129	221
24	Sequence Transduction with Recurrent Neural Networks Alex Graves 20122,152 citations, 144 a year	2012	2,152	253	144
25	Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations Itay Hubara, Matthieu Courbariaux, Daniel Soudry +2 more 20162,147 citations, 195 a year	2016	2,147	136	195
26	pymoo: Multi-objective Optimization in Python Julian Blank, Kalyanmoy Deb 20202,070 citations, 296 a year	2020	2,070	142	296
27	cuDNN: Efficient Primitives for Deep Learning Sharan Chetlur, Cliff Woolley, Philippe Vandermersch +4 more 20142,026 citations, 156 a year	2014	2,026	183	156
28	Large-Scale Evolution of Image Classifiers Esteban Real, Sherry Moore, Andrew Selle +5 more 20171,780 citations, 178 a year	2017	1,780	143	178
29	BranchyNet: Fast Inference via Early Exiting from Deep Neural Networks Surat Teerapittayanon, Bradley McDanel, H. T. Kung 20171,647 citations, 165 a year	2017	1,647	207	165
30	Deep clustering: Discriminative embeddings for segmentation and separation John R. Hershey, Zhuo Chen, Jonathan Le Roux +1 more 20151,476 citations, 123 a year	2015	1,476	177	123
31	Semi-Supervised Learning with Ladder Networks Antti Rasmus, Harri Valpola, Mikko Honkala +2 more 20151,433 citations, 119 a year	2015	1,433	123	119
32	One weird trick for parallelizing convolutional neural networks Alex Krizhevsky 20141,423 citations, 110 a year	2014	1,423	193	110
33	Regularizing Neural Networks by Penalizing Confident Output Distributions Gabriel Pereyra, George Tucker, Jan Chorowski +2 more 20171,293 citations, 129 a year	2017	1,293	158	129
34	SCNN: An Accelerator for Compressed-sparse Convolutional Neural Networks Angshuman Parashar, Minsoo Rhu, Anurag Mukkara +6 more 20171,286 citations, 129 a year	2017	1,286	156	129
35	Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results Antti Tarvainen, Harri Valpola 20171,219 citations, 122 a year	2017	1,219	189	122
36	Dynamic Network Surgery for Efficient DNNs Yiwen Guo, Anbang Yao, Yurong Chen 20161,160 citations, 106 a year	2016	1,160	108	106
37	Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognition Haşim Sak, Andrew Senior, Françoise Beaufays 20141,131 citations, 87 a year	2014	1,131	54	87
38	How to Construct Deep Recurrent Neural Networks Razvan Pascanu, Caglar Gulcehre, Kyunghyun Cho +1 more 20131,092 citations, 78 a year	2013	1,092	74	78
39	Deep Complex Networks Chiheb Trabelsi, Olexa Bilaniuk, Ying Zhang +7 more 20171,089 citations, 109 a year	2017	1,089	170	109
40	Deep Big Simple Neural Nets Excel on Handwritten Digit Recognition Dan Claudiu Ciresan, Ueli Meier, Luca Maria Gambardella +1 more 20101,021 citations, 60 a year	2010	1,021	46	60
41	PathNet: Evolution Channels Gradient Descent in Super Neural Networks Chrisantha Fernando, Dylan Banarse, Charles Blundell +5 more 2017983 citations, 98 a year	2017	983	50	98
42	Network Trimming: A Data-Driven Neuron Pruning Approach towards Efficient Deep Architectures Hengyuan Hu, Rui Peng, Yu-Wing Tai +1 more 2016978 citations, 89 a year	2016	978	72	89
43	Fast Algorithms for Convolutional Neural Networks Andrew Lavin, Scott Gray 2015977 citations, 81 a year	2015	977	130	81
44	Going Deeper in Facial Expression Recognition using Deep Neural Networks Ali Mollahosseini, David Chan, Mohammad H. Mahoor 2015976 citations, 81 a year	2015	976	93	81
45	Understanding LSTM -- a tutorial into Long Short-Term Memory Recurrent Neural Networks Ralf C. Staudemeyer, Eric Rothstein Morris 2019934 citations, 117 a year	2019	934	43	117
46	Non-negative sparse coding Patrik O. Hoyer 2002931 citations, 37 a year	2002	931	110	37
47	Fast Transformer Decoding: One Write-Head is All You Need Noam Shazeer 2019907 citations, 113 a year	2019	907	59	113
48	Gated Feedback Recurrent Neural Networks Junyoung Chung, Caglar Gulcehre, Kyunghyun Cho +1 more 2015905 citations, 75 a year	2015	905	86	75
49	Adaptive Computation Time for Recurrent Neural Networks Alex Graves 2016879 citations, 80 a year	2016	879	92	80
50	Model compression via distillation and quantization Antonio Polino, Razvan Pascanu, Dan Alistarh 2018855 citations, 95 a year	2018	855	48	95

Citation data from Semantic Scholar, via the Semantic Scholar Academic Graph API.