The Canon · Computer Science

The most-cited papers in Computation and Language cs.CL

Ranked by citation count from Semantic Scholar; papers count in their primary category only. The top 250, fifty to a page. For papers whose citations only just took off, see the sleepers.

Provisional: built from 480,031 of about 3.2 million arXiv papers with fresh Semantic Scholar citation counts so far (most-cited first), so some classics are still missing. Counts as of 15 November 2026.

More archives

Retired archives

Computer Science by category

8 more categories

Showing 1–50 of the top 250 · 21,931 papers in cs.CL counted so far

The most-cited papers in cs.CL, ranked by Semantic Scholar citations
Rank#	Paper	Year	Citations	Influential	Per year
1	Attention Is All You Need Ashish Vaswani, Noam Shazeer, Niki Parmar +5 more 2017194,990 citations, 19,499 a year	2017	194,990	20,851	19,499
2	BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin, Ming-Wei Chang, Kenton Lee +1 more 2018121,876 citations, 13,542 a year	2018	121,876	23,045	13,542
3	Language Models are Few-Shot Learners Tom B. Brown, Benjamin Mann, Nick Ryder +28 more 202064,094 citations, 9,156 a year	2020	64,094	5,526	9,156
4	Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov, Ilya Sutskever, Kai Chen +2 more 201335,733 citations, 2,552 a year	2013	35,733	4,206	2,552
5	Efficient Estimation of Word Representations in Vector Space Tomas Mikolov, Kai Chen, Greg Corrado +1 more 201335,169 citations, 2,512 a year	2013	35,169	4,374	2,512
6	RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu, Myle Ott, Naman Goyal +7 more 201931,546 citations, 3,943 a year	2019	31,546	6,132	3,943
7	Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau, Kyunghyun Cho, Yoshua Bengio 201430,110 citations, 2,316 a year	2014	30,110	2,618	2,316
8	Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation Kyunghyun Cho, Bart van Merrienboer, Caglar Gulcehre +4 more 201427,697 citations, 2,130 a year	2014	27,697	3,194	2,130
9	GPT-4 Technical Report OpenAI, Josh Achiam, Steven Adler +278 more 202327,487 citations, 6,872 a year	2023	27,487	3,317	6,872
10	Training language models to follow instructions with human feedback Long Ouyang, Jeff Wu, Xu Jiang +17 more 202224,599 citations, 4,920 a year	2022	24,599	2,482	4,920
11	LoRA: Low-Rank Adaptation of Large Language Models Edward J. Hu, Yelong Shen, Phillip Wallis +5 more 202123,741 citations, 3,957 a year	2021	23,741	3,290	3,957
12	Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason Wei, Xuezhi Wang, Dale Schuurmans +6 more 202222,451 citations, 4,490 a year	2022	22,451	1,428	4,490
13	Sequence to Sequence Learning with Neural Networks Ilya Sutskever, Oriol Vinyals, Quoc V. Le 201422,441 citations, 1,726 a year	2014	22,441	1,414	1,726
14	LLaMA: Open and Efficient Foundation Language Models Hugo Touvron, Thibaut Lavril, Gautier Izacard +11 more 202321,804 citations, 5,451 a year	2023	21,804	2,231	5,451
15	Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers, Iryna Gurevych 201920,905 citations, 2,613 a year	2019	20,905	2,499	2,613
16	Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks Patrick Lewis, Ethan Perez, Aleksandra Piktus +9 more 202018,984 citations, 2,712 a year	2020	18,984	1,684	2,712
17	Llama 2: Open Foundation and Fine-Tuned Chat Models Hugo Touvron, Louis Martin, Kevin Stone +65 more 202318,418 citations, 4,604 a year	2023	18,418	2,281	4,604
18	Convolutional Neural Networks for Sentence Classification Yoon Kim 201414,514 citations, 1,116 a year	2014	14,514	2,156	1,116
19	BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension Mike Lewis, Yinhan Liu, Naman Goyal +5 more 201913,294 citations, 1,662 a year	2019	13,294	2,413	1,662
20	Deep contextualized word representations Matthew E. Peters, Mark Neumann, Mohit Iyyer +4 more 201812,289 citations, 1,365 a year	2018	12,289	1,486	1,365
21	ReAct: Synergizing Reasoning and Acting in Language Models Shunyu Yao, Jeffrey Zhao, Dian Yu +4 more 202211,961 citations, 2,392 a year	2022	11,961	1,196	2,392
22	Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena Lianmin Zheng, Wei-Lin Chiang, Ying Sheng +10 more 202311,735 citations, 2,934 a year	2023	11,735	1,432	2,934
23	Enriching Word Vectors with Subword Information Piotr Bojanowski, Edouard Grave, Armand Joulin +1 more 201611,021 citations, 1,002 a year	2016	11,021	1,075	1,002
24	DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter Victor Sanh, Lysandre Debut, Julien Chaumond +1 more 201910,642 citations, 1,330 a year	2019	10,642	1,288	1,330
25	SQuAD: 100,000+ Questions for Machine Comprehension of Text Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev +1 more 20169,843 citations, 895 a year	2016	9,843	1,842	895
26	Distributed Representations of Sentences and Documents Quoc V. Le, Tomas Mikolov 20149,842 citations, 757 a year	2014	9,842	1,132	757
27	BERTScore: Evaluating Text Generation with BERT Tianyi Zhang, Varsha Kishore, Felix Wu +2 more 20199,750 citations, 1,219 a year	2019	9,750	1,706	1,219
28	Thumbs up? Sentiment Classification using Machine Learning Techniques Bo Pang, Lillian Lee, Shivakumar Vaithyanathan 20029,649 citations, 386 a year	2002	9,649	825	386
29	XLNet: Generalized Autoregressive Pretraining for Language Understanding Zhilin Yang, Zihang Dai, Yiming Yang +3 more 20199,576 citations, 1,197 a year	2019	9,576	1,000	1,197
30	DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models Zhihong Shao, Peiyi Wang, Qihao Zhu +8 more 20249,468 citations, 3,156 a year	2024	9,468	2,741	3,156
31	wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations Alexei Baevski, Henry Zhou, Abdelrahman Mohamed +1 more 20209,404 citations, 1,343 a year	2020	9,404	3,309	1,343
32	Unsupervised Cross-lingual Representation Learning at Scale Alexis Conneau, Kartikay Khandelwal, Naman Goyal +7 more 20199,354 citations, 1,169 a year	2019	9,354	1,864	1,169
33	Neural Machine Translation of Rare Words with Subword Units Rico Sennrich, Barry Haddow, Alexandra Birch 20159,064 citations, 755 a year	2015	9,064	1,070	755
34	GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Wang, Amanpreet Singh, Julian Michael +3 more 20189,025 citations, 1,003 a year	2018	9,025	1,456	1,003
35	Qwen3 Technical Report An Yang, Anfeng Li, Baosong Yang +57 more 20258,634 citations, 4,317 a year	2025	8,634	1,229	4,317
36	Effective Approaches to Attention-based Neural Machine Translation Minh-Thang Luong, Hieu Pham, Christopher D. Manning 20158,477 citations, 706 a year	2015	8,477	665	706
37	PaLM: Scaling Language Modeling with Pathways Aakanksha Chowdhery, Sharan Narang, Jacob Devlin +64 more 20228,437 citations, 1,687 a year	2022	8,437	441	1,687
38	Large Language Models are Zero-Shot Reasoners Takeshi Kojima, Shixiang Shane Gu, Machel Reid +2 more 20228,134 citations, 1,627 a year	2022	8,134	512	1,627
39	Self-Consistency Improves Chain of Thought Reasoning in Language Models Xuezhi Wang, Jason Wei, Dale Schuurmans +5 more 20227,856 citations, 1,571 a year	2022	7,856	969	1,571
40	ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan, Mingda Chen, Sebastian Goodman +3 more 20197,742 citations, 968 a year	2019	7,742	1,032	968
41	On the Properties of Neural Machine Translation: Encoder-Decoder Approaches Kyunghyun Cho, Bart van Merrienboer, Dzmitry Bahdanau +1 more 20147,651 citations, 588 a year	2014	7,651	915	588
42	Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu, Mike Schuster, Zhifeng Chen +28 more 20167,404 citations, 673 a year	2016	7,404	482	673
43	Dense Passage Retrieval for Open-Domain Question Answering Vladimir Karpukhin, Barlas Oğuz, Sewon Min +5 more 20207,160 citations, 1,023 a year	2020	7,160	1,089	1,023
44	VQA: Visual Question Answering Aishwarya Agrawal, Jiasen Lu, Stanislaw Antol +4 more 20156,734 citations, 561 a year	2015	6,734	937	561
45	RoFormer: Enhanced Transformer with Rotary Position Embedding Jianlin Su, Yu Lu, Shengfeng Pan +3 more 20216,636 citations, 1,106 a year	2021	6,636	532	1,106
46	Prefix-Tuning: Optimizing Continuous Prompts for Generation Xiang Lisa Li, Percy Liang 20216,452 citations, 1,075 a year	2021	6,452	492	1,075
47	The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester, Rami Al-Rfou, Noah Constant 20216,115 citations, 1,019 a year	2021	6,115	505	1,019
48	Survey of Hallucination in Natural Language Generation Ziwei Ji, Nayeon Lee, Rita Frieske +10 more 20226,094 citations, 1,219 a year	2022	6,094	232	1,219
49	Longformer: The Long-Document Transformer Iz Beltagy, Matthew E. Peters, Arman Cohan 20206,022 citations, 860 a year	2020	6,022	778	860
50	Toolformer: Language Models Can Teach Themselves to Use Tools Timo Schick, Jane Dwivedi-Yu, Roberto Dessì +5 more 20235,912 citations, 1,478 a year	2023	5,912	209	1,478

Citation data from Semantic Scholar, via the Semantic Scholar Academic Graph API.