Who Cited It

DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter

2019 · arXiv (Cornell University) · 4,600 citations · 10 from inside this corpus

No author records on this work.

The source holds an abstract for this work, but its best open-access copy is under no open licence, which does not permit us to republish the text. Read it at the source below.

DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter (2019)DistilBERT, a distilled versi…BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (2019)BERT: Pre-training of Deep Bi…HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit… (2019)HISTORIAE, History of Socio-C…Distilling the Knowledge in a Neural Network (2015)Distilling the Knowledge in a…Attention Is All You Need (2025)Attention Is All You NeedSQuAD: 100,000+ Questions for Machine Comprehension of Text (2016)SQuAD: 100,000+ Questions for…Learning Word Vectors for Sentiment Analysis (2011)Learning Word Vectors for Sen…GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding (2018)GLUE: A Multi-Task Benchmark …Deep Contextualized Word Representations (2018)Deep Contextualized Word Repr…Transformers: State-of-the-Art Natural Language Processing (2020)Transformers: State-of-the-Ar…Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer (2019)Exploring the Limits of Trans…HuggingFace's Transformers: State-of-the-art Natural Language Processing (2019)HuggingFace's Transformers: S…Language Models are Few-Shot Learners (2020)Language Models are Few-Shot …On the Opportunities and Risks of Foundation Models (2021)On the Opportunities and Risk…TinyBERT: Distilling BERT for Natural Language Understanding (2020)TinyBERT: Distilling BERT for…Text Data Augmentation for Deep Learning (2021)Text Data Augmentation for De…Deep Learning--based Text Classification (2021)Deep Learning--based Text Cla…Pre-trained models for natural language processing: A survey (2020)Pre-trained models for natura…A Brief Overview of ChatGPT: The History, Status Quo and Potential Future Development (2023)A Brief Overview of ChatGPT: …
18 of 18 neighbouring works in this corpus. Blue is what this paper cites; orange is what cites it, and a dashed line is one neighbour citing another. Only the largest labels are drawn — every node carries its full title on hover.
this paper works it cites works citing it node size = global citations · hover for the full title

What this paper cites, inside the corpus

PaperYearCited
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding201933,416
HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…201917,489
Distilling the Knowledge in a Neural Network201514,099
Attention Is All You Need20257,133
SQuAD: 100,000+ Questions for Machine Comprehension of Text20166,435
Learning Word Vectors for Sentiment Analysis20113,294
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding20181,861
Deep Contextualized Word Representations20181,783

What cites it, inside the corpus

PaperYearCited
Transformers: State-of-the-Art Natural Language Processing20208,295
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer20193,698
HuggingFace's Transformers: State-of-the-art Natural Language Processing20193,147
Language Models are Few-Shot Learners20203,020
On the Opportunities and Risks of Foundation Models20212,265
TinyBERT: Distilling BERT for Natural Language Understanding20201,706
Text Data Augmentation for Deep Learning20211,701
Deep Learning--based Text Classification20211,525
Pre-trained models for natural language processing: A survey20201,521
A Brief Overview of ChatGPT: The History, Status Quo and Potential Future Development20231,444

Links

DOI · Open access copy · OpenAlex record

Topics

Topic ModelingComputer Science
Ferroelectric and Negative Capacitance DevicesEngineering
Natural Language Processing TechniquesComputer Science

Is this record sound?

partial

One field of this record is missing or disagrees with another. What is shown below is what the source publishes.

  • weakensThe source lists no authors for this work at all, so there is nobody to attribute it to and it appears on no author page.
  • supports18 reference(s) recorded.
  • neutralThe DOI carries no year to check against.
  • supportsA title is present.

Provenance

Everything above was read from one stored OpenAlex payload, fetched 2026-09-04T03:58:44+00:00.

sha256 648f8491aaceaa34…