Language Models are Few-Shot Learners
T. B. Brown, Benjamin Mann low, Nick Ryder low, Melanie Subbiah low, Jared Kaplan low, Prafulla Dhariwal low, Arvind Neelakantan low, Pranav Shyam low, Girish Sastry low, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss low, Gretchen Krueger low, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler low, Jeffrey Wu, Clemens Winter low, Christopher Hesse low, Mark Chen, Eric J. Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark low, Christopher Berner low, Sam McCandlish, Alec Radford, Ilya Sutskever, Dario Amodei
The source holds an abstract for this work, but its best open-access copy is under no open licence, which does not permit us to republish the text. Read it at the source below.
Citation edge evidence
- LoRA Fine-Tuning of a 3B Code LLM for Algorithmic Efficiency→Language Models are Few-Shot LearnersLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→Language Models are Few-Shot LearnersLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→Glove: Global Vectors for Word RepresentationLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- Language Models are Few-Shot Learners→Distilling the Knowledge in a Neural NetworkLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→Efficient Estimation of Word Representations in Vector SpaceLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→Multitask LearningLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighterLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→Affordance-Compiled Intelligence: Observable-Only Cognitive Impedance Matching for No-Met…Legacy edge — source detail unavailable
- Language Models are Few-Shot Learners→Domain randomization for transferring deep neural networks from simulation to the real wo…Legacy edge — source detail unavailable
- Language Models are Few-Shot Learners→SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion MiningLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→[No title in the source record — Edinburgh Research Explorer (University of Edinburgh)]Legacy edge — source detail unavailable
- Language Models are Few-Shot Learners→Optimization as a Model for Few-Shot LearningLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→Know What You Don’t Know: Unanswerable Questions for SQuADLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→Natural Questions: A Benchmark for Question Answering ResearchLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→Estimating or Propagating Gradients Through Stochastic Neurons for Conditional ComputationLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→NLTK: The Natural Language ToolkitLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→TinyBERT: Distilling BERT for Natural Language UnderstandingLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→The PASCAL Recognising Textual Entailment ChallengeLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→Cross-lingual Language Model PretrainingLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→Unsupervised Data Augmentation for Consistency TrainingLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→Semantic Parsing on Freebase from Question-Answer PairsLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→Scaling Laws for Neural Language ModelsLegacy edge — source detail unavailable
- Natural Questions: A Benchmark for Question Answering Research→Know What You Don’t Know: Unanswerable Questions for SQuADLegacy edge — source detail unavailable
- Cross-lingual Language Model Pretraining→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Unsupervised Data Augmentation for Consistency Training→Distilling the Knowledge in a Neural NetworkLegacy edge — source detail unavailable
- Unsupervised Data Augmentation for Consistency Training→Glove: Global Vectors for Word RepresentationLegacy edge — source detail unavailable
- Unsupervised Data Augmentation for Consistency Training→[No title in the source record — Edinburgh Research Explorer (University of Edinburgh)]Legacy edge — source detail unavailable
- Unsupervised Data Augmentation for Consistency Training→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding→Glove: Global Vectors for Word RepresentationLegacy edge — source detail unavailable
- HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…→The PASCAL Recognising Textual Entailment ChallengeLegacy edge — source detail unavailable
- HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…→Cross-lingual Language Model PretrainingLegacy edge — source detail unavailable
- HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…→Know What You Don’t Know: Unanswerable Questions for SQuADLegacy edge — source detail unavailable
- HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter→Distilling the Knowledge in a Neural NetworkLegacy edge — source detail unavailable
- DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- Scaling Laws for Neural Language Models→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Scaling Laws for Neural Language Models→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- Affordance-Compiled Intelligence: Observable-Only Cognitive Impedance Matching for No-Met…→Semantic Parsing on Freebase from Question-Answer PairsLegacy edge — source detail unavailable
- Affordance-Compiled Intelligence: Observable-Only Cognitive Impedance Matching for No-Met…→Natural Questions: A Benchmark for Question Answering ResearchLegacy edge — source detail unavailable
- Affordance-Compiled Intelligence: Observable-Only Cognitive Impedance Matching for No-Met…→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- TinyBERT: Distilling BERT for Natural Language Understanding→Distilling the Knowledge in a Neural NetworkLegacy edge — source detail unavailable
- TinyBERT: Distilling BERT for Natural Language Understanding→Glove: Global Vectors for Word RepresentationLegacy edge — source detail unavailable
- TinyBERT: Distilling BERT for Natural Language Understanding→Know What You Don’t Know: Unanswerable Questions for SQuADLegacy edge — source detail unavailable
- TinyBERT: Distilling BERT for Natural Language Understanding→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- TinyBERT: Distilling BERT for Natural Language Understanding→DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighterLegacy edge — source detail unavailable
- LoRA Fine-Tuning of a 3B Code LLM for Algorithmic Efficiency→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- LoRA Fine-Tuning of a 3B Code LLM for Algorithmic Efficiency→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→Distilling the Knowledge in a Neural NetworkLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→Glove: Global Vectors for Word RepresentationLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→Efficient Estimation of Word Representations in Vector SpaceLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→Know What You Don’t Know: Unanswerable Questions for SQuADLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighterLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→Scaling Laws for Neural Language ModelsLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→LoRA Fine-Tuning of a 3B Code LLM for Algorithmic EfficiencyLegacy edge — source detail unavailable
What this paper cites, inside the corpus
What cites it, inside the corpus
| Paper | Year | Cited |
|---|---|---|
| LoRA Fine-Tuning of a 3B Code LLM for Algorithmic Efficiency | 2021 | 2,531 |
| On the Opportunities and Risks of Foundation Models | 2021 | 2,265 |
Links
Download BibTeX · Download RIS · DOI · Open access copy · OpenAlex record
Topics
| Topic Modeling | Computer Science |
| Natural Language Processing Techniques | Computer Science |
| Text Readability and Simplification | Computer Science |
Is this record sound?
partial
One field of this record is missing or disagrees with another. What is shown below is what the source publishes.
- supports31 author record(s) attached.
- supports127 reference(s) recorded.
- weakensThe DOI names 2005 but the record dates this to 2,020. One of the two is about a different paper.
- supportsA title is present.
Provenance
sha256 a08467ae9504f237…