Scaling Laws for Neural Language Models
Sam McCandlish, Tom Henighan, T. B. Brown, Benjamin Chess, Rewon Child, Scott Gray, Alec Radford, Jeffrey Wu, Dario Amodei
The source holds an abstract for this work, but its best open-access copy is under no open licence, which does not permit us to republish the text. Read it at the source below.
this paper
works it cites
works citing it
node size = global citations · hover for the full title
Citation edge evidence
- Large language models encode clinical knowledge→Scaling Laws for Neural Language ModelsLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→Scaling Laws for Neural Language ModelsLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→Scaling Laws for Neural Language ModelsLegacy edge — source detail unavailable
- A Brief Overview of ChatGPT: The History, Status Quo and Potential Future Development→Scaling Laws for Neural Language ModelsLegacy edge — source detail unavailable
- Scaling Laws for Neural Language Models→Adam: A Method for Stochastic OptimizationLegacy edge — source detail unavailable
- Scaling Laws for Neural Language Models→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Scaling Laws for Neural Language Models→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- Scaling Laws for Neural Language Models→Neural Tangent Kernel: Convergence and Generalization in Neural NetworksLegacy edge — source detail unavailable
- HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→Language Models are Few-Shot LearnersLegacy edge — source detail unavailable
- A Brief Overview of ChatGPT: The History, Status Quo and Potential Future Development→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- A Brief Overview of ChatGPT: The History, Status Quo and Potential Future Development→On the Opportunities and Risks of Foundation ModelsLegacy edge — source detail unavailable
- Large language models encode clinical knowledge→On the Opportunities and Risks of Foundation ModelsLegacy edge — source detail unavailable
What this paper cites, inside the corpus
What cites it, inside the corpus
Links
Download BibTeX · Download RIS · DOI · Open access copy · OpenAlex record
Topics
| Topic Modeling | Computer Science |
| Natural Language Processing Techniques | Computer Science |
| Neural Networks and Applications | Computer Science |
Is this record sound?
partial
One field of this record is missing or disagrees with another. What is shown below is what the source publishes.
- supports9 author record(s) attached.
- supports43 reference(s) recorded.
- weakensThe DOI names 2001 but the record dates this to 2,020. One of the two is about a different paper.
- supportsA title is present.
Provenance
sha256 b3024609427ad450…