BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Jacob Devlin, Ming‐Wei Chang, Kenton Lee, Kristina Toutanova
Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). 2019.
this paper
works it cites
works citing it
node size = global citations · hover for the full title
Citation edge evidence
- HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Momentum Contrast for Unsupervised Visual Representation Learning→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Graph neural networks: A review of methods and applications→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Emerging Properties in Self-Supervised Vision Transformers→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Langu…→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Transformer-XL: Attentive Language Models beyond a Fixed-Length Context→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- SciBERT: A Pretrained Language Model for Scientific Text→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Affordance-Compiled Intelligence: Observable-Only Cognitive Impedance Matching for No-Met…→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- SimCSE: Simple Contrastive Learning of Sentence Embeddings→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- CodeBERT: A Pre-Trained Model for Programming and Natural Languages→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- LoRA Fine-Tuning of a 3B Code LLM for Algorithmic Efficiency→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- LXMERT: Learning Cross-Modality Encoder Representations from Transformers→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Prefix-Tuning: Optimizing Continuous Prompts for Generation→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Longformer: The Long-Document Transformer→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- BERTScore: Evaluating Text Generation with BERT→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Shortcut learning in deep neural networks→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and…→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Ta…→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- XLNet: Generalized Autoregressive Pretraining for Language Understanding→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding→Glove: Global Vectors for Word RepresentationLegacy edge — source detail unavailable
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding→Distributed Representations of Words and Phrases and their CompositionalityLegacy edge — source detail unavailable
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding→Recursive Deep Models for Semantic Compositionality Over a Sentiment TreebankLegacy edge — source detail unavailable
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding→A unified architecture for natural language processingLegacy edge — source detail unavailable
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding→Distributed Representations of Sentences and DocumentsLegacy edge — source detail unavailable
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding→Class-based n -gram models of natural languageLegacy edge — source detail unavailable
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding→Supervised Learning of Universal Sentence Representations from Natural\n Language Inferen…Legacy edge — source detail unavailable
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding→Word Representations: A Simple and General Method for Semi-Supervised LearningLegacy edge — source detail unavailable
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding→Domain adaptation with structural correspondence learningLegacy edge — source detail unavailable
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding→A Decomposable Attention Model for Natural Language InferenceLegacy edge — source detail unavailable
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding→A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled DataLegacy edge — source detail unavailable
- A unified architecture for natural language processing→A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled DataLegacy edge — source detail unavailable
- Distributed Representations of Sentences and Documents→A unified architecture for natural language processingLegacy edge — source detail unavailable
- Distributed Representations of Sentences and Documents→Distributed Representations of Words and Phrases and their CompositionalityLegacy edge — source detail unavailable
- Distributed Representations of Sentences and Documents→Word Representations: A Simple and General Method for Semi-Supervised LearningLegacy edge — source detail unavailable
- Distributed Representations of Sentences and Documents→Recursive Deep Models for Semantic Compositionality Over a Sentiment TreebankLegacy edge — source detail unavailable
- Distributed Representations of Words and Phrases and their Compositionality→A unified architecture for natural language processingLegacy edge — source detail unavailable
- Distributed Representations of Words and Phrases and their Compositionality→Word Representations: A Simple and General Method for Semi-Supervised LearningLegacy edge — source detail unavailable
- Domain adaptation with structural correspondence learning→Class-based n -gram models of natural languageLegacy edge — source detail unavailable
- Domain adaptation with structural correspondence learning→A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled DataLegacy edge — source detail unavailable
- Word Representations: A Simple and General Method for Semi-Supervised Learning→A unified architecture for natural language processingLegacy edge — source detail unavailable
- Word Representations: A Simple and General Method for Semi-Supervised Learning→Class-based n -gram models of natural languageLegacy edge — source detail unavailable
- Glove: Global Vectors for Word Representation→A unified architecture for natural language processingLegacy edge — source detail unavailable
- Glove: Global Vectors for Word Representation→Distributed Representations of Words and Phrases and their CompositionalityLegacy edge — source detail unavailable
- Glove: Global Vectors for Word Representation→Word Representations: A Simple and General Method for Semi-Supervised LearningLegacy edge — source detail unavailable
- Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank→A unified architecture for natural language processingLegacy edge — source detail unavailable
- A Decomposable Attention Model for Natural Language Inference→Glove: Global Vectors for Word RepresentationLegacy edge — source detail unavailable
- BERTScore: Evaluating Text Generation with BERT→Distributed Representations of Words and Phrases and their CompositionalityLegacy edge — source detail unavailable
- BERTScore: Evaluating Text Generation with BERT→Glove: Global Vectors for Word RepresentationLegacy edge — source detail unavailable
- BERTScore: Evaluating Text Generation with BERT→A Decomposable Attention Model for Natural Language InferenceLegacy edge — source detail unavailable
- BERTScore: Evaluating Text Generation with BERT→XLNet: Generalized Autoregressive Pretraining for Language UnderstandingLegacy edge — source detail unavailable
- BERTScore: Evaluating Text Generation with BERT→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- BERTScore: Evaluating Text Generation with BERT→SciBERT: A Pretrained Language Model for Scientific TextLegacy edge — source detail unavailable
- XLNet: Generalized Autoregressive Pretraining for Language Understanding→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- Supervised Learning of Universal Sentence Representations from Natural\n Language Inferen…→A unified architecture for natural language processingLegacy edge — source detail unavailable
- Supervised Learning of Universal Sentence Representations from Natural\n Language Inferen…→Distributed Representations of Sentences and DocumentsLegacy edge — source detail unavailable
- Supervised Learning of Universal Sentence Representations from Natural\n Language Inferen…→Distributed Representations of Words and Phrases and their CompositionalityLegacy edge — source detail unavailable
- Supervised Learning of Universal Sentence Representations from Natural\n Language Inferen…→Glove: Global Vectors for Word RepresentationLegacy edge — source detail unavailable
- HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…→Recursive Deep Models for Semantic Compositionality Over a Sentiment TreebankLegacy edge — source detail unavailable
- HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- LXMERT: Learning Cross-Modality Encoder Representations from Transformers→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks→Glove: Global Vectors for Word RepresentationLegacy edge — source detail unavailable
- Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks→Recursive Deep Models for Semantic Compositionality Over a Sentiment TreebankLegacy edge — source detail unavailable
- Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks→BERTScore: Evaluating Text Generation with BERTLegacy edge — source detail unavailable
- Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks→Supervised Learning of Universal Sentence Representations from Natural\n Language Inferen…Legacy edge — source detail unavailable
- Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Ta…→Glove: Global Vectors for Word RepresentationLegacy edge — source detail unavailable
- DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer→Distributed Representations of Words and Phrases and their CompositionalityLegacy edge — source detail unavailable
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer→Glove: Global Vectors for Word RepresentationLegacy edge — source detail unavailable
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer→Recursive Deep Models for Semantic Compositionality Over a Sentiment TreebankLegacy edge — source detail unavailable
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer→XLNet: Generalized Autoregressive Pretraining for Language UnderstandingLegacy edge — source detail unavailable
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer→SciBERT: A Pretrained Language Model for Scientific TextLegacy edge — source detail unavailable
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer→DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighterLegacy edge — source detail unavailable
- Longformer: The Long-Document Transformer→Transformer-XL: Attentive Language Models beyond a Fixed-Length ContextLegacy edge — source detail unavailable
- Longformer: The Long-Document Transformer→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- Affordance-Compiled Intelligence: Observable-Only Cognitive Impedance Matching for No-Met…→Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→Glove: Global Vectors for Word RepresentationLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- Language Models are Few-Shot Learners→DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighterLegacy edge — source detail unavailable
- Language Models are Few-Shot Learners→Affordance-Compiled Intelligence: Observable-Only Cognitive Impedance Matching for No-Met…Legacy edge — source detail unavailable
- CodeBERT: A Pre-Trained Model for Programming and Natural Languages→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- SimCSE: Simple Contrastive Learning of Sentence Embeddings→Distributed Representations of Words and Phrases and their CompositionalityLegacy edge — source detail unavailable
- SimCSE: Simple Contrastive Learning of Sentence Embeddings→Glove: Global Vectors for Word RepresentationLegacy edge — source detail unavailable
- SimCSE: Simple Contrastive Learning of Sentence Embeddings→Recursive Deep Models for Semantic Compositionality Over a Sentiment TreebankLegacy edge — source detail unavailable
- SimCSE: Simple Contrastive Learning of Sentence Embeddings→Supervised Learning of Universal Sentence Representations from Natural\n Language Inferen…Legacy edge — source detail unavailable
- SimCSE: Simple Contrastive Learning of Sentence Embeddings→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- SimCSE: Simple Contrastive Learning of Sentence Embeddings→Sentence-BERT: Sentence Embeddings using Siamese BERT-NetworksLegacy edge — source detail unavailable
- Emerging Properties in Self-Supervised Vision Transformers→Momentum Contrast for Unsupervised Visual Representation LearningLegacy edge — source detail unavailable
- LoRA Fine-Tuning of a 3B Code LLM for Algorithmic Efficiency→A unified architecture for natural language processingLegacy edge — source detail unavailable
- LoRA Fine-Tuning of a 3B Code LLM for Algorithmic Efficiency→Recursive Deep Models for Semantic Compositionality Over a Sentiment TreebankLegacy edge — source detail unavailable
- LoRA Fine-Tuning of a 3B Code LLM for Algorithmic Efficiency→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- LoRA Fine-Tuning of a 3B Code LLM for Algorithmic Efficiency→Language Models are Few-Shot LearnersLegacy edge — source detail unavailable
- Prefix-Tuning: Optimizing Continuous Prompts for Generation→BERTScore: Evaluating Text Generation with BERTLegacy edge — source detail unavailable
- Prefix-Tuning: Optimizing Continuous Prompts for Generation→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Langu…→Glove: Global Vectors for Word RepresentationLegacy edge — source detail unavailable
- Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Langu…→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Langu…→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Langu…→Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerLegacy edge — source detail unavailable
- Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Langu…→Prefix-Tuning: Optimizing Continuous Prompts for GenerationLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→A unified architecture for natural language processingLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→Domain adaptation with structural correspondence learningLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→Word Representations: A Simple and General Method for Semi-Supervised LearningLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→Glove: Global Vectors for Word RepresentationLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→Transformer-XL: Attentive Language Models beyond a Fixed-Length ContextLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→LXMERT: Learning Cross-Modality Encoder Representations from TransformersLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighterLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→Longformer: The Long-Document TransformerLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→Shortcut learning in deep neural networksLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→Language Models are Few-Shot LearnersLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→Momentum Contrast for Unsupervised Visual Representation LearningLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→LoRA Fine-Tuning of a 3B Code LLM for Algorithmic EfficiencyLegacy edge — source detail unavailable
What this paper cites, inside the corpus
What cites it, inside the corpus
Links
Download BibTeX · Download RIS · DOI · Open access copy · OpenAlex record
Topics
| Topic Modeling | Computer Science |
| Natural Language Processing Techniques | Computer Science |
| Computational and Text Analysis Methods | Social Sciences |
Is this record sound?
complete
Nothing in this record contradicts itself and no field we check is missing.
- supports4 author record(s) attached.
- supports52 reference(s) recorded.
- neutralThe DOI carries no year to check against.
- supportsA title is present.
Provenance
sha256 7e3d99a592f7f61f…