SQuAD: 100,000+ Questions for Machine Comprehension of Text
Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev low, Percy Liang
We present the Stanford Question Answering Dataset (SQuAD), a new reading comprehension dataset consisting of 100,000+ questions posed by crowdworkers on a set of Wikipedia articles, where the answer to each question is a segment of text from the corresponding reading passage. We analyze the dataset to understand the types of reasoning required to answer the questions, leaning heavily on dependency and constituency trees. We build a strong logistic regression model, which achieves an F1 score of 51.0%, a significant improvement over a simple baseline (20%). However, human performance (86.8%) is much higher, indicating that the dataset presents a good challenge problem for future research. The dataset is freely available at https://stanford-qa.com
Citation edge evidence
- AI-Assisted Pipeline for Dynamic Generation of Trustworthy Health Supplement Content at S…→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- On the Dangers of Stochastic Parrots→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- ALBERT: A Lite BERT for Self-supervised Learning of Language\n Representations→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Langu…→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- LXMERT: Learning Cross-Modality Encoder Representations from Transformers→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- Know What You Don’t Know: Unanswerable Questions for SQuAD→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- Natural Questions: A Benchmark for Question Answering Research→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- Language Models as Knowledge Bases?→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- Adversarial Examples: Attacks and Defenses for Deep Learning→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- TinyBERT: Distilling BERT for Natural Language Understanding→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- Deep Learning--based Text Classification→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- Pre-trained models for natural language processing: A survey→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- Reading Wikipedia to Answer Open-Domain Questions→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- ERNIE: Enhanced Language Representation with Informative Entities→SQuAD: 100,000+ Questions for Machine Comprehension of TextLegacy edge — source detail unavailable
- SQuAD: 100,000+ Questions for Machine Comprehension of Text→Building a Large Annotated Corpus of English: The Penn TreebankLegacy edge — source detail unavailable
- SQuAD: 100,000+ Questions for Machine Comprehension of Text→Building Watson: An Overview of the DeepQA ProjectLegacy edge — source detail unavailable
- SQuAD: 100,000+ Questions for Machine Comprehension of Text→Teaching Machines to Read and ComprehendLegacy edge — source detail unavailable
- HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering→Reading Wikipedia to Answer Open-Domain QuestionsLegacy edge — source detail unavailable
- HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering→Know What You Don’t Know: Unanswerable Questions for SQuADLegacy edge — source detail unavailable
- Natural Questions: A Benchmark for Question Answering Research→HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question AnsweringLegacy edge — source detail unavailable
- Natural Questions: A Benchmark for Question Answering Research→Reading Wikipedia to Answer Open-Domain QuestionsLegacy edge — source detail unavailable
- Natural Questions: A Benchmark for Question Answering Research→Know What You Don’t Know: Unanswerable Questions for SQuADLegacy edge — source detail unavailable
- ERNIE: Enhanced Language Representation with Informative Entities→AI-Assisted Pipeline for Dynamic Generation of Trustworthy Health Supplement Content at S…Legacy edge — source detail unavailable
- ERNIE: Enhanced Language Representation with Informative Entities→GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language UnderstandingLegacy edge — source detail unavailable
- ERNIE: Enhanced Language Representation with Informative Entities→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Reading Wikipedia to Answer Open-Domain Questions→Teaching Machines to Read and ComprehendLegacy edge — source detail unavailable
- Reading Wikipedia to Answer Open-Domain Questions→Building Watson: An Overview of the DeepQA ProjectLegacy edge — source detail unavailable
- Know What You Don’t Know: Unanswerable Questions for SQuAD→Teaching Machines to Read and ComprehendLegacy edge — source detail unavailable
- HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…→Know What You Don’t Know: Unanswerable Questions for SQuADLegacy edge — source detail unavailable
- HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- LXMERT: Learning Cross-Modality Encoder Representations from Transformers→AI-Assisted Pipeline for Dynamic Generation of Trustworthy Health Supplement Content at S…Legacy edge — source detail unavailable
- LXMERT: Learning Cross-Modality Encoder Representations from Transformers→GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language UnderstandingLegacy edge — source detail unavailable
- LXMERT: Learning Cross-Modality Encoder Representations from Transformers→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Language Models as Knowledge Bases?→AI-Assisted Pipeline for Dynamic Generation of Trustworthy Health Supplement Content at S…Legacy edge — source detail unavailable
- Language Models as Knowledge Bases?→Natural Questions: A Benchmark for Question Answering ResearchLegacy edge — source detail unavailable
- Language Models as Knowledge Bases?→GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language UnderstandingLegacy edge — source detail unavailable
- Language Models as Knowledge Bases?→Reading Wikipedia to Answer Open-Domain QuestionsLegacy edge — source detail unavailable
- Language Models as Knowledge Bases?→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer→Teaching Machines to Read and ComprehendLegacy edge — source detail unavailable
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer→DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighterLegacy edge — source detail unavailable
- ALBERT: A Lite BERT for Self-supervised Learning of Language\n Representations→AI-Assisted Pipeline for Dynamic Generation of Trustworthy Health Supplement Content at S…Legacy edge — source detail unavailable
- ALBERT: A Lite BERT for Self-supervised Learning of Language\n Representations→Know What You Don’t Know: Unanswerable Questions for SQuADLegacy edge — source detail unavailable
- ALBERT: A Lite BERT for Self-supervised Learning of Language\n Representations→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- Pre-trained models for natural language processing: A survey→HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question AnsweringLegacy edge — source detail unavailable
- Pre-trained models for natural language processing: A survey→AI-Assisted Pipeline for Dynamic Generation of Trustworthy Health Supplement Content at S…Legacy edge — source detail unavailable
- Pre-trained models for natural language processing: A survey→GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language UnderstandingLegacy edge — source detail unavailable
- Pre-trained models for natural language processing: A survey→ERNIE: Enhanced Language Representation with Informative EntitiesLegacy edge — source detail unavailable
- Pre-trained models for natural language processing: A survey→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Pre-trained models for natural language processing: A survey→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- Pre-trained models for natural language processing: A survey→LXMERT: Learning Cross-Modality Encoder Representations from TransformersLegacy edge — source detail unavailable
- Pre-trained models for natural language processing: A survey→Language Models as Knowledge Bases?Legacy edge — source detail unavailable
- Pre-trained models for natural language processing: A survey→DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighterLegacy edge — source detail unavailable
- Pre-trained models for natural language processing: A survey→Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerLegacy edge — source detail unavailable
- Pre-trained models for natural language processing: A survey→ALBERT: A Lite BERT for Self-supervised Learning of Language\n RepresentationsLegacy edge — source detail unavailable
- Pre-trained models for natural language processing: A survey→TinyBERT: Distilling BERT for Natural Language UnderstandingLegacy edge — source detail unavailable
- TinyBERT: Distilling BERT for Natural Language Understanding→AI-Assisted Pipeline for Dynamic Generation of Trustworthy Health Supplement Content at S…Legacy edge — source detail unavailable
- TinyBERT: Distilling BERT for Natural Language Understanding→GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language UnderstandingLegacy edge — source detail unavailable
- TinyBERT: Distilling BERT for Natural Language Understanding→Know What You Don’t Know: Unanswerable Questions for SQuADLegacy edge — source detail unavailable
- TinyBERT: Distilling BERT for Natural Language Understanding→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- TinyBERT: Distilling BERT for Natural Language Understanding→DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighterLegacy edge — source detail unavailable
- TinyBERT: Distilling BERT for Natural Language Understanding→ALBERT: A Lite BERT for Self-supervised Learning of Language\n RepresentationsLegacy edge — source detail unavailable
- On the Dangers of Stochastic Parrots→GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language UnderstandingLegacy edge — source detail unavailable
- On the Dangers of Stochastic Parrots→Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerLegacy edge — source detail unavailable
- Deep Learning--based Text Classification→AI-Assisted Pipeline for Dynamic Generation of Trustworthy Health Supplement Content at S…Legacy edge — source detail unavailable
- Deep Learning--based Text Classification→GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language UnderstandingLegacy edge — source detail unavailable
- Deep Learning--based Text Classification→Know What You Don’t Know: Unanswerable Questions for SQuADLegacy edge — source detail unavailable
- Deep Learning--based Text Classification→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- Deep Learning--based Text Classification→DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighterLegacy edge — source detail unavailable
- Deep Learning--based Text Classification→ALBERT: A Lite BERT for Self-supervised Learning of Language\n RepresentationsLegacy edge — source detail unavailable
- Deep Learning--based Text Classification→Pre-trained models for natural language processing: A surveyLegacy edge — source detail unavailable
- mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Langu…→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Langu…→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Langu…→Language Models as Knowledge Bases?Legacy edge — source detail unavailable
- Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Langu…→Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→ERNIE: Enhanced Language Representation with Informative EntitiesLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→Know What You Don’t Know: Unanswerable Questions for SQuADLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanit…Legacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→LXMERT: Learning Cross-Modality Encoder Representations from TransformersLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→Language Models as Knowledge Bases?Legacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighterLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→ALBERT: A Lite BERT for Self-supervised Learning of Language\n RepresentationsLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→On the Dangers of Stochastic ParrotsLegacy edge — source detail unavailable
- On the Opportunities and Risks of Foundation Models→mT5: A Massively Multilingual Pre-trained Text-to-Text TransformerLegacy edge — source detail unavailable
What this paper cites, inside the corpus
| Paper | Year | Cited |
|---|---|---|
| Building a Large Annotated Corpus of English: The Penn Treebank | 1993 | 7,538 |
| Building Watson: An Overview of the DeepQA Project | 2010 | 1,523 |
| Teaching Machines to Read and Comprehend | 2015 | 1,519 |
What cites it, inside the corpus
Links
Download BibTeX · Download RIS · DOI · Open access copy · OpenAlex record
Topics
| Topic Modeling | Computer Science |
| Natural Language Processing Techniques | Computer Science |
| Multimodal Machine Learning Applications | Computer Science |
Is this record sound?
complete
Nothing in this record contradicts itself and no field we check is missing.
- supports4 author record(s) attached.
- supports27 reference(s) recorded.
- neutralThe DOI carries no year to check against.
- supportsA title is present.
Provenance
sha256 5cad55ac5d4d41e1…