A Convolutional Neural Network for Modelling Sentences

Nal Kalchbrenner; Edward Grefenstette; Phil Blunsom

doi:https://doi.org/10.3115/v1/p14-1062

A Convolutional Neural Network for Modelling Sentences

2014 · 3,571 citations · 12 from inside this corpus

Nal Kalchbrenner, Edward Grefenstette, Phil Blunsom

The ability to accurately represent sentences is central to language understanding. We describe a convolutional architecture dubbed the Dynamic Convolutional Neural Network (DCNN) that we adopt for the semantic modelling of sentences. The network uses Dynamic k-Max Pooling, a global pooling operation over linear sequences. The network handles input sentences of varying length and induces a feature graph over the sentence that is capable of explicitly capturing short and long-range relations. The network does not rely on a parse tree and is easily applicable to any language. We test the DCNN in four experiments: small scale binary and multi-class sentiment prediction, six-way question classification and Twitter sentiment prediction by distant supervision. The network achieves excellent performance in the first three tasks and a greater than 25% error reduction in the last task with respect to the strongest baseline.

19 of 19 neighbouring works in this corpus. Blue is what this paper cites; orange is what cites it, and a dashed line is one neighbour citing another. Only the largest labels are drawn — every node carries its full title on hover.

this paper works it cites works citing it node size = global citations · hover for the full title

Citation edge evidence

Each row is directed from the citing work to the cited work. Source status remains readable without the interactive graph.

Convolutional Neural Networks for Sentence Classification→A Convolutional Neural Network for Modelling SentencesLegacy edge — source detail unavailable
Hierarchical Attention Networks for Document Classification→A Convolutional Neural Network for Modelling SentencesLegacy edge — source detail unavailable
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Langu…→A Convolutional Neural Network for Modelling SentencesLegacy edge — source detail unavailable
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer→A Convolutional Neural Network for Modelling SentencesLegacy edge — source detail unavailable
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]→A Convolutional Neural Network for Modelling SentencesLegacy edge — source detail unavailable
Convolutional 2D Knowledge Graph Embeddings→A Convolutional Neural Network for Modelling SentencesLegacy edge — source detail unavailable
Deep learning for sentiment analysis: A survey→A Convolutional Neural Network for Modelling SentencesLegacy edge — source detail unavailable
Document Modeling with Gated Recurrent Neural Network for Sentiment Classification→A Convolutional Neural Network for Modelling SentencesLegacy edge — source detail unavailable
Deep Learning Enabled Semantic Communication Systems→A Convolutional Neural Network for Modelling SentencesLegacy edge — source detail unavailable
Deep Learning--based Text Classification→A Convolutional Neural Network for Modelling SentencesLegacy edge — source detail unavailable
Pre-trained models for natural language processing: A survey→A Convolutional Neural Network for Modelling SentencesLegacy edge — source detail unavailable
Teaching Machines to Read and Comprehend→A Convolutional Neural Network for Modelling SentencesLegacy edge — source detail unavailable
A Convolutional Neural Network for Modelling Sentences→Adaptive Subgradient Methods for Online Learning and Stochastic OptimizationLegacy edge — source detail unavailable
A Convolutional Neural Network for Modelling Sentences→Recursive Deep Models for Semantic Compositionality Over a Sentiment TreebankLegacy edge — source detail unavailable
A Convolutional Neural Network for Modelling Sentences→Improving neural networks by preventing co-adaptation of feature detectorsLegacy edge — source detail unavailable
A Convolutional Neural Network for Modelling Sentences→A unified architecture for natural language processingLegacy edge — source detail unavailable
A Convolutional Neural Network for Modelling Sentences→Phoneme recognition using time-delay neural networksLegacy edge — source detail unavailable
A Convolutional Neural Network for Modelling Sentences→Word Representations: A Simple and General Method for Semi-Supervised LearningLegacy edge — source detail unavailable
A Convolutional Neural Network for Modelling Sentences→Extensions of recurrent neural network language modelLegacy edge — source detail unavailable
Convolutional Neural Networks for Sentence Classification→Improving neural networks by preventing co-adaptation of feature detectorsLegacy edge — source detail unavailable
Convolutional Neural Networks for Sentence Classification→Adaptive Subgradient Methods for Online Learning and Stochastic OptimizationLegacy edge — source detail unavailable
Convolutional Neural Networks for Sentence Classification→Recursive Deep Models for Semantic Compositionality Over a Sentiment TreebankLegacy edge — source detail unavailable
A unified architecture for natural language processing→Phoneme recognition using time-delay neural networksLegacy edge — source detail unavailable
Word Representations: A Simple and General Method for Semi-Supervised Learning→A unified architecture for natural language processingLegacy edge — source detail unavailable
Document Modeling with Gated Recurrent Neural Network for Sentiment Classification→Convolutional Neural Networks for Sentence ClassificationLegacy edge — source detail unavailable
Document Modeling with Gated Recurrent Neural Network for Sentiment Classification→Recursive Deep Models for Semantic Compositionality Over a Sentiment TreebankLegacy edge — source detail unavailable
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank→A unified architecture for natural language processingLegacy edge — source detail unavailable
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank→Adaptive Subgradient Methods for Online Learning and Stochastic OptimizationLegacy edge — source detail unavailable
Hierarchical Attention Networks for Document Classification→Teaching Machines to Read and ComprehendLegacy edge — source detail unavailable
Hierarchical Attention Networks for Document Classification→Convolutional Neural Networks for Sentence ClassificationLegacy edge — source detail unavailable
Hierarchical Attention Networks for Document Classification→Document Modeling with Gated Recurrent Neural Network for Sentiment ClassificationLegacy edge — source detail unavailable
Hierarchical Attention Networks for Document Classification→Recursive Deep Models for Semantic Compositionality Over a Sentiment TreebankLegacy edge — source detail unavailable
Convolutional 2D Knowledge Graph Embeddings→Convolutional Neural Networks for Sentence ClassificationLegacy edge — source detail unavailable
Convolutional 2D Knowledge Graph Embeddings→Adaptive Subgradient Methods for Online Learning and Stochastic OptimizationLegacy edge — source detail unavailable
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]→Convolutional Neural Networks for Sentence ClassificationLegacy edge — source detail unavailable
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]→A unified architecture for natural language processingLegacy edge — source detail unavailable
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]→Phoneme recognition using time-delay neural networksLegacy edge — source detail unavailable
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]→Extensions of recurrent neural network language modelLegacy edge — source detail unavailable
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]→Document Modeling with Gated Recurrent Neural Network for Sentiment ClassificationLegacy edge — source detail unavailable
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]→Recursive Deep Models for Semantic Compositionality Over a Sentiment TreebankLegacy edge — source detail unavailable
Deep learning for sentiment analysis: A survey→Convolutional Neural Networks for Sentence ClassificationLegacy edge — source detail unavailable
Deep learning for sentiment analysis: A survey→Document Modeling with Gated Recurrent Neural Network for Sentiment ClassificationLegacy edge — source detail unavailable
Deep learning for sentiment analysis: A survey→Recursive Deep Models for Semantic Compositionality Over a Sentiment TreebankLegacy edge — source detail unavailable
Deep learning for sentiment analysis: A survey→Hierarchical Attention Networks for Document ClassificationLegacy edge — source detail unavailable
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer→Teaching Machines to Read and ComprehendLegacy edge — source detail unavailable
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer→Recursive Deep Models for Semantic Compositionality Over a Sentiment TreebankLegacy edge — source detail unavailable
Pre-trained models for natural language processing: A survey→Convolutional Neural Networks for Sentence ClassificationLegacy edge — source detail unavailable
Pre-trained models for natural language processing: A survey→Recursive Deep Models for Semantic Compositionality Over a Sentiment TreebankLegacy edge — source detail unavailable
Pre-trained models for natural language processing: A survey→Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerLegacy edge — source detail unavailable
Deep Learning--based Text Classification→Convolutional Neural Networks for Sentence ClassificationLegacy edge — source detail unavailable
Deep Learning--based Text Classification→Document Modeling with Gated Recurrent Neural Network for Sentiment ClassificationLegacy edge — source detail unavailable
Deep Learning--based Text Classification→Hierarchical Attention Networks for Document ClassificationLegacy edge — source detail unavailable
Deep Learning--based Text Classification→Pre-trained models for natural language processing: A surveyLegacy edge — source detail unavailable
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Langu…→Convolutional Neural Networks for Sentence ClassificationLegacy edge — source detail unavailable
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Langu…→Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerLegacy edge — source detail unavailable

What this paper cites, inside the corpus

Paper	Year	Cited
Adaptive Subgradient Methods for Online Learning and Stochastic Optimization	2010	8,621
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank	2013	6,849
Improving neural networks by preventing co-adaptation of feature detectors	2012	6,653
A unified architecture for natural language processing	2008	5,207
Phoneme recognition using time-delay neural networks	1989	2,650
Word Representations: A Simple and General Method for Semi-Supervised Learning	2010	1,941
Extensions of recurrent neural network language model	2011	1,603

What cites it, inside the corpus

Paper	Year	Cited
Convolutional Neural Networks for Sentence Classification	2014	13,987
Hierarchical Attention Networks for Document Classification	2016	4,871
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Langu…	2022	3,836
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer	2019	3,698
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]	2018	2,907
Convolutional 2D Knowledge Graph Embeddings	2018	2,467
Deep learning for sentiment analysis: A survey	2018	1,918
Document Modeling with Gated Recurrent Neural Network for Sentiment Classification	2015	1,548
Deep Learning Enabled Semantic Communication Systems	2021	1,547
Deep Learning--based Text Classification	2021	1,525
Pre-trained models for natural language processing: A survey	2020	1,521
Teaching Machines to Read and Comprehend	2015	1,519

Links

Download BibTeX · Download RIS · DOI · Open access copy · OpenAlex record

Topics

Topic Modeling	Computer Science
Natural Language Processing Techniques	Computer Science
Sentiment Analysis and Opinion Mining	Computer Science

Is this record sound?

complete

Nothing in this record contradicts itself and no field we check is missing.

supports3 author record(s) attached.
supports35 reference(s) recorded.
neutralThe DOI carries no year to check against.
supportsA title is present.

Provenance

Everything above was read from one stored OpenAlex payload, fetched 2026-09-04T03:58:46+00:00.

sha256 bba2969b3567609a…