Why Does Unsupervised Pre-training Help Deep Learning?
Dumitru Erhan, Yoshua Bengio, Aaron Courville, Pierre-Antoine Manzagol, Pascal Vincent low, Samy Bengio
The source holds an abstract for this work, but its best open-access copy is under no open licence, which does not permit us to republish the text. Read it at the source below.
this paper
works it cites
works citing it
node size = global citations · hover for the full title
Citation edge evidence
- Deep learning in neural networks: An overview→Why Does Unsupervised Pre-training Help Deep Learning?Legacy edge — source detail unavailable
- Deep Sparse Rectifier Neural Networks→Why Does Unsupervised Pre-training Help Deep Learning?Legacy edge — source detail unavailable
- Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review→Why Does Unsupervised Pre-training Help Deep Learning?Legacy edge — source detail unavailable
- Deep learning for healthcare: review, opportunities and challenges→Why Does Unsupervised Pre-training Help Deep Learning?Legacy edge — source detail unavailable
- Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition→Why Does Unsupervised Pre-training Help Deep Learning?Legacy edge — source detail unavailable
- A survey on semi-supervised learning→Why Does Unsupervised Pre-training Help Deep Learning?Legacy edge — source detail unavailable
- Recurrent Convolutional Neural Networks for Text Classification→Why Does Unsupervised Pre-training Help Deep Learning?Legacy edge — source detail unavailable
- Practical Recommendations for Gradient-Based Training of Deep Architectures→Why Does Unsupervised Pre-training Help Deep Learning?Legacy edge — source detail unavailable
- Deep Learning: Methods and Applications→Why Does Unsupervised Pre-training Help Deep Learning?Legacy edge — source detail unavailable
- A Gift from Knowledge Distillation: Fast Optimization, Network Minimization and Transfer …→Why Does Unsupervised Pre-training Help Deep Learning?Legacy edge — source detail unavailable
- Pre-trained models for natural language processing: A survey→Why Does Unsupervised Pre-training Help Deep Learning?Legacy edge — source detail unavailable
- Why Does Unsupervised Pre-training Help Deep Learning?→Reducing the Dimensionality of Data with Neural NetworksLegacy edge — source detail unavailable
- Why Does Unsupervised Pre-training Help Deep Learning?→A Fast Learning Algorithm for Deep Belief NetsLegacy edge — source detail unavailable
- Why Does Unsupervised Pre-training Help Deep Learning?→A unified architecture for natural language processingLegacy edge — source detail unavailable
- Why Does Unsupervised Pre-training Help Deep Learning?→Curriculum learningLegacy edge — source detail unavailable
- Why Does Unsupervised Pre-training Help Deep Learning?→Learning Deep Architectures for AILegacy edge — source detail unavailable
- Why Does Unsupervised Pre-training Help Deep Learning?→Training Products of Experts by Minimizing Contrastive DivergenceLegacy edge — source detail unavailable
- Why Does Unsupervised Pre-training Help Deep Learning?→Semi-Supervised LearningLegacy edge — source detail unavailable
- Why Does Unsupervised Pre-training Help Deep Learning?→On Discriminative vs. Generative Classifiers: A comparison of logistic regression and nai…Legacy edge — source detail unavailable
- Semi-Supervised Learning→On Discriminative vs. Generative Classifiers: A comparison of logistic regression and nai…Legacy edge — source detail unavailable
- Practical Recommendations for Gradient-Based Training of Deep Architectures→Learning Deep Architectures for AILegacy edge — source detail unavailable
- Practical Recommendations for Gradient-Based Training of Deep Architectures→A Fast Learning Algorithm for Deep Belief NetsLegacy edge — source detail unavailable
- Practical Recommendations for Gradient-Based Training of Deep Architectures→Deep Sparse Rectifier Neural NetworksLegacy edge — source detail unavailable
- Practical Recommendations for Gradient-Based Training of Deep Architectures→Curriculum learningLegacy edge — source detail unavailable
- Learning Deep Architectures for AI→Reducing the Dimensionality of Data with Neural NetworksLegacy edge — source detail unavailable
- Learning Deep Architectures for AI→Training Products of Experts by Minimizing Contrastive DivergenceLegacy edge — source detail unavailable
- Learning Deep Architectures for AI→A unified architecture for natural language processingLegacy edge — source detail unavailable
- Learning Deep Architectures for AI→A Fast Learning Algorithm for Deep Belief NetsLegacy edge — source detail unavailable
- Learning Deep Architectures for AI→On Discriminative vs. Generative Classifiers: A comparison of logistic regression and nai…Legacy edge — source detail unavailable
- Learning Deep Architectures for AI→Curriculum learningLegacy edge — source detail unavailable
- Deep learning in neural networks: An overview→Learning Deep Architectures for AILegacy edge — source detail unavailable
- Deep learning in neural networks: An overview→Reducing the Dimensionality of Data with Neural NetworksLegacy edge — source detail unavailable
- Deep learning in neural networks: An overview→Training Products of Experts by Minimizing Contrastive DivergenceLegacy edge — source detail unavailable
- Deep learning in neural networks: An overview→A unified architecture for natural language processingLegacy edge — source detail unavailable
- Deep learning in neural networks: An overview→A Fast Learning Algorithm for Deep Belief NetsLegacy edge — source detail unavailable
- Deep learning in neural networks: An overview→Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech RecognitionLegacy edge — source detail unavailable
- Deep learning in neural networks: An overview→Deep Learning: Methods and ApplicationsLegacy edge — source detail unavailable
- Deep learning in neural networks: An overview→Deep Sparse Rectifier Neural NetworksLegacy edge — source detail unavailable
- Reducing the Dimensionality of Data with Neural Networks→A Fast Learning Algorithm for Deep Belief NetsLegacy edge — source detail unavailable
- A Fast Learning Algorithm for Deep Belief Nets→Training Products of Experts by Minimizing Contrastive DivergenceLegacy edge — source detail unavailable
- Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition→Learning Deep Architectures for AILegacy edge — source detail unavailable
- Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition→Reducing the Dimensionality of Data with Neural NetworksLegacy edge — source detail unavailable
- Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition→Training Products of Experts by Minimizing Contrastive DivergenceLegacy edge — source detail unavailable
- Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition→A unified architecture for natural language processingLegacy edge — source detail unavailable
- Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition→A Fast Learning Algorithm for Deep Belief NetsLegacy edge — source detail unavailable
- Deep Learning: Methods and Applications→Learning Deep Architectures for AILegacy edge — source detail unavailable
- Deep Learning: Methods and Applications→Reducing the Dimensionality of Data with Neural NetworksLegacy edge — source detail unavailable
- Deep Learning: Methods and Applications→A unified architecture for natural language processingLegacy edge — source detail unavailable
- Deep Learning: Methods and Applications→A Fast Learning Algorithm for Deep Belief NetsLegacy edge — source detail unavailable
- Deep Learning: Methods and Applications→Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech RecognitionLegacy edge — source detail unavailable
- Deep Learning: Methods and Applications→Deep Sparse Rectifier Neural NetworksLegacy edge — source detail unavailable
- Deep Sparse Rectifier Neural Networks→Learning Deep Architectures for AILegacy edge — source detail unavailable
- Deep Sparse Rectifier Neural Networks→A Fast Learning Algorithm for Deep Belief NetsLegacy edge — source detail unavailable
- Recurrent Convolutional Neural Networks for Text Classification→Reducing the Dimensionality of Data with Neural NetworksLegacy edge — source detail unavailable
- Curriculum learning→Learning Deep Architectures for AILegacy edge — source detail unavailable
- Curriculum learning→Reducing the Dimensionality of Data with Neural NetworksLegacy edge — source detail unavailable
- Curriculum learning→A unified architecture for natural language processingLegacy edge — source detail unavailable
- Curriculum learning→A Fast Learning Algorithm for Deep Belief NetsLegacy edge — source detail unavailable
- Deep learning for healthcare: review, opportunities and challenges→Practical Recommendations for Gradient-Based Training of Deep ArchitecturesLegacy edge — source detail unavailable
- Deep learning for healthcare: review, opportunities and challenges→Learning Deep Architectures for AILegacy edge — source detail unavailable
- Deep learning for healthcare: review, opportunities and challenges→Deep learning in neural networks: An overviewLegacy edge — source detail unavailable
- Deep learning for healthcare: review, opportunities and challenges→Reducing the Dimensionality of Data with Neural NetworksLegacy edge — source detail unavailable
- Deep learning for healthcare: review, opportunities and challenges→A Fast Learning Algorithm for Deep Belief NetsLegacy edge — source detail unavailable
- Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review→Learning Deep Architectures for AILegacy edge — source detail unavailable
- Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review→Deep learning in neural networks: An overviewLegacy edge — source detail unavailable
- Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review→Reducing the Dimensionality of Data with Neural NetworksLegacy edge — source detail unavailable
- Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review→Training Products of Experts by Minimizing Contrastive DivergenceLegacy edge — source detail unavailable
- Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review→A Fast Learning Algorithm for Deep Belief NetsLegacy edge — source detail unavailable
- Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review→Deep Learning: Methods and ApplicationsLegacy edge — source detail unavailable
- Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review→Deep Sparse Rectifier Neural NetworksLegacy edge — source detail unavailable
- A survey on semi-supervised learning→Semi-Supervised LearningLegacy edge — source detail unavailable
- A survey on semi-supervised learning→A Fast Learning Algorithm for Deep Belief NetsLegacy edge — source detail unavailable
- Pre-trained models for natural language processing: A survey→Reducing the Dimensionality of Data with Neural NetworksLegacy edge — source detail unavailable
What this paper cites, inside the corpus
What cites it, inside the corpus
Links
Topics
| Domain Adaptation and Few-Shot Learning | Computer Science |
| Machine Learning and Data Classification | Computer Science |
| Topic Modeling | Computer Science |
Is this record sound?
complete
Nothing in this record contradicts itself and no field we check is missing.
- supports6 author record(s) attached.
- supports55 reference(s) recorded.
- neutralThe DOI carries no year to check against.
- supportsA title is present.
Provenance
sha256 6e314d9c6052d1ed…