Solving Multiclass Learning Problems via Error-Correcting Output Codes
Tom Dietterich, Ghulum Bakiri low
Multiclass learning problems involve finding a definitionfor an unknown function f(x) whose range is a discrete setcontaining k > 2 values (i.e., k ``classes''). Thedefinition is acquired by studying collections of training examples ofthe form [x_i, f (x_i)]. Existing approaches tomulticlass learning problems include direct application of multiclassalgorithms such as the decision-tree algorithms C4.5 and CART,application of binary concept learning algorithms to learn individualbinary functions for each of the k classes, and application ofbinary concept learning algorithms with distributed outputrepresentations. This paper compares these three approaches to a newtechnique in which error-correcting codes are employed as adistributed output representation. We show that these outputrepresentations improve the generalization performance of both C4.5and backpropagation on a wide range of multiclass learning tasks. Wealso demonstrate that this approach is robust with respect to changesin the size of the training sample, the assignment of distributedrepresentations to particular classes, and the application ofoverfitting avoidance techniques such as decision-tree pruning.Finally, we show that---like the other methods---the error-correctingcode technique can provide reliable class probability estimates.Taken together, these results demonstrate that error-correcting outputcodes provide a general-purpose method for improving the performanceof inductive learning programs on multiclass problems.
Citation edge evidence
- Ensemble Methods in Machine Learning→Solving Multiclass Learning Problems via Error-Correcting Output CodesLegacy edge — source detail unavailable
- Multitask Learning→Solving Multiclass Learning Problems via Error-Correcting Output CodesLegacy edge — source detail unavailable
- Distance Metric Learning for Large Margin Nearest Neighbor Classification→Solving Multiclass Learning Problems via Error-Correcting Output CodesLegacy edge — source detail unavailable
- Ensemble learning: A survey→Solving Multiclass Learning Problems via Error-Correcting Output CodesLegacy edge — source detail unavailable
- Understanding Machine Learning: From Theory To Algorithms→Solving Multiclass Learning Problems via Error-Correcting Output CodesLegacy edge — source detail unavailable
- Ensemble based systems in decision making→Solving Multiclass Learning Problems via Error-Correcting Output CodesLegacy edge — source detail unavailable
- A Short Introduction to Boosting→Solving Multiclass Learning Problems via Error-Correcting Output CodesLegacy edge — source detail unavailable
- Improved boosting algorithms using confidence-rated predictions→Solving Multiclass Learning Problems via Error-Correcting Output CodesLegacy edge — source detail unavailable
- Boosting the margin: a new explanation for the effectiveness of voting methods→Solving Multiclass Learning Problems via Error-Correcting Output CodesLegacy edge — source detail unavailable
- The Boosting Approach to Machine Learning: An Overview→Solving Multiclass Learning Problems via Error-Correcting Output CodesLegacy edge — source detail unavailable
- Improved Boosting Algorithms Using Confidence-rated Predictions→Solving Multiclass Learning Problems via Error-Correcting Output CodesLegacy edge — source detail unavailable
- On the algorithmic implementation of multiclass kernel-based vector machines→Solving Multiclass Learning Problems via Error-Correcting Output CodesLegacy edge — source detail unavailable
- Distance Metric Learning for Large Margin Nearest Neighbor Classification→Solving Multiclass Learning Problems via Error-Correcting Output CodesLegacy edge — source detail unavailable
- Attribute-Based Classification for Zero-Shot Visual Object Categorization→Solving Multiclass Learning Problems via Error-Correcting Output CodesLegacy edge — source detail unavailable
- Neural networks for classification: a survey→Solving Multiclass Learning Problems via Error-Correcting Output CodesLegacy edge — source detail unavailable
- Solving Multiclass Learning Problems via Error-Correcting Output Codes→Classification and Regression Trees.Legacy edge — source detail unavailable
- Solving Multiclass Learning Problems via Error-Correcting Output Codes→Learning Internal Representations by Error PropagationLegacy edge — source detail unavailable
- Solving Multiclass Learning Problems via Error-Correcting Output Codes→The perceptron: A probabilistic model for information storage and organization in the bra…Legacy edge — source detail unavailable
- Solving Multiclass Learning Problems via Error-Correcting Output Codes→The Strength of Weak LearnabilityLegacy edge — source detail unavailable
- Solving Multiclass Learning Problems via Error-Correcting Output Codes→Learning Internal Representations by Error PropagationLegacy edge — source detail unavailable
- Solving Multiclass Learning Problems via Error-Correcting Output Codes→Phoneme recognition using time-delay neural networksLegacy edge — source detail unavailable
- Solving Multiclass Learning Problems via Error-Correcting Output Codes→Parallel Networks that Learn to Pronounce English TextLegacy edge — source detail unavailable
- Solving Multiclass Learning Problems via Error-Correcting Output Codes→Connectionist learning proceduresLegacy edge — source detail unavailable
- Ensemble Methods in Machine Learning→Improved boosting algorithms using confidence-rated predictionsLegacy edge — source detail unavailable
- Boosting the margin: a new explanation for the effectiveness of voting methods→Improved boosting algorithms using confidence-rated predictionsLegacy edge — source detail unavailable
- Boosting the margin: a new explanation for the effectiveness of voting methods→The Strength of Weak LearnabilityLegacy edge — source detail unavailable
- Improved boosting algorithms using confidence-rated predictions→Boosting the margin: a new explanation for the effectiveness of voting methodsLegacy edge — source detail unavailable
- Distance Metric Learning for Large Margin Nearest Neighbor Classification→On the algorithmic implementation of multiclass kernel-based vector machinesLegacy edge — source detail unavailable
- Phoneme recognition using time-delay neural networks→Learning Internal Representations by Error PropagationLegacy edge — source detail unavailable
- Phoneme recognition using time-delay neural networks→Connectionist learning proceduresLegacy edge — source detail unavailable
- Attribute-Based Classification for Zero-Shot Visual Object Categorization→Learning Internal Representations by Error PropagationLegacy edge — source detail unavailable
- Attribute-Based Classification for Zero-Shot Visual Object Categorization→Classification and Regression Trees.Legacy edge — source detail unavailable
- Distance Metric Learning for Large Margin Nearest Neighbor Classification→On the algorithmic implementation of multiclass kernel-based vector machinesLegacy edge — source detail unavailable
- A Short Introduction to Boosting→Boosting the margin: a new explanation for the effectiveness of voting methodsLegacy edge — source detail unavailable
- A Short Introduction to Boosting→Improved boosting algorithms using confidence-rated predictionsLegacy edge — source detail unavailable
- A Short Introduction to Boosting→The Strength of Weak LearnabilityLegacy edge — source detail unavailable
- Learning Internal Representations by Error Propagation→Learning Internal Representations by Error PropagationLegacy edge — source detail unavailable
- On the algorithmic implementation of multiclass kernel-based vector machines→Improved boosting algorithms using confidence-rated predictionsLegacy edge — source detail unavailable
- On the algorithmic implementation of multiclass kernel-based vector machines→Classification and Regression Trees.Legacy edge — source detail unavailable
- Ensemble based systems in decision making→Ensemble Methods in Machine LearningLegacy edge — source detail unavailable
- Ensemble based systems in decision making→Boosting the margin: a new explanation for the effectiveness of voting methodsLegacy edge — source detail unavailable
- Ensemble based systems in decision making→The Strength of Weak LearnabilityLegacy edge — source detail unavailable
- The Boosting Approach to Machine Learning: An Overview→Boosting the margin: a new explanation for the effectiveness of voting methodsLegacy edge — source detail unavailable
- The Boosting Approach to Machine Learning: An Overview→Improved boosting algorithms using confidence-rated predictionsLegacy edge — source detail unavailable
- The Boosting Approach to Machine Learning: An Overview→The Strength of Weak LearnabilityLegacy edge — source detail unavailable
- The Boosting Approach to Machine Learning: An Overview→Improved Boosting Algorithms Using Confidence-rated PredictionsLegacy edge — source detail unavailable
- Ensemble learning: A survey→Improved boosting algorithms using confidence-rated predictionsLegacy edge — source detail unavailable
- Ensemble learning: A survey→Ensemble based systems in decision makingLegacy edge — source detail unavailable
- Connectionist learning procedures→Parallel Networks that Learn to Pronounce English TextLegacy edge — source detail unavailable
- Connectionist learning procedures→Phoneme recognition using time-delay neural networksLegacy edge — source detail unavailable
- Connectionist learning procedures→Learning Internal Representations by Error PropagationLegacy edge — source detail unavailable
- Improved Boosting Algorithms Using Confidence-rated Predictions→Boosting the margin: a new explanation for the effectiveness of voting methodsLegacy edge — source detail unavailable
- Understanding Machine Learning: From Theory To Algorithms→The perceptron: A probabilistic model for information storage and organization in the bra…Legacy edge — source detail unavailable
- Understanding Machine Learning: From Theory To Algorithms→The Strength of Weak LearnabilityLegacy edge — source detail unavailable
- Understanding Machine Learning: From Theory To Algorithms→Learning Internal Representations by Error PropagationLegacy edge — source detail unavailable
- Understanding Machine Learning: From Theory To Algorithms→On the algorithmic implementation of multiclass kernel-based vector machinesLegacy edge — source detail unavailable
- Understanding Machine Learning: From Theory To Algorithms→Classification and Regression Trees.Legacy edge — source detail unavailable
What this paper cites, inside the corpus
What cites it, inside the corpus
Links
Download BibTeX · Download RIS · DOI · Open access copy · OpenAlex record
Topics
| Machine Learning and Algorithms | Computer Science |
| Imbalanced Data Classification Techniques | Computer Science |
| Machine Learning and Data Classification | Computer Science |
Is this record sound?
complete
Nothing in this record contradicts itself and no field we check is missing.
- supports2 author record(s) attached.
- supports37 reference(s) recorded.
- neutralThe DOI carries no year to check against.
- supportsA title is present.
Provenance
sha256 46f669157f96ea35…