Journal
IEEE TRANSACTIONS ON INFORMATION THEORY
Volume 48, Issue 10, Pages 2721-2735Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TIT.2002.802647
Keywords
generalization; margin; margin distribution; neural networks; probably approximately correct (pac) learning; ridge regression; soft margin; statistical learning; support vector machines (SVMs)
Ask authors/readers for more resources
Generalization bounds depending on the margin of a classifier are a relatively recent development. They provide an ex. planation of the performance of state-of-the-art learning systems such as support vector machines (SVMs) [1] and Adaboost [2]. The difficulty with these bounds has been either their lack of robustness or their looseness. The question of whether the generalization of a classifier can be more tightly bounded in terms of a robust measure of the distribution of margin values has remained open for some time. The paper answers this open question in the affirmative and, furthermore, the analysis leads to bounds that motivate the previously heuristic soft margin SVM algorithms as well as justifying the use of the quadratic loss in neural network training algorithms. The results are extended to give bounds for the probability of failing to achieve a target accuracy in regression prediction, with a statistical analysis of ridge regression and Gaussian processes as a,special case. The analysis presented in the paper has also lead to,new boosting algorithms described elsewhere.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available