An ε-twin support vector machine for regression

This study proposes a new regressor-epsilon-twin support vector regression (epsilon-TSVR) based on TSVR. epsilon-TSVR determines a pair of epsilon-insensitive proximal functions by solving two related SVM-type problems. Different form only empirical risk minimization is implemented in TSVR, the structural risk minimization principle is implemented by introducing the regularization term in primal problems of our epsilon-TSVR, yielding the dual problems to be stable positive definite quadratic programming problems, so can improve the performance of regression. In addition, the successive overrelaxation technique is used to solve the optimization problems to speed up the training procedure. Experimental results for both artificial and real datasets show that, compared with the popular epsilon-SVR, LS-SVR and TSVR, our epsilon-TSVR has remarkable improvement of generalization performance with short training time.