基于Ramp损失函数的原空间支持向量回归机
首发时间:2013-07-15
摘要:支持向量回归机模型的性能与所选的损失函数有很大关系。提出一种基于不对称形式的二次不敏感控制型Ramp损失函数的支持向量回归机,采用凹凸过程优化和光滑技术算法,将非凸优化问题转化为连续、二次可微凸优化问题,利用Amijo-Newton优化算法求解所建立的优化模型,并分析了算法的收敛性。该算法不仅可以保持支持向量的稀疏性,而且还可以控制训练样本中的异常值。实验结果表明,该模型保持了很好的泛化能力,无论对模拟数据还是标准数据都具有一定的拟合精度,与标准支持向量机模型相比,不仅能够降低噪声和孤立点的影响而且也具有较强的鲁棒性。
For information in English, please click here
Support vector regression in the primal space based on the Ramp loss function
Abstract:In this paper the function of support vector regression machine model relies much on the loss function chosen. On the basis of quadratic insensitive control type loss function Ramp with asymmetric form, support vector regression machine model is proposed. Adopting the concave and convex process optimization and the smooth technology algorithm, transforming the non-convex optimization to the continuous, quadratic differentiable convex optimization. Using the Amijo-Newton optimized algorithm to solve the proposed model and analyzing the convergence of the algorithm. The algorithm not only keeps the sparse nature of support vector, but also can control the abnormal values of the training sample. The experimental results show that the support vector regression machine model proposed keeps good generalization ability, and the model can better fit both the simulated data and the standard data. Compared with the standard support vector machine (SVM) model, the proposed model not only can reduce the effects of noise and outliers, but also has stronger robustness.
Keywords: theory of controls Support vector regression Outliers Loss function concave-convex procedure(CCCP)
论文图表:
引用
No.4548423813481137****
同行评议
勘误表
基于Ramp损失函数的原空间支持向量回归机
评论
全部评论0/1000