On the Representer Theorem and Equivalent Degrees of Freedom of SVR

Dinuzzo, F; Neve , M; De Nicolao, G; Gianazza, UP

アイテム詳細

登録内容を編集ファイル形式で保存

一時保存へ追加

タグ情報を表示リリース履歴を表示詳細要約

公開

学術論文

On the Representer Theorem and Equivalent Degrees of Freedom of SVR

MPS-Authors

There are no MPG-Authors in the publication available

External Resource

http://www.jmlr.org/papers/volume8/dinuzzo07a/dinuzzo07a.pdf
(出版社版)

Fulltext (restricted access)

There are currently no full texts shared for your IP range.

フルテキスト (公開)

公開されているフルテキストはありません

付随資料 (公開)

There is no public supplementary material available

引用

Dinuzzo, F., Neve, M., De Nicolao, G., & Gianazza, U. (2007). On the Representer Theorem and Equivalent Degrees of Freedom of SVR. The Journal of Machine Learning Research, 8, 2467-2495.

引用: https://hdl.handle.net/11858/00-001M-0000-0013-CB7F-F

要旨

Support Vector Regression (SVR) for discrete data is considered. An alternative formulation of the representer theorem is derived. This result is based on the newly introduced notion of pseudoresidual and the use of subdifferential calculus. The representer theorem is exploited to analyze the sensitivity properties of ε-insensitive SVR and introduce the notion of approximate degrees of freedom. The degrees of freedom are shown to play a key role in the evaluation of the optimism, that is the difference between the expected in-sample error and the expected empirical risk. In this way, it is possible to define a Cp-like statistic that can be used for tuning the parameters of SVR. The proposed tuning procedure is tested on a simulated benchmark problem and on a real world problem (Boston Housing data set).