Greedy kernel PCA for training data reduction and nonlinear feature extraction in classification

Xiaofang Liu; Chun Yang

doi:10.1117/12.832806

30 October 2009 Greedy kernel PCA for training data reduction and nonlinear feature extraction in classification

Xiaofang Liu, Chun Yang

Proceedings Volume 7495, MIPPR 2009: Automatic Target Recognition and Image Analysis; 749530 (2009) https://doi.org/10.1117/12.832806
Event: Sixth International Symposium on Multispectral Image Processing and Pattern Recognition, 2009, Yichang, China

Abstract

The aim of this paper applies greedy kernel principal component analysis (greedy kernel PCA) to deal with training data reduction and nonlinear feature extraction in classification. Kernel PCA is a nonlinear extension of linear PCA. It shows a powerful nonlinear feature extraction technique via kernel trick. A disadvantage of kernel PCA, however, is that the storage of training data in terms of the dot products is too expensive since the size of kernel matrix increases quadratically with the number of training data. So, a more efficient feature extraction method, greedy kernel PCA, is proposed to reduce training data and nonlinear feature extraction for classification. The reduced set method aims to find a new kernel expansion and well approximates the original training data. Simulation results show both kernel PCA and greedy kernel PCA are more superior to linear PCA in feature extraction. Greedy kernel PCA will tend towards kernel PCA feature extraction as more percentage of training data is included in the reduced set, whilst greedy kernel PCA results in lower evaluation cost due to the reduced training set. The experiments show also that greedy kernel PCA can significantly reduce the complexity while retaining their accuracy in classification.

Citation Download Citation

Xiaofang Liu and Chun Yang "Greedy kernel PCA for training data reduction and nonlinear feature extraction in classification", Proc. SPIE 7495, MIPPR 2009: Automatic Target Recognition and Image Analysis, 749530 (30 October 2009); https://doi.org/10.1117/12.832806

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available