Monthly
288 pp. per issue, 6 x 9,
illustrated
Founded: 1989
ISSN 0899-7667
E-ISSN 1530-888X
2008 ISI Impact Factor: 2.378
|
October 2000, Vol. 12, No. 10, Pages 2385-2404
Posted Online March 13, 2006.
(doi:10.1162/089976600300014980)
© 2000 Massachusetts Institute of Technology
Generalized Discriminant Analysis Using a Kernel Approach G. BaudatMars Electronics International, CH-1211 Geneva, Switzerland F. AnouarINRA-SNES, Institut National de Recherche en Agronomie, 49071 Beaucouzé, France
We present a new method that we call generalized discriminant analysis (GDA) to deal with nonlinear discriminant analysis using kernel function operator. The underlying theory is close to the support vector machines (SVM) insofar as the GDA method provides a mapping of the input vectors into high-dimensional feature space. In the transformed space, linear properties make it easy to extend and generalize the classical linear discriminant analysis (LDA) to nonlinear discriminant analysis. The formulation is expressed as an eigenvalue problem resolution. Using a different kernel, one can cover a wide class of nonlinearities. For both simulated data and alternate kernels, we give classification results, as well as the shape of the decision function. The results are confirmed using real data to perform seed classification. Cited byRobert F. Harrison, Kitsuchart Pasupa. (2010) A simple iterative algorithm for parsimonious binary kernel Fisher discrimination. Pattern Analysis and Applications 13:1, 15-22 Online publication date: 1-Mar-2010. CrossRef Dake Zhou, Zhenmin Tang. (2010) Kernel-based improved discriminant analysis and its application to face recognition. Soft Computing 14:2, 103-111 Online publication date: 1-Feb-2010. CrossRef Xiao-Zhang Liu, Wen-Sheng Chen, P.C. Yuen, Guo-Can Feng. (2010) Learning Kernel in Kernel-Based LDA for Face Recognition Under Illumination Variations. IEEE Signal Processing Letters 16:12, 1019-1022 Online publication date: 1-Jan-2010. CrossRef Jun-Bao Li, Jeng-Shyang Pan, Zhe-Ming Lu. (2009) Kernel optimization-based discriminant analysis for face recognition. Neural Computing and Applications 18:6, 603-612 Online publication date: 1-Oct-2009. CrossRef U. Ozertem, D. Erdogmus. (2009) RKHS Bayes Discriminant: A Subspace Constrained Nonlinear Feature Projection for Signal Detection. IEEE Transactions on Neural Networks 20:7, 1195-1203 Online publication date: 1-Aug-2009. CrossRef S. Prasad, L.M. Bruce. (2009) Information Fusion in Kernel-Induced Spaces for Robust Subpixel Hyperspectral ATR. IEEE Geoscience and Remote Sensing Letters 6:3, 572-576 Online publication date: 1-Aug-2009. CrossRef Ming-Guang Shi, Jun-Feng Xia, Xue-Ling Li, De-Shuang Huang. (2009) Predicting protein–protein interactions from sequence using correlation coefficient and high-quality interaction dataset. Amino Acids Online publication date: 24-May-2009. CrossRef Khalid Chougdali, Mohamed Jedra, Nouredine Zahid. (2009) Kernel relevance weighted discriminant analysis for face recognition. Pattern Analysis and Applications Online publication date: 9-May-2009. CrossRef Bor-Chen Kuo, Cheng-Hsuan Li, Jinn-Min Yang. (2009) Kernel Nonparametric Weighted Feature Extraction for Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing 47:4, 1139-1155 Online publication date: 1-May-2009. CrossRef W. Wu, M.O. Ahmad, S. Samadi. (2009) Discriminant analysis based on modified generalised singular value decomposition and its numerical error analysis. IET Computer Vision 3:3, 159 Online publication date: 1-Feb-2009. CrossRef Eimad E. Abusham, E. K. Wong. (2009) Locally Linear Discriminate Embedding for Face Recognition. Discrete Dynamics in Nature and Society 2009, 1-9 Online publication date: 1-Feb-2009. CrossRef Hong-yan WU, Dao-ping HUANG. (2009) <![CDATA[Improving kernel fisher discriminant analysis for fault diagnosis in chemical process]]>. Journal of Computer Applications 29:2, 595 CrossRef Jing Peng, Peng Zhang, N. Riedel. (2009) Discriminant Learning Analysis. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) 38:6, 1614-1625 Online publication date: 1-Jan-2009. CrossRef Zi-qiang WANG, Xu QIAN. (2009) <![CDATA[Document classification algorithm based on KDA and SVM]]>. Journal of Computer Applications 29:2, 416 CrossRef Xiao-zhang LIU, Guo-can FENG. (2009) <![CDATA[Multiple kernel discriminant analysis with optimized weight]]> : Multiple kernel discriminant analysis with optimized weight. Journal of Computer Applications 29:9, 2473 CrossRef Yanwei Pang, Yuan Yuan, Xuelong Li. (2009) Effective Feature Extraction in High-Dimensional Space. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) 38:6, 1652-1656 Online publication date: 1-Jan-2009. CrossRef Lei Wang, Kap Luk Chan, Ping Xue, Luping Zhou. (2009) A Kernel-Induced Space Selection Approach to Model Selection in KLDA. IEEE Transactions on Neural Networks 19:12, 2116-2131 Online publication date: 1-Jan-2009. CrossRef Xiao-yan ZHOU. (2008) Novel face recognition method based on KPCA plus KDA. Journal of Computer Applications 28:5, 1263-1266 Online publication date: 20-Nov-2008. CrossRef Shuiwang Ji, Jieping Ye. (2008) Kernel Uncorrelated and Regularized Discriminant Analysis: A Theoretical and Computational Study. IEEE Transactions on Knowledge and Data Engineering 20:10, 1311-1321 Online publication date: 1-Nov-2008. CrossRef Jaewon Sung, Daijin Kim. (2008) Pose-Robust Facial Expression Recognition Using View-Based 2D $+$ 3D AAM. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans 38:4, 852-866 Online publication date: 1-Aug-2008. CrossRef Yanwei Pang, Yuan Yuan, Xuelong Li. (2008) Gabor-Based Region Covariance Matrices for Face Recognition. IEEE Transactions on Circuits and Systems for Video Technology 18:7, 989-993 Online publication date: 1-Aug-2008. CrossRef L. Samaniego, A. Bardossy, K. Schulz. (2008) Supervised Classification of Remotely Sensed Imagery Using a Modified $k$-NN Technique. IEEE Transactions on Geoscience and Remote Sensing 46:7, 2112-2125 Online publication date: 1-Aug-2008. CrossRef I. Wai-Hung Tsang, A. Kocsor, J.T.-Y. Kwok. (2008) Large-Scale Maximum Margin Discriminant Analysis Using Core Vector Machines. IEEE Transactions on Neural Networks 19:4, 610-624 Online publication date: 1-May-2008. CrossRef O.C. Hamsici, A.M. Martinez. (2008) Bayes Optimality in Linear Discriminant Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 30:4, 647-657 Online publication date: 1-May-2008. CrossRef Haixian Wang, Sibao Chen, Zilan Hu, Wenming Zheng. (2008) Locality-Preserved Maximum Information Projection. IEEE Transactions on Neural Networks 19:4, 571-585 Online publication date: 1-May-2008. CrossRef Sang-Woon Kim, B.J. Oommen. (2008) On Using Prototype Reduction Schemes to Optimize Kernel-Based Fisher Discriminant Analysis. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) 38:2, 564-570 Online publication date: 1-May-2008. CrossRef Kar-Ann Toh, How-Lung Eng. (2008) Between Classification-Error Approximation and Weighted Least-Squares Learning. IEEE Transactions on Pattern Analysis and Machine Intelligence 30:4, 658-669 Online publication date: 1-May-2008. CrossRef Vitomir truc, France Miheli , Nikola Pave ić. (2008) Face authentication using a hybrid approach. Journal of Electronic Imaging 17:1, 011003 Online publication date: 1-Feb-2008. CrossRef Gwo-Her Lee, Tzuen Wuu Hsieh, Jinshiuh Taur, Chin-Wang Tao. (2008) A posteriori multiresolution-based kernel orthogonal subspace technique for supervised texture segmentation. Optical Engineering 47:7, 077006 Online publication date: 1-Feb-2008. CrossRef Manli Zhu, Aleix M. Martinez. (2008) Pruning Noisy Bases in Discriminant Analysis. IEEE Transactions on Neural Networks 19:1, 148-157 Online publication date: 1-Feb-2008. CrossRef Baochang Zhang, Zongli Wang, Bineng Zhong. (2008) Kernel Learning of Histogram of Local Gabor Phase Patterns for Face Recognition. EURASIP Journal on Advances in Signal Processing 2008, 1-9 Online publication date: 1-Feb-2008. CrossRef Xuelian Yu, Xuegang Wang, Benyong Liu. (2007) A Direct Kernel Uncorrelated Discriminant Analysis Algorithm. IEEE Signal Processing Letters 14:10, 742-745 Online publication date: 1-Nov-2007. CrossRef Shu Yang, Shuicheng Yan, Chao Zhang, Xiaoou Tang. (2007) Bilinear Analysis for Kernel Selection and Nonlinear Feature Extraction. IEEE Transactions on Neural Networks 18:5, 1442-1452 Online publication date: 1-Oct-2007. CrossRef Tomoharu Iwata, Kazumi Saito, Naonori Ueda, Sean Stromsten, Thomas L. Griffiths, Joshua B. Tenenbaum. (2007) Parametric Embedding for Class Visualization. Neural Computation 19:9, 2536-2556 Online publication date: 1-Sep-2007. Abstract
| PDF (1365 KB)
| PDF Plus (1093 KB) H.. Cevikalp, M.. Neamtu, A.. Barkana. (2007) The Kernel Common Vector Method: A Novel Nonlinear Subspace Classifier for Pattern Recognition. IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) 37:4, 937-951 Online publication date: 1-Sep-2007. CrossRef Jian Huang, P.C. Yuen, Wen-Sheng Chen, Jian Huang Lai. (2007) Choosing Parameters of Kernel Subspace LDA for Recognition of Face Images Under Pose and Illumination Variations. IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) 37:4, 847-862 Online publication date: 1-Sep-2007. CrossRef Paul Honeine, Cdric Richard, Patrick Flandrin. (2007) Time-Frequency Learning Machines. IEEE Transactions on Signal Processing 55:7, 3930-3936 Online publication date: 1-Aug-2007. CrossRef Yi-Hung Liu, Han-Pang Huang, Chang-Hsin Weng. (2007) Recognition of Electromyographic Signals Using Cascaded Kernel Learning Machine. IEEE/ASME Transactions on Mechatronics 12:3, 253-264 Online publication date: 1-Jul-2007. CrossRef Jian Yang, David Zhang, Jing-yu Yang, Ben Niu. (2007) Globally Maximizing, Locally Minimizing: Unsupervised Discriminant Projection with Applications to Face and Palm Biometrics. IEEE Transactions on Pattern Analysis and Machine Intelligence 29:4, 650-664 Online publication date: 1-May-2007. CrossRef Shuicheng Yan, Yuxiao Hu, Dong Xu, Hong-Jiang Zhang, Benyu Zhang, Qiansheng Cheng. (2007) Nonlinear Discriminant Analysis on Embedded Manifold. IEEE Transactions on Circuits and Systems for Video Technology 17:4, 468-477 Online publication date: 1-May-2007. CrossRef Heesung Kwon, Nasser M. Nasrabadi. (2007) Kernel Spectral Matched Filter for Hyperspectral Imagery. International Journal of Computer Vision 71:2, 127-141 Online publication date: 1-Mar-2007. CrossRef Sebastiano B. Serpico, Gabriele Moser. (2007) Extraction of Spectral Channels From Hyperspectral Images for Classification Purposes. IEEE Transactions on Geoscience and Remote Sensing 45:2, 484-495 Online publication date: 1-Mar-2007. CrossRef Dimitrios I. Domboulas, Monique P. Fargues, Gamani Karunasiri. (2007) Uncooled infrared-imaging face recognition using kernel-based generalized discriminant analysis. Optical Engineering 46:8, 087201 Online publication date: 1-Feb-2007. CrossRef Heesung Kwon, Nasser M. Nasrabadi. (2007) A Comparative Analysis of Kernel Subspace Target Detectors for Hyperspectral Imagery. EURASIP Journal on Advances in Signal Processing 2007, 1-14 Online publication date: 1-Feb-2007. CrossRef Yi-Hung Liu, Yen-Ting Chen. (2007) Face Recognition Using Total Margin-Based Adaptive Fuzzy Support Vector Machines. IEEE Transactions on Neural Networks 18:1, 178-192 Online publication date: 1-Feb-2007. CrossRef Hakan Cevikalp, Marian Neamtu, Mitch Wilkes. (2006) Discriminative Common Vector Method With Kernels. IEEE Transactions on Neural Networks 17:6, 1550-1565 Online publication date: 1-Dec-2006. CrossRef T.-K. Kim, J. Kittler. (2006) Design and Fusion of Pose-Invariant Face-Identification Experts. IEEE Transactions on Circuits and Systems for Video Technology 16:9, 1096-1106 Online publication date: 1-Oct-2006. CrossRef Xudong Xie, Kin-Man Lam. (2006) Gabor-based kernel PCA with doubly nonlinear mapping for face recognition with a single face image. IEEE Transactions on Image Processing 15:9, 2481-2492 Online publication date: 1-Oct-2006. CrossRef Weihua Li, Tie-lin Shi, Shu-zi Yang. (2006) An approach for mechanical fault classification based on generalized discriminant analysis. Frontiers of Mechanical Engineering in China 1:3, 292-298 Online publication date: 1-Oct-2006. CrossRef Q. Liu, X. Tang, H. Lu, S. Ma. (2006) Face Recognition Using Kernel Scatter-Difference-Based Discriminant Analysis. IEEE Transactions on Neural Networks 17:4, 1081-1085 Online publication date: 1-Aug-2006. CrossRef S.K. Zhou, R. Chellappa. (2006) From sample similarity to ensemble similarity: probabilistic distance measures in reproducing kernel Hilbert space. IEEE Transactions on Pattern Analysis and Machine Intelligence 28:6, 917-929 Online publication date: 1-Jul-2006. CrossRef Chengjun Liu. (2006) Capitalize on dimensionality increasing techniques for improving face recognition grand challenge performance. IEEE Transactions on Pattern Analysis and Machine Intelligence 28:5, 725-737 Online publication date: 1-Jun-2006. CrossRef H. Kwon, N.M. Nasrabadi. (2006) Kernel Adaptive Subspace Detector for Hyperspectral Imagery. IEEE Geoscience and Remote Sensing Letters 3:2, 271-275 Online publication date: 1-May-2006. CrossRef Wenming Zheng. (2006) Class-Incremental Generalized Discriminant Analysis. Neural Computation 18:4, 979-1006 Online publication date: 1-Apr-2006. Abstract
| PDF (1607 KB)
| PDF Plus (1616 KB) Heesung Kwon, N.M. Nasrabadi. (2006) Kernel matched subspace detectors for hyperspectral target detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 28:2, 178-194 Online publication date: 1-Mar-2006. CrossRef W. Zheng, X. Zhou, C. Zou, L. Zhao. (2006) Facial Expression Recognition Using Kernel Canonical Correlation Analysis (KCCA). IEEE Transactions on Neural Networks 17:1, 233-238 Online publication date: 1-Feb-2006. CrossRef Mantao Xu, Xiaolin Wu, P. Franti. (2006) Context quantization by kernel Fisher discriminant. IEEE Transactions on Image Processing 15:1, 169-177 Online publication date: 1-Feb-2006. CrossRef J. Lu, K.N. Plataniotis, A.N. Venetsanopoulos, S.Z. Li. (2006) Ensemble-based discriminant learning with boosting for face recognition. IEEE Transactions on Neural Networks 17:1, 166-178 Online publication date: 1-Feb-2006. CrossRef Linlin Shen, Li Bai. (2006) Information Theory for Gabor Feature Selection for Face Recognition. EURASIP Journal on Advances in Signal Processing 2006, 1-12 Online publication date: 1-Feb-2006. CrossRef Ibtissam Constantin, Cdric Richard, Rgis Lengelle, Laurent Soufflet. (2006) <![CDATA[Nonlinear Regularized Wiener Filtering With Kernels: App]]><![CDATA[lication in Denoising MEG Data Corrupted by ECG]]>. IEEE Transactions on Signal Processing 54:12, 4796 CrossRef Heesung Kwon, N.M. Nasrabadi. (2006) Kernel orthogonal subspace projection for hyperspectral signal classification. IEEE Transactions on Geoscience and Remote Sensing 43:12, 2952-2962 Online publication date: 1-Jan-2006. CrossRef W.-S. Chen, P.C. Yuen, J. Huang, D.-Q. Dai. (2005) Kernel Machine-Based One-Parameter Regularized Fisher Discriminant Method for Face Recognition. IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) 35:4, 659-669 Online publication date: 1-Sep-2005. CrossRef P. Zhang, J. Peng, C. Domeniconi. (2005) Kernel Pooled Local Subspaces for Classification. IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) 35:3, 489-502 Online publication date: 1-Jul-2005. CrossRef H. Zhang, W. Huang, Z. Huang, B. Zhang. (2005) A Kernel Autoassociator Approach to Pattern Classification. IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) 35:3, 593-606 Online publication date: 1-Jul-2005. CrossRef Jieping Ye, Qi Li. (2005) A two-stage linear discriminant analysis via QR-decomposition. IEEE Transactions on Pattern Analysis and Machine Intelligence 27:6, 929-941 Online publication date: 1-Jul-2005. CrossRef H. Xiong, M.N.S. Swamy, M.O. Ahmad. (2005) Optimizing the Kernel in the Empirical Feature Space. IEEE Transactions on Neural Networks 16:2, 460-474 Online publication date: 1-Apr-2005. CrossRef Tae-Kyun Kim, J. Kittler. (2005) Locally linear discriminant analysis for multimodally distributed classes for face recognition with a single model image. IEEE Transactions on Pattern Analysis and Machine Intelligence 27:3, 318-327 Online publication date: 1-Apr-2005. CrossRef Heesung Kwon, N.M. Nasrabadi. (2005) Kernel RX-algorithm: a nonlinear anomaly detector for hyperspectral imagery. IEEE Transactions on Geoscience and Remote Sensing 43:2, 388-397 Online publication date: 1-Mar-2005. CrossRef Jian Yang, A.F. Frangi, Jing-Yu Yang, David Zhang, Zhong Jin. (2005) KPCA plus LDA: a complete kernel Fisher discriminant framework for feature extraction and recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 27:2, 230-244 Online publication date: 1-Mar-2005. CrossRef W. Zheng, L. Zhao, C. Zou. (2005) Foley–Sammon Optimal Discriminant Vectors Using Kernel Approach. IEEE Transactions on Neural Networks 16:1, 1-9 Online publication date: 1-Feb-2005. CrossRef X.S. Zhou, A. Garg, T.S. Huang. (2005) Nonlinear variants of biased discriminants for interactive image retrieval. IEE Proceedings - Vision, Image, and Signal Processing 152:6, 927 Online publication date: 1-Feb-2005. CrossRef Cheong Hee Park, Haesun Park. (2005) Nonlinear Discriminant Analysis Using Kernel Functions and the Generalized Singular Value Decomposition. SIAM Journal on Matrix Analysis and Applications 27:1, 87 Online publication date: 1-Feb-2005. CrossRef A. Kocsor, L. Toth. (2004) Kernel-Based Feature Extraction with a Speech Technology Application. IEEE Transactions on Signal Processing 52:8, 2250-2263 Online publication date: 1-Sep-2004. CrossRef Wenming Zheng, Li Zhao, Cairong Zou. (2004) A Modified Algorithm for Generalized Discriminant Analysis. Neural Computation 16:6, 1283-1297 Online publication date: 1-Jun-2004. Abstract
| PDF (249 KB)
| PDF Plus (275 KB) Z. Liang, P. Shi. (2004) Efficient algorithm for kernel discriminant analysis. Electronics Letters 40:25, 1579 Online publication date: 1-Feb-2004. CrossRef Q. Liu, H. Lu, S. Ma. (2004) Improving Kernel Fisher Discriminant Analysis for Face Recognition. IEEE Transactions on Circuits and Systems for Video Technology 14:1, 42-49 Online publication date: 1-Feb-2004. CrossRef Julian Mintseris, Zhiping Weng. (2003) Atomic contact vectors in protein-protein recognition. Proteins: Structure, Function, and Genetics 53:3, 629-639 Online publication date: 15-Dec-2003. CrossRef QingShan Liu, Rui Huang, HanQing Lu, SongDe Ma. (2003) Kernel-based nonlinear discriminant analysis for face recognition. Journal of Computer Science and Technology 18:6, 788-795 Online publication date: 1-Dec-2003. CrossRef Junshui Ma, J.L. Sancho-Gomez, S.C. Ahalt. (2003) Nonlinear multiclass discriminant analysis. IEEE Signal Processing Letters 10:7, 196-199 Online publication date: 1-Aug-2003. CrossRef S. Mika, G. Ratsch, J. Weston, B. Scholkopf, A. Smola, K. Muller. (2003) Constructing descriptive and discriminative nonlinear features: rayleigh coefficients in kernel feature spaces. IEEE Transactions on Pattern Analysis and Machine Intelligence 25:5, 623-628 Online publication date: 1-Jun-2003. CrossRef J.A.K. Suykens, T. Van Gestel, J. Vandewalle, B. De Moor. (2003) A support vector machine formulation to pca analysis and its kernel version. IEEE Transactions on Neural Networks 14:2, 447-450 Online publication date: 1-Apr-2003. CrossRef D. Martinez, A. Bray. (2003) Nonlinear blind source separation using kernels. IEEE Transactions on Neural Networks 14:1, 228-235 Online publication date: 1-Feb-2003. CrossRef Juwei Lu, K.N. Plataniotis, A.N. Venetsanopoulos. (2003) Face recognition using kernel direct discriminant analysis algorithms. IEEE Transactions on Neural Networks 14:1, 117-126 Online publication date: 1-Feb-2003. CrossRef T. Van Gestel, J. A. K. Suykens, G. Lanckriet, A. Lambrechts, B. De Moor, J. Vandewalle. (2002) Bayesian Framework for Least-Squares Support Vector Machine Classifiers, Gaussian Processes, and Kernel Fisher Discriminant Analysis. Neural Computation 14:5, 1115-1147 Online publication date: 1-May-2002. Abstract
| PDF (406 KB)
| PDF Plus (435 KB) K.-R. Muller, S. Mika, G. Ratsch, K. Tsuda, B. Scholkopf. (2001) An introduction to kernel-based learning algorithms. IEEE Transactions on Neural Networks 12:2, 181-201 Online publication date: 1-Apr-2001. CrossRef
|