Activate Activate Activate
contact  
Hello. Sign in to personalize your visit. New user? Register now.  

In
By author

Monthly
288 pp. per issue, 6 x 9,
illustrated
Founded: 1989
ISSN 0899-7667
E-ISSN 1530-888X
2008 ISI Impact Factor: 2.378

Neural Computation

October 2000, Vol. 12, No. 10, Pages 2385-2404
Posted Online March 13, 2006.
(doi:10.1162/089976600300014980)
© 2000 Massachusetts Institute of Technology
Generalized Discriminant Analysis Using a Kernel Approach

G. Baudat

Mars Electronics International, CH-1211 Geneva, Switzerland

F. Anouar

INRA-SNES, Institut National de Recherche en Agronomie, 49071 Beaucouzé, France

PDF (1,031.65 KB) PDF Plus (324.351 KB)

We present a new method that we call generalized discriminant analysis (GDA) to deal with nonlinear discriminant analysis using kernel function operator. The underlying theory is close to the support vector machines (SVM) insofar as the GDA method provides a mapping of the input vectors into high-dimensional feature space. In the transformed space, linear properties make it easy to extend and generalize the classical linear discriminant analysis (LDA) to nonlinear discriminant analysis. The formulation is expressed as an eigenvalue problem resolution. Using a different kernel, one can cover a wide class of nonlinearities. For both simulated data and alternate kernels, we give classification results, as well as the shape of the decision function. The results are confirmed using real data to perform seed classification.

Cited by

Robert F. Harrison, Kitsuchart Pasupa. (2010) A simple iterative algorithm for parsimonious binary kernel Fisher discrimination. Pattern Analysis and Applications 13:1, 15-22
Online publication date: 1-Mar-2010.
CrossRef
Dake Zhou, Zhenmin Tang. (2010) Kernel-based improved discriminant analysis and its application to face recognition. Soft Computing 14:2, 103-111
Online publication date: 1-Feb-2010.
CrossRef
Xiao-Zhang Liu, Wen-Sheng Chen, P.C. Yuen, Guo-Can Feng. (2010) Learning Kernel in Kernel-Based LDA for Face Recognition Under Illumination Variations. IEEE Signal Processing Letters 16:12, 1019-1022
Online publication date: 1-Jan-2010.
CrossRef
Jun-Bao Li, Jeng-Shyang Pan, Zhe-Ming Lu. (2009) Kernel optimization-based discriminant analysis for face recognition. Neural Computing and Applications 18:6, 603-612
Online publication date: 1-Oct-2009.
CrossRef
U. Ozertem, D. Erdogmus. (2009) RKHS Bayes Discriminant: A Subspace Constrained Nonlinear Feature Projection for Signal Detection. IEEE Transactions on Neural Networks 20:7, 1195-1203
Online publication date: 1-Aug-2009.
CrossRef
S. Prasad, L.M. Bruce. (2009) Information Fusion in Kernel-Induced Spaces for Robust Subpixel Hyperspectral ATR. IEEE Geoscience and Remote Sensing Letters 6:3, 572-576
Online publication date: 1-Aug-2009.
CrossRef
Ming-Guang Shi, Jun-Feng Xia, Xue-Ling Li, De-Shuang Huang. (2009) Predicting protein–protein interactions from sequence using correlation coefficient and high-quality interaction dataset. Amino Acids
Online publication date: 24-May-2009.
CrossRef
Khalid Chougdali, Mohamed Jedra, Nouredine Zahid. (2009) Kernel relevance weighted discriminant analysis for face recognition. Pattern Analysis and Applications
Online publication date: 9-May-2009.
CrossRef
Bor-Chen Kuo, Cheng-Hsuan Li, Jinn-Min Yang. (2009) Kernel Nonparametric Weighted Feature Extraction for Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing 47:4, 1139-1155
Online publication date: 1-May-2009.
CrossRef
W. Wu, M.O. Ahmad, S. Samadi. (2009) Discriminant analysis based on modified generalised singular value decomposition and its numerical error analysis. IET Computer Vision 3:3, 159
Online publication date: 1-Feb-2009.
CrossRef
Eimad E. Abusham, E. K. Wong. (2009) Locally Linear Discriminate Embedding for Face Recognition. Discrete Dynamics in Nature and Society 2009, 1-9
Online publication date: 1-Feb-2009.
CrossRef
Hong-yan WU, Dao-ping HUANG. (2009) <![CDATA[Improving kernel fisher discriminant analysis for fault diagnosis in chemical process]]>. Journal of Computer Applications 29:2, 595
CrossRef
Jing Peng, Peng Zhang, N. Riedel. (2009) Discriminant Learning Analysis. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) 38:6, 1614-1625
Online publication date: 1-Jan-2009.
CrossRef
Zi-qiang WANG, Xu QIAN. (2009) <![CDATA[Document classification algorithm based on KDA and SVM]]>. Journal of Computer Applications 29:2, 416
CrossRef
Xiao-zhang LIU, Guo-can FENG. (2009) <![CDATA[Multiple kernel discriminant analysis with optimized weight]]> : Multiple kernel discriminant analysis with optimized weight. Journal of Computer Applications 29:9, 2473
CrossRef
Yanwei Pang, Yuan Yuan, Xuelong Li. (2009) Effective Feature Extraction in High-Dimensional Space. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) 38:6, 1652-1656
Online publication date: 1-Jan-2009.
CrossRef
Lei Wang, Kap Luk Chan, Ping Xue, Luping Zhou. (2009) A Kernel-Induced Space Selection Approach to Model Selection in KLDA. IEEE Transactions on Neural Networks 19:12, 2116-2131
Online publication date: 1-Jan-2009.
CrossRef
Xiao-yan ZHOU. (2008) Novel face recognition method based on KPCA plus KDA. Journal of Computer Applications 28:5, 1263-1266
Online publication date: 20-Nov-2008.
CrossRef
Shuiwang Ji, Jieping Ye. (2008) Kernel Uncorrelated and Regularized Discriminant Analysis: A Theoretical and Computational Study. IEEE Transactions on Knowledge and Data Engineering 20:10, 1311-1321
Online publication date: 1-Nov-2008.
CrossRef
Jaewon Sung, Daijin Kim. (2008) Pose-Robust Facial Expression Recognition Using View-Based 2D $+$ 3D AAM. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans 38:4, 852-866
Online publication date: 1-Aug-2008.
CrossRef
Yanwei Pang, Yuan Yuan, Xuelong Li. (2008) Gabor-Based Region Covariance Matrices for Face Recognition. IEEE Transactions on Circuits and Systems for Video Technology 18:7, 989-993
Online publication date: 1-Aug-2008.
CrossRef
L. Samaniego, A. Bardossy, K. Schulz. (2008) Supervised Classification of Remotely Sensed Imagery Using a Modified $k$-NN Technique. IEEE Transactions on Geoscience and Remote Sensing 46:7, 2112-2125
Online publication date: 1-Aug-2008.
CrossRef
I. Wai-Hung Tsang, A. Kocsor, J.T.-Y. Kwok. (2008) Large-Scale Maximum Margin Discriminant Analysis Using Core Vector Machines. IEEE Transactions on Neural Networks 19:4, 610-624
Online publication date: 1-May-2008.
CrossRef
O.C. Hamsici, A.M. Martinez. (2008) Bayes Optimality in Linear Discriminant Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 30:4, 647-657
Online publication date: 1-May-2008.
CrossRef
Haixian Wang, Sibao Chen, Zilan Hu, Wenming Zheng. (2008) Locality-Preserved Maximum Information Projection. IEEE Transactions on Neural Networks 19:4, 571-585
Online publication date: 1-May-2008.
CrossRef
Sang-Woon Kim, B.J. Oommen. (2008) On Using Prototype Reduction Schemes to Optimize Kernel-Based Fisher Discriminant Analysis. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) 38:2, 564-570
Online publication date: 1-May-2008.
CrossRef
Kar-Ann Toh, How-Lung Eng. (2008) Between Classification-Error Approximation and Weighted Least-Squares Learning. IEEE Transactions on Pattern Analysis and Machine Intelligence 30:4, 658-669
Online publication date: 1-May-2008.
CrossRef
Vitomir truc, France Miheli, Nikola Paveić. (2008) Face authentication using a hybrid approach. Journal of Electronic Imaging 17:1, 011003
Online publication date: 1-Feb-2008.
CrossRef
Gwo-Her Lee, Tzuen Wuu Hsieh, Jinshiuh Taur, Chin-Wang Tao. (2008) A posteriori multiresolution-based kernel orthogonal subspace technique for supervised texture segmentation. Optical Engineering 47:7, 077006
Online publication date: 1-Feb-2008.
CrossRef
Manli Zhu, Aleix M. Martinez. (2008) Pruning Noisy Bases in Discriminant Analysis. IEEE Transactions on Neural Networks 19:1, 148-157
Online publication date: 1-Feb-2008.
CrossRef
Baochang Zhang, Zongli Wang, Bineng Zhong. (2008) Kernel Learning of Histogram of Local Gabor Phase Patterns for Face Recognition. EURASIP Journal on Advances in Signal Processing 2008, 1-9
Online publication date: 1-Feb-2008.
CrossRef
Xuelian Yu, Xuegang Wang, Benyong Liu. (2007) A Direct Kernel Uncorrelated Discriminant Analysis Algorithm. IEEE Signal Processing Letters 14:10, 742-745
Online publication date: 1-Nov-2007.
CrossRef
Shu Yang, Shuicheng Yan, Chao Zhang, Xiaoou Tang. (2007) Bilinear Analysis for Kernel Selection and Nonlinear Feature Extraction. IEEE Transactions on Neural Networks 18:5, 1442-1452
Online publication date: 1-Oct-2007.
CrossRef
Tomoharu Iwata, Kazumi Saito, Naonori Ueda, Sean Stromsten, Thomas L. Griffiths, Joshua B. Tenenbaum. (2007) Parametric Embedding for Class Visualization. Neural Computation 19:9, 2536-2556
Online publication date: 1-Sep-2007.
Abstract | PDF (1365 KB) | PDF Plus (1093 KB) 
H.. Cevikalp, M.. Neamtu, A.. Barkana. (2007) The Kernel Common Vector Method: A Novel Nonlinear Subspace Classifier for Pattern Recognition. IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) 37:4, 937-951
Online publication date: 1-Sep-2007.
CrossRef
Jian Huang, P.C. Yuen, Wen-Sheng Chen, Jian Huang Lai. (2007) Choosing Parameters of Kernel Subspace LDA for Recognition of Face Images Under Pose and Illumination Variations. IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) 37:4, 847-862
Online publication date: 1-Sep-2007.
CrossRef
Paul Honeine, Cdric Richard, Patrick Flandrin. (2007) Time-Frequency Learning Machines. IEEE Transactions on Signal Processing 55:7, 3930-3936
Online publication date: 1-Aug-2007.
CrossRef
Yi-Hung Liu, Han-Pang Huang, Chang-Hsin Weng. (2007) Recognition of Electromyographic Signals Using Cascaded Kernel Learning Machine. IEEE/ASME Transactions on Mechatronics 12:3, 253-264
Online publication date: 1-Jul-2007.
CrossRef
Jian Yang, David Zhang, Jing-yu Yang, Ben Niu. (2007) Globally Maximizing, Locally Minimizing: Unsupervised Discriminant Projection with Applications to Face and Palm Biometrics. IEEE Transactions on Pattern Analysis and Machine Intelligence 29:4, 650-664
Online publication date: 1-May-2007.
CrossRef
Shuicheng Yan, Yuxiao Hu, Dong Xu, Hong-Jiang Zhang, Benyu Zhang, Qiansheng Cheng. (2007) Nonlinear Discriminant Analysis on Embedded Manifold. IEEE Transactions on Circuits and Systems for Video Technology 17:4, 468-477
Online publication date: 1-May-2007.
CrossRef
Heesung Kwon, Nasser M. Nasrabadi. (2007) Kernel Spectral Matched Filter for Hyperspectral Imagery. International Journal of Computer Vision 71:2, 127-141
Online publication date: 1-Mar-2007.
CrossRef
Sebastiano B. Serpico, Gabriele Moser. (2007) Extraction of Spectral Channels From Hyperspectral Images for Classification Purposes. IEEE Transactions on Geoscience and Remote Sensing 45:2, 484-495
Online publication date: 1-Mar-2007.
CrossRef
Dimitrios I. Domboulas, Monique P. Fargues, Gamani Karunasiri. (2007) Uncooled infrared-imaging face recognition using kernel-based generalized discriminant analysis. Optical Engineering 46:8, 087201
Online publication date: 1-Feb-2007.
CrossRef
Heesung Kwon, Nasser M. Nasrabadi. (2007) A Comparative Analysis of Kernel Subspace Target Detectors for Hyperspectral Imagery. EURASIP Journal on Advances in Signal Processing 2007, 1-14
Online publication date: 1-Feb-2007.
CrossRef
Yi-Hung Liu, Yen-Ting Chen. (2007) Face Recognition Using Total Margin-Based Adaptive Fuzzy Support Vector Machines. IEEE Transactions on Neural Networks 18:1, 178-192
Online publication date: 1-Feb-2007.
CrossRef
Hakan Cevikalp, Marian Neamtu, Mitch Wilkes. (2006) Discriminative Common Vector Method With Kernels. IEEE Transactions on Neural Networks 17:6, 1550-1565
Online publication date: 1-Dec-2006.
CrossRef
T.-K. Kim, J. Kittler. (2006) Design and Fusion of Pose-Invariant Face-Identification Experts. IEEE Transactions on Circuits and Systems for Video Technology 16:9, 1096-1106
Online publication date: 1-Oct-2006.
CrossRef
Xudong Xie, Kin-Man Lam. (2006) Gabor-based kernel PCA with doubly nonlinear mapping for face recognition with a single face image. IEEE Transactions on Image Processing 15:9, 2481-2492
Online publication date: 1-Oct-2006.
CrossRef
Weihua Li, Tie-lin Shi, Shu-zi Yang. (2006) An approach for mechanical fault classification based on generalized discriminant analysis. Frontiers of Mechanical Engineering in China 1:3, 292-298
Online publication date: 1-Oct-2006.
CrossRef
Q. Liu, X. Tang, H. Lu, S. Ma. (2006) Face Recognition Using Kernel Scatter-Difference-Based Discriminant Analysis. IEEE Transactions on Neural Networks 17:4, 1081-1085
Online publication date: 1-Aug-2006.
CrossRef
S.K. Zhou, R. Chellappa. (2006) From sample similarity to ensemble similarity: probabilistic distance measures in reproducing kernel Hilbert space. IEEE Transactions on Pattern Analysis and Machine Intelligence 28:6, 917-929
Online publication date: 1-Jul-2006.
CrossRef
Chengjun Liu. (2006) Capitalize on dimensionality increasing techniques for improving face recognition grand challenge performance. IEEE Transactions on Pattern Analysis and Machine Intelligence 28:5, 725-737
Online publication date: 1-Jun-2006.
CrossRef
H. Kwon, N.M. Nasrabadi. (2006) Kernel Adaptive Subspace Detector for Hyperspectral Imagery. IEEE Geoscience and Remote Sensing Letters 3:2, 271-275
Online publication date: 1-May-2006.
CrossRef
Wenming Zheng. (2006) Class-Incremental Generalized Discriminant Analysis. Neural Computation 18:4, 979-1006
Online publication date: 1-Apr-2006.
Abstract | PDF (1607 KB) | PDF Plus (1616 KB) 
Heesung Kwon, N.M. Nasrabadi. (2006) Kernel matched subspace detectors for hyperspectral target detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 28:2, 178-194
Online publication date: 1-Mar-2006.
CrossRef
W. Zheng, X. Zhou, C. Zou, L. Zhao. (2006) Facial Expression Recognition Using Kernel Canonical Correlation Analysis (KCCA). IEEE Transactions on Neural Networks 17:1, 233-238
Online publication date: 1-Feb-2006.
CrossRef
Mantao Xu, Xiaolin Wu, P. Franti. (2006) Context quantization by kernel Fisher discriminant. IEEE Transactions on Image Processing 15:1, 169-177
Online publication date: 1-Feb-2006.
CrossRef
J. Lu, K.N. Plataniotis, A.N. Venetsanopoulos, S.Z. Li. (2006) Ensemble-based discriminant learning with boosting for face recognition. IEEE Transactions on Neural Networks 17:1, 166-178
Online publication date: 1-Feb-2006.
CrossRef
Linlin Shen, Li Bai. (2006) Information Theory for Gabor Feature Selection for Face Recognition. EURASIP Journal on Advances in Signal Processing 2006, 1-12
Online publication date: 1-Feb-2006.
CrossRef
Ibtissam Constantin, Cdric Richard, Rgis Lengelle, Laurent Soufflet. (2006) <![CDATA[Nonlinear Regularized Wiener Filtering With Kernels: App]]><![CDATA[lication in Denoising MEG Data Corrupted by ECG]]>. IEEE Transactions on Signal Processing 54:12, 4796
CrossRef
Heesung Kwon, N.M. Nasrabadi. (2006) Kernel orthogonal subspace projection for hyperspectral signal classification. IEEE Transactions on Geoscience and Remote Sensing 43:12, 2952-2962
Online publication date: 1-Jan-2006.
CrossRef
W.-S. Chen, P.C. Yuen, J. Huang, D.-Q. Dai. (2005) Kernel Machine-Based One-Parameter Regularized Fisher Discriminant Method for Face Recognition. IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) 35:4, 659-669
Online publication date: 1-Sep-2005.
CrossRef
P. Zhang, J. Peng, C. Domeniconi. (2005) Kernel Pooled Local Subspaces for Classification. IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) 35:3, 489-502
Online publication date: 1-Jul-2005.
CrossRef
H. Zhang, W. Huang, Z. Huang, B. Zhang. (2005) A Kernel Autoassociator Approach to Pattern Classification. IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) 35:3, 593-606
Online publication date: 1-Jul-2005.
CrossRef
Jieping Ye, Qi Li. (2005) A two-stage linear discriminant analysis via QR-decomposition. IEEE Transactions on Pattern Analysis and Machine Intelligence 27:6, 929-941
Online publication date: 1-Jul-2005.
CrossRef
H. Xiong, M.N.S. Swamy, M.O. Ahmad. (2005) Optimizing the Kernel in the Empirical Feature Space. IEEE Transactions on Neural Networks 16:2, 460-474
Online publication date: 1-Apr-2005.
CrossRef
Tae-Kyun Kim, J. Kittler. (2005) Locally linear discriminant analysis for multimodally distributed classes for face recognition with a single model image. IEEE Transactions on Pattern Analysis and Machine Intelligence 27:3, 318-327
Online publication date: 1-Apr-2005.
CrossRef
Heesung Kwon, N.M. Nasrabadi. (2005) Kernel RX-algorithm: a nonlinear anomaly detector for hyperspectral imagery. IEEE Transactions on Geoscience and Remote Sensing 43:2, 388-397
Online publication date: 1-Mar-2005.
CrossRef
Jian Yang, A.F. Frangi, Jing-Yu Yang, David Zhang, Zhong Jin. (2005) KPCA plus LDA: a complete kernel Fisher discriminant framework for feature extraction and recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 27:2, 230-244
Online publication date: 1-Mar-2005.
CrossRef
W. Zheng, L. Zhao, C. Zou. (2005) Foley&#8211;Sammon Optimal Discriminant Vectors Using Kernel Approach. IEEE Transactions on Neural Networks 16:1, 1-9
Online publication date: 1-Feb-2005.
CrossRef
X.S. Zhou, A. Garg, T.S. Huang. (2005) Nonlinear variants of biased discriminants for interactive image retrieval. IEE Proceedings - Vision, Image, and Signal Processing 152:6, 927
Online publication date: 1-Feb-2005.
CrossRef
Cheong Hee Park, Haesun Park. (2005) Nonlinear Discriminant Analysis Using Kernel Functions and the Generalized Singular Value Decomposition. SIAM Journal on Matrix Analysis and Applications 27:1, 87
Online publication date: 1-Feb-2005.
CrossRef
A. Kocsor, L. Toth. (2004) Kernel-Based Feature Extraction with a Speech Technology Application. IEEE Transactions on Signal Processing 52:8, 2250-2263
Online publication date: 1-Sep-2004.
CrossRef
Wenming Zheng, Li Zhao, Cairong Zou. (2004) A Modified Algorithm for Generalized Discriminant Analysis. Neural Computation 16:6, 1283-1297
Online publication date: 1-Jun-2004.
Abstract | PDF (249 KB) | PDF Plus (275 KB) 
Z. Liang, P. Shi. (2004) Efficient algorithm for kernel discriminant analysis. Electronics Letters 40:25, 1579
Online publication date: 1-Feb-2004.
CrossRef
Q. Liu, H. Lu, S. Ma. (2004) Improving Kernel Fisher Discriminant Analysis for Face Recognition. IEEE Transactions on Circuits and Systems for Video Technology 14:1, 42-49
Online publication date: 1-Feb-2004.
CrossRef
Julian Mintseris, Zhiping Weng. (2003) Atomic contact vectors in protein-protein recognition. Proteins: Structure, Function, and Genetics 53:3, 629-639
Online publication date: 15-Dec-2003.
CrossRef
QingShan Liu, Rui Huang, HanQing Lu, SongDe Ma. (2003) Kernel-based nonlinear discriminant analysis for face recognition. Journal of Computer Science and Technology 18:6, 788-795
Online publication date: 1-Dec-2003.
CrossRef
Junshui Ma, J.L. Sancho-Gomez, S.C. Ahalt. (2003) Nonlinear multiclass discriminant analysis. IEEE Signal Processing Letters 10:7, 196-199
Online publication date: 1-Aug-2003.
CrossRef
S. Mika, G. Ratsch, J. Weston, B. Scholkopf, A. Smola, K. Muller. (2003) Constructing descriptive and discriminative nonlinear features: rayleigh coefficients in kernel feature spaces. IEEE Transactions on Pattern Analysis and Machine Intelligence 25:5, 623-628
Online publication date: 1-Jun-2003.
CrossRef
J.A.K. Suykens, T. Van Gestel, J. Vandewalle, B. De Moor. (2003) A support vector machine formulation to pca analysis and its kernel version. IEEE Transactions on Neural Networks 14:2, 447-450
Online publication date: 1-Apr-2003.
CrossRef
D. Martinez, A. Bray. (2003) Nonlinear blind source separation using kernels. IEEE Transactions on Neural Networks 14:1, 228-235
Online publication date: 1-Feb-2003.
CrossRef
Juwei Lu, K.N. Plataniotis, A.N. Venetsanopoulos. (2003) Face recognition using kernel direct discriminant analysis algorithms. IEEE Transactions on Neural Networks 14:1, 117-126
Online publication date: 1-Feb-2003.
CrossRef
T. Van Gestel, J. A. K. Suykens, G. Lanckriet, A. Lambrechts, B. De Moor, J. Vandewalle. (2002) Bayesian Framework for Least-Squares Support Vector Machine Classifiers, Gaussian Processes, and Kernel Fisher Discriminant Analysis. Neural Computation 14:5, 1115-1147
Online publication date: 1-May-2002.
Abstract | PDF (406 KB) | PDF Plus (435 KB) 
K.-R. Muller, S. Mika, G. Ratsch, K. Tsuda, B. Scholkopf. (2001) An introduction to kernel-based learning algorithms. IEEE Transactions on Neural Networks 12:2, 181-201
Online publication date: 1-Apr-2001.
CrossRef
Fulei Chu, Shengfa Yuan, Zhike Peng. Machine Learning Techniques. .
CrossRef

Technology Partner - Atypon Systems, Inc.
  CrossRef member COUNTER member