Activate Activate Activate
contact  
Hello. Sign in to personalize your visit. New user? Register now.  

In
By author

Neural Computation

January 2009, Vol. 21, No. 1, Pages 121-146
Posted Online February 11, 2009.
(doi:10.1162/neco.2009.11-07-651)
© 2008 Massachusetts Institute of Technology

Density-Weighted Nyström Method for Computing Large Kernel Eigensystems

Kai Zhang

Department of Computer Science and Engineering, Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong

James T. Kwok

Department of Computer Science and Engineering, Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong

Full Text | PDF (1,151.581 KB) | PDF Plus (805.754 KB)

The Nyström method is a well-known sampling-based technique for approximating the eigensystem of large kernel matrices. However, the chosen samples in the Nyström method are all assumed to be of equal importance, which deviates from the integral equation that defines the kernel eigenfunctions. Motivated by this observation, we extend the Nyström method to a more general, density-weighted version. We show that by introducing the probability density function as a natural weighting scheme, the approximation of the eigensystem can be greatly improved. An efficient algorithm is proposed to enforce such weighting in practice, which has the same complexity as the original Nyström method and hence is notably cheaper than several other alternatives. Experiments on kernel principal component analysis, spectral clustering, and image segmentation demonstrate the encouraging performance of our algorithm.

Cited by

Fanhua Shang, L.C. Jiao, Jiarong Shi, Fei Wang, Maoguo Gong. (2011) Fast affinity propagation clustering: A multilevel approach. Pattern Recognition
Online publication date: 1-May-2011.
CrossRef
Fanhua Shang, L. C. Jiao, Jiarong Shi, Maoguo Gong, R. H. Shang. (2010) Fast density-weighted low-rank approximation spectral clustering. Data Mining and Knowledge Discovery
Online publication date: 4-Dec-2010.
CrossRef
Kai Zhang, James T Kwok. (2010) Clustered Nyström Method for Large Scale Manifold Learning and Dimension Reduction. IEEE Transactions on Neural Networks 21:10, 1576-1587
Online publication date: 1-Oct-2010.
CrossRef
Kai Zhang, J.T. Kwok. (2010) Simplifying Mixture Models Through Function Approximation. IEEE Transactions on Neural Networks 21:4, 644-658
Online publication date: 1-Apr-2010.
CrossRef
Cheng-Jin Du, Marco Marcello, David G. Spiller, Michael R. H. White, Till Bretschneider. (2010) Interactive segmentation of clustered cells via geodesic commute distance and constrained density weighted Nyström method. Cytometry Part An/a-n/a
Online publication date: 1-Jan-2010.
CrossRef
Lishan Qiao, Songcan Chen, Xiaoyang Tan. (2010) Sparsity preserving projections with applications to face recognition. Pattern Recognition 43:1, 331-341
Online publication date: 1-Jan-2010.
CrossRef
M.-A. Belabbas, P. J. Wolfe. (2009) On landmark selection and sampling in high-dimensional data analysis. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 367:1906, 4295-4312
Online publication date: 13-Nov-2009.
CrossRef

Technology Partner - Atypon Systems, Inc.
  CrossRef member COUNTER member