Monthly
288 pp. per issue
6 x 9, illustrated
Founded: 1989
ISSN 0899-7667
E-ISSN 1530-888X
2010 Impact Factor: 2.290
|
January 2009, Vol. 21, No. 1, Pages 121-146
Posted Online February 11, 2009.
(doi:10.1162/neco.2009.11-07-651)
© 2008 Massachusetts Institute of Technology
Density-Weighted Nyström Method for Computing Large Kernel EigensystemsKai ZhangDepartment of Computer Science and Engineering, Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong twinsen@cse.ust.hk James T. KwokDepartment of Computer Science and Engineering, Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong jamesk@cse.ust.hk
The Nyström method is a well-known sampling-based technique for approximating the eigensystem of large kernel matrices. However, the chosen samples in the Nyström method are all assumed to be of equal importance, which deviates from the integral equation that defines the kernel eigenfunctions. Motivated by this observation, we extend the Nyström method to a more general, density-weighted version. We show that by introducing the probability density function as a natural weighting scheme, the approximation of the eigensystem can be greatly improved. An efficient algorithm is proposed to enforce such weighting in practice, which has the same complexity as the original Nyström method and hence is notably cheaper than several other alternatives. Experiments on kernel principal component analysis, spectral clustering, and image segmentation demonstrate the encouraging performance of our algorithm. Cited byFanhua Shang, L.C. Jiao, Jiarong Shi, Fei Wang, Maoguo Gong. (2011) Fast affinity propagation clustering: A multilevel approach. Pattern RecognitionOnline publication date: 1-May-2011. CrossRef Fanhua Shang, L. C. Jiao, Jiarong Shi, Maoguo Gong, R. H. Shang. (2010) Fast density-weighted low-rank approximation spectral clustering. Data Mining and Knowledge DiscoveryOnline publication date: 4-Dec-2010. CrossRef Kai Zhang, James T Kwok. (2010) Clustered Nyström Method for Large Scale Manifold Learning and Dimension Reduction. IEEE Transactions on Neural Networks 21:10, 1576-1587 Online publication date: 1-Oct-2010. CrossRef Kai Zhang, J.T. Kwok. (2010) Simplifying Mixture Models Through Function Approximation. IEEE Transactions on Neural Networks 21:4, 644-658 Online publication date: 1-Apr-2010. CrossRef Cheng-Jin Du, Marco Marcello, David G. Spiller, Michael R. H. White, Till Bretschneider. (2010) Interactive segmentation of clustered cells via geodesic commute distance and constrained density weighted Nyström method. Cytometry Part An/a-n/a Online publication date: 1-Jan-2010. CrossRef Lishan Qiao, Songcan Chen, Xiaoyang Tan. (2010) Sparsity preserving projections with applications to face recognition. Pattern Recognition 43:1, 331-341 Online publication date: 1-Jan-2010. CrossRef M.-A. Belabbas, P. J. Wolfe. (2009) On landmark selection and sampling in high-dimensional data analysis. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 367:1906, 4295-4312 Online publication date: 13-Nov-2009. CrossRef
|