Monthly
288 pp. per issue, 6 x 9,
illustrated
Founded: 1989
ISSN 0899-7667
E-ISSN 1530-888X
2008 ISI Impact Factor: 2.378
|
January 1, 1998, Vol. 10, No. 1, Pages 215-234
Posted Online March 13, 2006.
(doi:10.1162/089976698300017953)
© 1997 Massachusetts Institute of Technology
GTM: The Generative Topographic Mapping Christopher M. BishopNeural Computing Research Group, Department of Computer Science and Applied Mathematics, Aston University, Birmingham B4 7ET, U.K. Markus SvensénNeural Computing Research Group, Department of Computer Science and Applied Mathematics, Aston University, Birmingham B4 7ET, U.K. Christopher K. I. WilliamsNeural Computing Research Group, Department of Computer Science and Applied Mathematics, Aston University, Birmingham B4 7ET, U.K.
Latent variable models represent the probability density of data in a space of several dimensions in terms of a smaller number of latent, or hidden, variables. A familiar example is factor analysis, which is based on a linear transformation between the latent space and the data space. In this article, we introduce a form of nonlinear latent variable model called the generative topographic mapping, for which the parameters of the model can be determined using the expectation-maximization algorithm. GTM provides a principled alternative to the widely used self-organizing map (SOM) of Kohonen (1982) and overcomes most of the significant limitations of the SOM. We demonstrate the performance of the GTM algorithm on a toy problem and on simulated data from flow diagnostics for a multiphase oil pipeline. Cited byRui Li, Tai-Peng Tian, Stan Sclaroff, Ming-Hsuan Yang. (2010) 3D Human Motion Tracking with a Coordinated Mixture of Factor Analyzers. International Journal of Computer Vision 87:1-2, 170-190 Online publication date: 1-Apr-2010. CrossRef Luis Felipe Giraldo, Fernando Lozano, Nicanor Quijano. (2009) Foraging theory for dimensionality reduction of clustered data. Machine Learning Online publication date: 13-Dec-2009. CrossRef Jan H. Kwakkel, Scott W. Cunningham. (2009) Managing polysemy and synonymy in science mapping using the mixtures of factor analyzers model. Journal of the American Society for Information Science and Technology 60:10, 2064-2078 Online publication date: 1-Nov-2009. CrossRef Antanas Verikas, Zivile Kalsyte, Marija Bacauskiene, Adas Gelzinis. (2009) Hybrid and ensemble-based soft computing techniques in bankruptcy prediction: a survey. Soft Computing Online publication date: 16-Oct-2009. CrossRef Ezequiel Lopez-Rubio, Juan Miguel Ortiz-de-Lazcano-Lobato, Domingo Lopez-Rodriguez. (2009) Probabilistic PCA Self-Organizing Maps. IEEE Transactions on Neural Networks 20:9, 1474-1489 Online publication date: 1-Oct-2009. CrossRef Tianhao Zhang, Dacheng Tao, Xuelong Li, Jie Yang. (2009) Patch Alignment for Dimensionality Reduction. IEEE Transactions on Knowledge and Data Engineering 21:9, 1299-1313 Online publication date: 1-Oct-2009. CrossRef Shiming Xiang, Feiping Nie, Changshui Zhang, Chunxia Zhang. (2009) Nonlinear Dimensionality Reduction with Local Spline Embedding. IEEE Transactions on Knowledge and Data Engineering 21:9, 1285-1298 Online publication date: 1-Oct-2009. CrossRef Dora Alvarez, Hugo Hidalgo. (2009) Document analysis and visualization with zero-inflated poisson. Data Mining and Knowledge Discovery 19:1, 1-23 Online publication date: 1-Sep-2009. CrossRef Christian Feuersänger, Michael Griebel. (2009) Principal manifold learning by sparse grids. Computing 85:4, 267-299 Online publication date: 1-Sep-2009. CrossRef R. D'Abrusco, G. Longo, N. A. Walton. (2009) Quasar candidates selection in the Virtual Observatory era. Monthly Notices of the Royal Astronomical Society 396:1, 223-262 Online publication date: 11-Jul-2009. CrossRef Shih-Sian Cheng, Hsin-Chia Fu, Hsin-Min Wang. (2009) Model-Based Clustering by Probabilistic Self-Organizing Maps. IEEE Transactions on Neural Networks 20:5, 805-826 Online publication date: 1-Jun-2009. CrossRef Shiming Xiang, Feiping Nie, Yangqiu Song, Changshui Zhang, Chunxia Zhang. (2009) Embedding new data points for manifold learning via coordinate propagation. Knowledge and Information Systems 19:2, 159-184 Online publication date: 1-Jun-2009. CrossRef D K Saldin, V L Shneerson, R Fung, A Ourmazd. (2009) Structure of isolated biomolecules obtained from ultrashort x-ray pulses: exploiting the symmetry of random orientations. Journal of Physics: Condensed Matter 21:13, 134014 Online publication date: 1-May-2009. CrossRef Indranil Bose, Xi Chen. (2009) A method for extension of generative topographic mapping for fuzzy clustering. Journal of the American Society for Information Science and Technology 60:2, 363-371 Online publication date: 1-Mar-2009. CrossRef Eimad E. Abusham, E. K. Wong. (2009) Locally Linear Discriminate Embedding for Face Recognition. Discrete Dynamics in Nature and Society 2009, 1-9 Online publication date: 1-Feb-2009. CrossRef Paola Costantini, Marielle Linting, Giovanni C. Porzio. (2009) Mining performance data through nonlinear PCA with optimal scaling. Applied Stochastic Models in Business and Industry n/a-n/a Online publication date: 1-Feb-2009. CrossRef Jun-Ying ZHANG, Bin ZHOU. (2009) <![CDATA[Self Organizing Map with Generalized and Localized Parallel Competitions for the TSP]]>. Chinese Journal of Computers 31:2, 220 CrossRef Iván Olier, Alfredo Vellido. (2009) Variational Bayesian Generative Topographic Mapping. Journal of Mathematical Modelling and Algorithms 7:4, 371-387 Online publication date: 1-Jan-2009. CrossRef N. Gianniotis, P. Tino. (2008) Visualization of Tree-Structured Data Through Generative Topographic Mapping. IEEE Transactions on Neural Networks 19:8, 1468-1493 Online publication date: 1-Sep-2008. CrossRef Guido Sanguinetti. (2008) Dimensionality Reduction of Clustered Data Sets. IEEE Transactions on Pattern Analysis and Machine Intelligence 30:3, 535-540 Online publication date: 1-Apr-2008. CrossRef L. Hamel, N. Nahar, M.S. Poptsova, O. Zhaxybayeva, J.P. Gogarten. (2008) Unsupervised Learning in Detection of Gene Transfer. Journal of Biomedicine and Biotechnology 2008, 1-8 Online publication date: 1-Feb-2008. CrossRef Vladimir Bochko, Yoichi Miyake, Jussi Parkkinen. (2008) The Learning-Based Principal Component Analysis Technique in Low Resolution and High Resolution Spectral Images. Journal of Imaging Science and Technology 52:3, 030504 Online publication date: 1-Feb-2008. CrossRef Gary G. Yen, Zheng Wu. (2008) <![CDATA[Ranked Centroid Projection: A Data Visualization Approach With Self-Organizing Maps]]>. IEEE Transactions on Neural Networks 19:2, 245 CrossRef Tong Lin, Hongbin Zha. (2008) <![CDATA[Riemannian Manifold Learning]]>. IEEE Transactions on Pattern Analysis and Machine Intelligence 30:5, 796 CrossRef Sylvain Lespinats, Michel Verleysen, Alain Giron, Bernard Fertil. (2007) DD-HDS: A Method for Visualization and Exploration of High-Dimensional Data. IEEE Transactions on Neural Networks 18:5, 1265-1279 Online publication date: 1-Oct-2007. CrossRef Diego Vidaurre, Jorge Muruzabal. (2007) A Quick Assessment of Topology Preservation for SOM Structures. IEEE Transactions on Neural Networks 18:5, 1524-1528 Online publication date: 1-Oct-2007. CrossRef Chao Jin, Thomas Fevens, Shuo Li, Sudhir Mudur. (2007) Motion learning-based framework for unarticulated shape animation. The Visual Computer 23:9-11, 753-761 Online publication date: 7-Sep-2007. CrossRef Chun-Hou Zheng, De-Shuang Huang, Kang Li, George Irwin, Zhan-Li Sun. (2007) MISEP Method for Postnonlinear Blind Source Separation. Neural Computation 19:9, 2557-2578 Online publication date: 1-Sep-2007. Abstract
| PDF (966 KB)
| PDF Plus (401 KB) Hujun Yin. (2007) Nonlinear dimensionality reduction and data visualization: A review. International Journal of Automation and Computing 4:3, 294-303 Online publication date: 1-Aug-2007. CrossRef Steven C. Kazmierczak, Todd K. Leen, Deniz Erdogmus, Miguel A. Carreira-Perpinan. (2007) Reduction of multi-dimensional laboratory data to a two-dimensional plot: a novel technique for the identification of laboratory error. Clinical Chemistry and Laboratory Medicine 45:6, 749-752 Online publication date: 1-Jul-2007. CrossRef Ata Kabán. (2007) Predictive Modelling of Heterogeneous Sequence Collections by Topographic Ordering of Histories. Machine Learning 68:1, 63-95 Online publication date: 23-Jun-2007. CrossRef Colin Fyfe. (2007) Two topographic maps for data visualisation. Data Mining and Knowledge Discovery 14:2, 207-224 Online publication date: 13-Apr-2007. CrossRef Jianghua Liang, V.K. Vaishnavi, A. Vandenberg. (2006) Clustering of LDAP directory schemas to facilitate information resources interoperability across organizations. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans 36:4, 631-642 Online publication date: 1-Aug-2006. CrossRef E. Berglund, J. Sitte. (2006) The Parameterless Self-Organizing Map Algorithm. IEEE Transactions on Neural Networks 17:2, 305-316 Online publication date: 1-Apr-2006. CrossRef D. D'Alimonte, G. Zibordi. (2006) Statistical assessment of radiometric measurements from autonomous systems. IEEE Transactions on Geoscience and Remote Sensing 44:3, 719-728 Online publication date: 1-Apr-2006. CrossRef Guzmán Díaz, Ignacio Díaz Blanco, Pablo Arboleya, Javier Gómez-Aleixandre. (2006) Zero-sequence-based relaying technique for protecting power transformers and its performance assessment using unsupervised learning ANN. European Transactions on Electrical Power 16:2, 147-160 Online publication date: 1-Apr-2006. CrossRef M.H.C. Law, A.K. Jain. (2006) Incremental nonlinear dimensionality reduction by manifold learning. IEEE Transactions on Pattern Analysis and Machine Intelligence 28:3, 377-391 Online publication date: 1-Apr-2006. CrossRef E.G. Learned-Miller. (2006) Data driven image models through continuous joint alignment. IEEE Transactions on Pattern Analysis and Machine Intelligence 28:2, 236-250 Online publication date: 1-Mar-2006. CrossRef Thomas Villmann, Jens Christian Claussen. (2006) Magnification Control in Self-Organizing Maps and Neural Gas. Neural Computation 18:2, 446-469 Online publication date: 1-Feb-2006. Abstract
| PDF (164 KB)
| PDF Plus (198 KB) P. Gao, W.L. Woo, S.S. Dlay. (2006) Weierstrass approach to blind source separation of multiple nonlinearly mixed signals. IEE Proceedings - Circuits, Devices and Systems 153:4, 332 Online publication date: 1-Feb-2006. CrossRef P. Gao, W.L. Woo, S.S. Dlay. (2006) Non-linear independent component analysis using series reversion and Weierstrass network. IEE Proceedings - Vision, Image, and Signal Processing 153:2, 115 Online publication date: 1-Feb-2006. CrossRef Ming-ming Sun, Jian Yang, Jing-yu Yang. (2006) <![CDATA[Topology Description for Data Distributions Using a Topology Graph With Divide-and-Combine Learning Strategy]]>. IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) 36:6, 1296 CrossRef Petr Praus. (2006) SVD-based principal component analysis of geochemical data. Central European Journal of Chemistry 3:4, 731-741 Online publication date: 1-Jan-2006. CrossRef P. Meinicke, S. Klanke, R. Memisevic, H. Ritter. (2005) Principal surfaces from unsupervised kernel regression. IEEE Transactions on Pattern Analysis and Machine Intelligence 27:9, 1379-1391 Online publication date: 1-Oct-2005. CrossRef I.T. Nabney, Y. Sun, P. Tino, A. Kaban. (2005) Semisupervised learning of hierarchical latent trait models for data visualization. IEEE Transactions on Knowledge and Data Engineering 17:3, 384-400 Online publication date: 1-Apr-2005. CrossRef Xiaoli Li, R. Du. (2005) Condition Monitoring Using a Latent Process Model with an Application to Sheet Metal Stamping Processes. Journal of Manufacturing Science and Engineering 127:2, 376 Online publication date: 1-Feb-2005. CrossRef Elias Pampalk, Simon Dixon, Gerhard Widmer. (2004) Exploring Music Collections by Browsing Different Views. Computer Music Journal 28:2, 49-62 Online publication date: 1-Jun-2004. Citation
| PDF (1370 KB)
| PDF Plus (563 KB) Reiner Schulz, James A. Reggia. (2004) Temporally Asymmetric Learning Supports Sequence Processing in Multi-Winner Self-Organizing Maps. Neural Computation 16:3, 535-561 Online publication date: 1-Mar-2004. Abstract
| PDF (1908 KB)
| PDF Plus (1943 KB) Jainy Kuriakose, Anandamohan Ghosh, V. Ravi Kumar, B. D. Kulkarni. (2004) Isometric graphing and multidimensional scaling for reaction-diffusion modeling on regular and fractal surfaces with spatiotemporal pattern recognition. The Journal of Chemical Physics 120:11, 5432 Online publication date: 1-Feb-2004. CrossRef A. Vellido, W. El-Deredy, P.J.G. Lisboa. (2003) Selective smoothing of the generative topographic mapping. IEEE Transactions on Neural Networks 14:4, 847-852 Online publication date: 1-Aug-2003. CrossRef Miguel L. Teodoro, George N. Phillips, Lydia E. Kavraki. (2003) Understanding Protein Flexibility through Dimensionality Reduction. Journal of Computational Biology 10:3-4, 617-634 Online publication date: 1-Jul-2003. CrossRef Guilherme de A. Barreto, Aluizio F. R. Araújo, Stefan C. Kremer. (2003) A Taxonomy for Spatiotemporal Connectionist Networks Revisited: The Unsupervised Case. Neural Computation 15:6, 1255-1320 Online publication date: 1-Jun-2003. Abstract
| PDF (412 KB)
| PDF Plus (470 KB) Kyung Hwan Kim, Sung June Kim. (2003) Method for unsupervised classification of multiunit neural signal recording under low signal-to-noise ratio. IEEE Transactions on Biomedical Engineering 50:4, 421-431 Online publication date: 1-May-2003. CrossRef B.J. Frey, N. Jojic. (2003) Transformation-invariant clustering using the EM algorithm. IEEE Transactions on Pattern Analysis and Machine Intelligence 25:1, 1-17 Online publication date: 1-Feb-2003. CrossRef Katy B rner, Chaomei Chen, Kevin W. Boyack. (2003) Visualizing knowledge domains. Annual Review of Information Science and Technology 37:1, 179-255 Online publication date: 1-Feb-2003. CrossRef A. Rauber, D. Merkl, M. Dittenbach. (2002) The growing hierarchical self-organizing map: exploratory analysis of high-dimensional data. IEEE Transactions on Neural Networks 13:6, 1331-1341 Online publication date: 1-Dec-2002. CrossRef Marc M. Van Hulle. (2002) Joint Entropy Maximization in Kernel-Based Topographic Maps. Neural Computation 14:8, 1887-1906 Online publication date: 1-Aug-2002. Abstract
| PDF (733 KB)
| PDF Plus (743 KB) Marc M. Van Hulle. (2002) Kernel-Based Topographic Map Formation by Local Density Modeling. Neural Computation 14:7, 1561-1573 Online publication date: 1-Jul-2002. Abstract
| PDF (1039 KB)
| PDF Plus (1044 KB) P. Tino, I. Nabney. (2002) Hierarchical GTM: constructing localized nonlinear projection manifolds in a principled way. IEEE Transactions on Pattern Analysis and Machine Intelligence 24:5, 639-656 Online publication date: 1-Jun-2002. CrossRef Aapo Hyvärinen, Patrik O. Hoyer, Mika Inki. (2001) Topographic Independent Component Analysis. Neural Computation 13:7, 1527-1558 Online publication date: 1-Jul-2001. Abstract
| PDF (1406 KB)
| PDF Plus (1406 KB) T.W. Nattkemper, H.J. Ritter, W. Schubert. (2001) A neural classifier enabling high-throughput topological analysis of lymphocytes in tissue sections. IEEE Transactions on Information Technology in Biomedicine 5:2, 138-149 Online publication date: 1-Jul-2001. CrossRef H. Yin, N.M. Allinson. (2001) Self-organizing mixture networks for probability density estimation. IEEE Transactions on Neural Networks 12:2, 405-411 Online publication date: 1-Apr-2001. CrossRef Karin Haese, Geoffrey J. Goodhill. (2001) Auto-SOM: Recursive Parameter Estimation for Guidance of Self-Organizing Feature Maps. Neural Computation 13:3, 595-619 Online publication date: 1-Mar-2001. Abstract
| PDF (1112 KB)
| PDF Plus (342 KB) H. Yin, N.M. Allinson. (2001) Bayesian self-organising map for Gaussian mixtures. IEE Proceedings - Vision, Image, and Signal Processing 148:4, 234 Online publication date: 1-Feb-2001. CrossRef M. Girolami. (2001) The topographic organization and visualization of binary data using multivariate-Bernoulli latent variable models. IEEE Transactions on Neural Networks 12:6, 1367 CrossRef Kui-Yu Chang, J. Ghosh. (2001) A unified model for probabilistic principal surfaces. IEEE Transactions on Pattern Analysis and Machine Intelligence 23:1, 22 CrossRef A. Kaban, M. Girolami. (2001) A combined latent class and trait model for the analysis and visualization of discrete data. IEEE Transactions on Pattern Analysis and Machine Intelligence 23:8, 859 CrossRef Dirk Husmeier. (2000) The Bayesian Evidence Scheme for Regularizing Probability-Density Estimating Neural Networks. Neural Computation 12:11, 2685-2717 Online publication date: 1-Nov-2000. Abstract
| PDF (223 KB)
| PDF Plus (230 KB) Zhuo Meng, Yoh-Han Pao. (2000) Visualization and self-organization of multidimensional data through equalized orthogonal mapping. IEEE Transactions on Neural Networks 11:4, 1031-1038 Online publication date: 1-Aug-2000. CrossRef Maxim Khaikine, Klaus Holthausen. (2000) A General Probability Estimation Approach for Neural Computation. Neural Computation 12:2, 433-450 Online publication date: 1-Feb-2000. Abstract
| PDF (254 KB)
| PDF Plus (256 KB) M.A. Carreira-Perpinan. (2000) Mode-finding for mixtures of Gaussian distributions. IEEE Transactions on Pattern Analysis and Machine Intelligence 22:11, 1318 CrossRef M. Ignova, G. A. Montague, A. C. Ward, J. Glassey. (1999) Fermentation seed quality analysis with self-organising neural networks. Biotechnology and Bioengineering 64:1, 82-91 Online publication date: 5-Aug-1999. CrossRef H. Attias. (1999) Independent Factor Analysis. Neural Computation 11:4, 803-851 Online publication date: 1-May-1999. Abstract
| PDF (530 KB)
| PDF Plus (567 KB) Michael E. Tipping, Christopher M. Bishop. (1999) Mixtures of Probabilistic Principal Component Analyzers. Neural Computation 11:2, 443-482 Online publication date: 1-Feb-1999. Abstract
| PDF (394 KB)
| PDF Plus (433 KB) Sam Roweis, Zoubin Ghahramani. (1999) A Unifying Review of Linear Gaussian Models. Neural Computation 11:2, 305-345 Online publication date: 1-Feb-1999. Abstract
| PDF (287 KB)
| PDF Plus (326 KB) Thore Graepel, Klaus Obermayer. (1999) A Stochastic Self-Organizing Map for Proximity Data. Neural Computation 11:1, 139-155 Online publication date: 1-Jan-1999. Abstract
| PDF (154 KB)
| PDF Plus (180 KB) Akio Utsugi. (1998) Density Estimation by Mixture Models with Smoothing Priors. Neural Computation 10:8, 2115-2135 Online publication date: 1-Nov-1998. Abstract
| PDF (234 KB)
| PDF Plus (242 KB) C.M. Bishop, M.E. Tipping. (1998) A hierarchical latent variable model for data visualization. IEEE Transactions on Pattern Analysis and Machine Intelligence 20:3, 281-293 Online publication date: 1-Apr-1998. CrossRef M. Girolami, A. Cichocki, S.I. Amari. (1998) A common neural-network model for unsupervised exploratory data analysis and independent component analysis. IEEE Transactions on Neural Networks 9:6, 1495 CrossRef Mike Schuster. Neural Nets for Speech Processing. . CrossRef Marc M. Van Hulle. Kernel-Based Topographic Maps: Theory and Applications. . CrossRef
|