Monthly
288 pp. per issue
6 x 9, illustrated
Founded: 1989
ISSN 0899-7667
E-ISSN 1530-888X
2010 Impact Factor: 2.290
|
June 2009, Vol. 21, No. 6, Pages 1485-1519
Posted Online May 19, 2009.
(doi:10.1162/neco.2009.04-08-773)
© 2009 Massachusetts Institute of Technology
Nonlinear Extraction of Independent Components of Natural Images Using Radial GaussianizationSiwei LyuComputer Science Department, University at Albany, State University of New York, Albany, NY 12222, U.S.A. lsw@cs.albany.edu Eero P. SimoncelliHoward Hughes Medical Institute, Center for Neural Science, and Courant Institute for Mathematical Sciences, New York University, New York, NY 10003, U.S.A eero@cns.nyu.edu
We consider the problem of efficiently encoding a signal by transforming it to a new representation whose components are statistically independent. A widely studied linear solution, known as independent component analysis (ICA), exists for the case when the signal is generated as a linear transformation of independent nongaussian sources. Here, we examine a complementary case, in which the source is nongaussian and elliptically symmetric. In this case, no invertible linear transform suffices to decompose the signal into independent components, but we show that a simple nonlinear transformation, which we call radial gaussianization (RG), is able to remove all dependencies. We then examine this methodology in the context of natural image statistics. We first show that distributions of spatially proximal bandpass filter responses are better described as elliptical than as linearly transformed independent sources. Consistent with this, we demonstrate that the reduction in dependency achieved by applying RG to either nearby pairs or blocks of bandpass filter responses is significantly greater than that achieved by ICA. Finally, we show that the RG transformation may be closely approximated by divisive normalization, which has been used to model the nonlinear response properties of visual neurons. Cited byTerry Elliott. (2012) Cross-Talk Induces Bifurcations in Nonlinear Models of Synaptic Plasticity. Neural Computation 24:2, 455-522 Online publication date: 1-Feb-2012. Abstract | Full Text | PDF (1596 KB) | PDF Plus (1355 KB) Matteo Carandini, David J. Heeger. (2011) Normalization as a canonical neural computation. Nature Reviews NeuroscienceOnline publication date: 23-Nov-2011. CrossRef Tania Pouli, Douglas W. Cunningham, Erik Reinhard. (2011) A Survey of Image Statistics Relevant to Computer Graphics. Computer Graphics Forumno-no Online publication date: 1-Apr-2011. CrossRef Jonathan W. Pillow, Yashar Ahmadian, Liam Paninski. (2011) Model-Based Decoding, Information Estimation, and Change-Point Detection Techniques for Multineuron Spike Trains. Neural Computation 23:1, 1-45 Online publication date: 1-Jan-2011. Abstract | Full Text | PDF (1188 KB) | PDF Plus (1217 KB) | Supplementary Content Jesús Malo, Valero Laparra. (2010) Psychophysically Tuned Divisive Normalization Approximately Factorizes the PDF of Natural Images. Neural Computation 22:12, 3179-3206 Online publication date: 1-Dec-2010. Abstract | Full Text | PDF (1448 KB) | PDF Plus (885 KB)
|