Monthly
288 pp. per issue
6 x 9, illustrated
Founded: 1989
ISSN 0899-7667
E-ISSN 1530-888X
2011 Impact Factor: 1.884
|
March 2003, Vol. 15, No. 3, Pages 621-638
Posted Online March 13, 2006.
(doi:10.1162/089976603321192103)
© 2003 Massachusetts Institute of Technology
Permitted and Forbidden Sets in Symmetric Threshold-Linear NetworksRichard H. R. HahnloserHoward Hughes Medical Institute, Department of Brain and Cognitive Sciences, MIT E25-210, Cambridge, MA 02139, U.S.A., rhahnloser@mit.edu H. Sebastian SeungHoward Hughes Medical Institute, Department of Brain and Cognitive Sciences, MIT E25-210, Cambridge, MA 02139, U.S.A., seung@mit.edu Jean-Jacques SlotineDepartment of Mechanical Engineering and Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, U.S.A., jjs@mit.edu
The richness and complexity of recurrent cortical circuits is an inexhaustible source of inspiration for thinking about high-level biological computation. In past theoretical studies, constraints on the synaptic connection patterns of threshold-linear networks were found that guaranteed bounded network dynamics, convergence to attractive fixed points, and multistability, all fundamental aspects of cortical information processing. However, these conditions were only sufficient, and it remained unclear which were the minimal (necessary) conditions for convergence and multistability. We show that symmetric threshold-linear networks converge to a set of attractive fixed points if and only if the network matrix is copositive. Furthermore, the set of attractive fixed points is nonconnected (the network is multiattractive) if and only if the network matrix is not positive semidefinite. There are permitted sets of neurons that can be coactive at a stable steady state and forbidden sets that cannot. Permitted sets are clustered in the sense that subsets of permitted sets are permitted and supersets of forbidden sets are forbidden. By viewing permitted sets as memories stored in the synaptic connections, we provide a formulation of long-term memory that is more general than the traditional perspective of fixed-point attractor networks. There is a close correspondence between threshold-linear networks and networks defined by the generalized Lotka-Volterra equations. Cited byWei Zhou, Jacek M. Zurada. (2012) A competitive layer model for cellular neural networks. Neural NetworksOnline publication date: 1-May-2012. Emre Neftci, Elisabetta Chicca, Giacomo Indiveri, Rodney Douglas. (2011) A Systematic Method for Configuring VLSI Networks of Spiking Neurons. Neural Computation 23:10, 2457-2497 Online publication date: 1-Oct-2011. Abstract | Full Text | PDF (1192 KB) | PDF Plus (655 KB) Immanuel M. Bomze, Werner Schachinger, Gabriele Uchida. (2011) Think co(mpletely)positive ! Matrix properties, examples and a clustered bibliography on copositive optimization. Journal of Global OptimizationOnline publication date: 13-Aug-2011. Carina Curto, Anda Degeratu, Vladimir Itskov. (2011) Flexible Memory Networks. Bulletin of Mathematical BiologyOnline publication date: 9-Aug-2011. Immanuel M. Bomze. (2011) Copositive optimization – Recent developments and applications. European Journal of Operational ResearchOnline publication date: 1-Apr-2011. Ueli Rutishauser, Rodney J. Douglas, Jean-Jacques Slotine. (2011) Collective Stability of Networks of Winner-Take-All Circuits. Neural Computation 23:3, 735-773 Online publication date: 1-Mar-2011. Abstract | Full Text | PDF (2124 KB) | PDF Plus (1611 KB) Youngmin Cho, Lawrence K. Saul. (2010) Large-Margin Classification in Infinite Neural Networks. Neural Computation 22:10, 2678-2697 Online publication date: 1-Oct-2010. Abstract | Full Text | PDF (372 KB) | PDF Plus (284 KB) Wei Zhou, Jacek M. Zurada. (2010) Competitive Layer Model of Discrete-Time Recurrent Neural Networks with LT Neurons. Neural Computation 22:8, 2137-2160 Online publication date: 1-Aug-2010. Abstract | Full Text | PDF (674 KB) | PDF Plus (409 KB) Martin T Wiechert, Benjamin Judkewitz, Hermann Riecke, Rainer W Friedrich. (2010) Mechanisms of pattern decorrelation by recurrent neuronal circuits. Nature Neuroscience 13:8, 1003-1010 Online publication date: 1-Aug-2010. Zhang Yi. (2010) Foundations of Implementing the Competitive Layer Model by Lotka–Volterra Recurrent Neural Networks. IEEE Transactions on Neural Networks 21:3, 494-507 Online publication date: 1-Mar-2010. T. Binzegger, R.J. Douglas, K.A.C. Martin. (2009) Topology and dynamics of the canonical circuit of cat V1. Neural Networks 22:8, 1071-1078 Online publication date: 1-Oct-2009. Zhang Yi, Lei Zhang, Jiali Yu, Kok Kiong Tan. (2009) Permitted and Forbidden Sets in Discrete-Time Linear Threshold Recurrent Neural Networks. IEEE Transactions on Neural Networks 20:6, 952-963 Online publication date: 1-Jun-2009. Lei Zhang, Zhang Yi, Stones Lei Zhang, Pheng Ann Heng. (2009) Activity Invariant Sets and Exponentially Stable Attractors of Linear Threshold Discrete-Time Recurrent Neural Networks. IEEE Transactions on Automatic Control 54:6, 1341-1347 Online publication date: 1-Jun-2009. Ueli Rutishauser, Rodney J. Douglas. (2009) State-Dependent Computation Using Coupled Recurrent Networks. Neural Computation 21:2, 478-509 Online publication date: 1-Feb-2009. Abstract | Full Text | PDF (2431 KB) | PDF Plus (353 KB) Jiali Yu, Zhang Yi, Lei Zhang. (2009) Representations of Continuous Attractors of Recurrent Neural Networks. IEEE Transactions on Neural Networks 20:2, 368-372 Online publication date: 1-Feb-2009. Lei Zhang, Zhang Yi, Jiali Yu. (2008) Multiperiodicity and Attractivity of Delayed Recurrent Neural Networks With Unsaturating Piecewise Linear Transfer Functions. IEEE Transactions on Neural Networks 19:1, 158-167 Online publication date: 1-Jan-2008. Kenji Morita, Masato Okada, Kazuyuki Aihara. (2007) Selectivity and Stability via Dendritic Nonlinearity. Neural Computation 19:7, 1798-1853 Online publication date: 1-Jul-2007. Abstract | PDF (3187 KB) | PDF Plus (1439 KB) Rodney J. Douglas, Kevan A.C. Martin. (2007) Recurrent neuronal circuits in the neocortex. Current Biology 17:13, R496-R500 Online publication date: 1-Jul-2007. H. Tang, K.C. Tan, E.J. Teoh. (2006) Dynamics Analysis and Analog Associative Memory of Networks With LT Neurons. IEEE Transactions on Neural Networks 17:2, 409-418 Online publication date: 1-Mar-2006. Tim P. Vogels, Kanaka Rajan, L.F. Abbott. (2005) NEURAL NETWORK DYNAMICS. Annual Review of Neuroscience 28:1, 357-376 Online publication date: 1-Jul-2005. Mao Ye, Yi Zhang. (2005) Complete Convergence of Competitive Neural Networks with Different Time Scales. Neural Processing Letters 21:1, 53-60 Online publication date: 1-Feb-2005. H. J. Tang, K. C. Tan, Weinian Zhang. (2005) Analysis of Cyclic Dynamics for Networks of Linear Threshold Neurons. Neural Computation 17:1, 97-114 Online publication date: 1-Jan-2005. Abstract | PDF (922 KB) | PDF Plus (967 KB) Liam Paninski. (2004) Maximum likelihood estimation of cascade point-process neural encoding models. Network: Computation in Neural Systems 15:4, 243-262 Online publication date: 1-Nov-2004. R.H.R. Hahnloser. (2003) Emergence of neural integration in the head-direction system by visual supervision. Neuroscience 120:3, 877-891 Online publication date: 1-Sep-2003.
|