Activate Activate Activate
contact  
Hello. Sign in to personalize your visit. New user? Register now.  

In
By author

Neural Computation

March 2003, Vol. 15, No. 3, Pages 621-638
Posted Online March 13, 2006.
(doi:10.1162/089976603321192103)
© 2003 Massachusetts Institute of Technology

Permitted and Forbidden Sets in Symmetric Threshold-Linear Networks

Richard H. R. Hahnloser

Howard Hughes Medical Institute, Department of Brain and Cognitive Sciences, MIT E25-210, Cambridge, MA 02139, U.S.A.,

H. Sebastian Seung

Howard Hughes Medical Institute, Department of Brain and Cognitive Sciences, MIT E25-210, Cambridge, MA 02139, U.S.A.,

Jean-Jacques Slotine

Department of Mechanical Engineering and Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, U.S.A.,

PDF (125.425 KB) | PDF Plus (173.726 KB)

The richness and complexity of recurrent cortical circuits is an inexhaustible source of inspiration for thinking about high-level biological computation. In past theoretical studies, constraints on the synaptic connection patterns of threshold-linear networks were found that guaranteed bounded network dynamics, convergence to attractive fixed points, and multistability, all fundamental aspects of cortical information processing. However, these conditions were only sufficient, and it remained unclear which were the minimal (necessary) conditions for convergence and multistability.

We show that symmetric threshold-linear networks converge to a set of attractive fixed points if and only if the network matrix is copositive. Furthermore, the set of attractive fixed points is nonconnected (the network is multiattractive) if and only if the network matrix is not positive semidefinite. There are permitted sets of neurons that can be coactive at a stable steady state and forbidden sets that cannot. Permitted sets are clustered in the sense that subsets of permitted sets are permitted and supersets of forbidden sets are forbidden. By viewing permitted sets as memories stored in the synaptic connections, we provide a formulation of long-term memory that is more general than the traditional perspective of fixed-point attractor networks. There is a close correspondence between threshold-linear networks and networks defined by the generalized Lotka-Volterra equations.

Cited by

Wei Zhou, Jacek M. Zurada. (2012) A competitive layer model for cellular neural networks. Neural Networks
Online publication date: 1-May-2012.
Emre Neftci, Elisabetta Chicca, Giacomo Indiveri, Rodney Douglas. (2011) A Systematic Method for Configuring VLSI Networks of Spiking Neurons. Neural Computation 23:10, 2457-2497
Online publication date: 1-Oct-2011.
Abstract | Full Text | PDF (1192 KB) | PDF Plus (655 KB) 
Immanuel M. Bomze, Werner Schachinger, Gabriele Uchida. (2011) Think co(mpletely)positive ! Matrix properties, examples and a clustered bibliography on copositive optimization. Journal of Global Optimization
Online publication date: 13-Aug-2011.
Carina Curto, Anda Degeratu, Vladimir Itskov. (2011) Flexible Memory Networks. Bulletin of Mathematical Biology
Online publication date: 9-Aug-2011.
Immanuel M. Bomze. (2011) Copositive optimization – Recent developments and applications. European Journal of Operational Research
Online publication date: 1-Apr-2011.
Ueli Rutishauser, Rodney J. Douglas, Jean-Jacques Slotine. (2011) Collective Stability of Networks of Winner-Take-All Circuits. Neural Computation 23:3, 735-773
Online publication date: 1-Mar-2011.
Abstract | Full Text | PDF (2124 KB) | PDF Plus (1611 KB) 
Youngmin Cho, Lawrence K. Saul. (2010) Large-Margin Classification in Infinite Neural Networks. Neural Computation 22:10, 2678-2697
Online publication date: 1-Oct-2010.
Abstract | Full Text | PDF (372 KB) | PDF Plus (284 KB) 
Wei Zhou, Jacek M. Zurada. (2010) Competitive Layer Model of Discrete-Time Recurrent Neural Networks with LT Neurons. Neural Computation 22:8, 2137-2160
Online publication date: 1-Aug-2010.
Abstract | Full Text | PDF (674 KB) | PDF Plus (409 KB) 
Martin T Wiechert, Benjamin Judkewitz, Hermann Riecke, Rainer W Friedrich. (2010) Mechanisms of pattern decorrelation by recurrent neuronal circuits. Nature Neuroscience 13:8, 1003-1010
Online publication date: 1-Aug-2010.
Zhang Yi. (2010) Foundations of Implementing the Competitive Layer Model by Lotka–Volterra Recurrent Neural Networks. IEEE Transactions on Neural Networks 21:3, 494-507
Online publication date: 1-Mar-2010.
T. Binzegger, R.J. Douglas, K.A.C. Martin. (2009) Topology and dynamics of the canonical circuit of cat V1. Neural Networks 22:8, 1071-1078
Online publication date: 1-Oct-2009.
Zhang Yi, Lei Zhang, Jiali Yu, Kok Kiong Tan. (2009) Permitted and Forbidden Sets in Discrete-Time Linear Threshold Recurrent Neural Networks. IEEE Transactions on Neural Networks 20:6, 952-963
Online publication date: 1-Jun-2009.
Lei Zhang, Zhang Yi, Stones Lei Zhang, Pheng Ann Heng. (2009) Activity Invariant Sets and Exponentially Stable Attractors of Linear Threshold Discrete-Time Recurrent Neural Networks. IEEE Transactions on Automatic Control 54:6, 1341-1347
Online publication date: 1-Jun-2009.
Ueli Rutishauser, Rodney J. Douglas. (2009) State-Dependent Computation Using Coupled Recurrent Networks. Neural Computation 21:2, 478-509
Online publication date: 1-Feb-2009.
Abstract | Full Text | PDF (2431 KB) | PDF Plus (353 KB) 
Jiali Yu, Zhang Yi, Lei Zhang. (2009) Representations of Continuous Attractors of Recurrent Neural Networks. IEEE Transactions on Neural Networks 20:2, 368-372
Online publication date: 1-Feb-2009.
Lei Zhang, Zhang Yi, Jiali Yu. (2008) Multiperiodicity and Attractivity of Delayed Recurrent Neural Networks With Unsaturating Piecewise Linear Transfer Functions. IEEE Transactions on Neural Networks 19:1, 158-167
Online publication date: 1-Jan-2008.
Kenji Morita, Masato Okada, Kazuyuki Aihara. (2007) Selectivity and Stability via Dendritic Nonlinearity. Neural Computation 19:7, 1798-1853
Online publication date: 1-Jul-2007.
Abstract | PDF (3187 KB) | PDF Plus (1439 KB) 
Rodney J. Douglas, Kevan A.C. Martin. (2007) Recurrent neuronal circuits in the neocortex. Current Biology 17:13, R496-R500
Online publication date: 1-Jul-2007.
H. Tang, K.C. Tan, E.J. Teoh. (2006) Dynamics Analysis and Analog Associative Memory of Networks With LT Neurons. IEEE Transactions on Neural Networks 17:2, 409-418
Online publication date: 1-Mar-2006.
Tim P. Vogels, Kanaka Rajan, L.F. Abbott. (2005) NEURAL NETWORK DYNAMICS. Annual Review of Neuroscience 28:1, 357-376
Online publication date: 1-Jul-2005.
Mao Ye, Yi Zhang. (2005) Complete Convergence of Competitive Neural Networks with Different Time Scales. Neural Processing Letters 21:1, 53-60
Online publication date: 1-Feb-2005.
H. J. Tang, K. C. Tan, Weinian Zhang. (2005) Analysis of Cyclic Dynamics for Networks of Linear Threshold Neurons. Neural Computation 17:1, 97-114
Online publication date: 1-Jan-2005.
Abstract | PDF (922 KB) | PDF Plus (967 KB) 
Liam Paninski. (2004) Maximum likelihood estimation of cascade point-process neural encoding models. Network: Computation in Neural Systems 15:4, 243-262
Online publication date: 1-Nov-2004.
R.H.R. Hahnloser. (2003) Emergence of neural integration in the head-direction system by visual supervision. Neuroscience 120:3, 877-891
Online publication date: 1-Sep-2003.

Technology Partner - Atypon Systems, Inc.
  CrossRef member COUNTER member