An Information-Theoretic Approach to Neural Computing

Neural networks provide a powerful new technology to model and controlnonlinear and complex systems. In this book the authors present a detailedformulation of n... » 

Neural networks provide a powerful new technology to model and controlnonlinear and complex systems. In this book the authors present a detailedformulation of neural networks from the informationtheoretic viewpoint. Theyshow how this perspective provides new insights into the design theory ofneural networks. In particular they show how these methods may be applied tothe topics of supervised and unsupervised learning including featureextraction linear and nonlinear independent component analysis and Boltzmannmachines. Readers are assumed to have a basic understanding of neural networksbut all the relevant concepts from information theory are carefully introducedand explained. Consequently readers from several different scientificdisciplines notably cognitive scientists engineers physicistsstatisticians and computer scientists will find this to be a very valuableintroduction to this topic. «