Explore
Information Bottleneck
0 Ungluers have
Faved this Work
Login to Fave
The celebrated information bottleneck (IB) principle of Tishby et al. has recently enjoyed renewed attention due to its application in the area of deep learning. This collection investigates the IB principle in this new context. The individual chapters in this collection: • provide novel insights into the functional properties of the IB; • discuss the IB principle (and its derivates) as an objective for training multi-layer machine learning structures such as neural networks and decision trees; and • offer a new perspective on neural network learning via the lens of the IB framework. Our collection thus contributes to a better understanding of the IB principle specifically for deep learning and, more generally, of information–theoretic cost functions in machine learning. This paves the way toward explainable artificial intelligence.
This book is included in DOAB.
Why read this book? Have your say.
You must be logged in to comment.
Rights Information
Are you the author or publisher of this work? If so, you can claim it as yours by registering as an Unglue.it rights holder.Downloads
This work has been downloaded 54 times via unglue.it ebook links.
- 54 - pdf (CC BY) at Unglue.it.
Keywords
- bottleneck
- Classification
- classifier
- compression
- conspicuous subset
- decision tree
- deep learning
- Deep Networks
- deep neural networks
- Economics, finance, business & management
- ensemble
- hand crafted priors
- Industry & industrial studies
- information
- information bottleneck
- information bottleneck principle
- Information technology industries
- Information theory
- latent space representation
- learnability
- learnable priors
- Machine learning
- Media, information & communication industries
- mutual information
- neural networks
- optimization
- regularization
- regularization methods
- Representation Learning
- semi-supervised classification
- stochastic neural networks
- variational inference
Links
DOI: 10.3390/books978-3-0365-0803-0Editions