Information Bottleneck Approach to Predictive Inference

Information Bottleneck Approach to Predictive Inference

This paper synthesizes a recent line of work on automated predictive model making inspired by Rate-Distortion theory, in particular by the Information Bottleneck method. Predictive inference is interpreted as a strategy for efficient communication. The relationship to thermodynamic efficiency is dis...

Full description

Bibliographic Details
Main Author: Susanne Still
Format: Article
Language:English
Published: MDPI AG 2014-02-01
Series:Entropy
Subjects:
predictive inference
information bottleneck method
dynamical systems
thermodynamic efficiency
far-from-equilibrium thermodynamics
computing engines
Online Access:http://www.mdpi.com/1099-4300/16/2/968
Description
Summary:This paper synthesizes a recent line of work on automated predictive model making inspired by Rate-Distortion theory, in particular by the Information Bottleneck method. Predictive inference is interpreted as a strategy for efficient communication. The relationship to thermodynamic efficiency is discussed. The overall aim of this paper is to explain how this information theoretic approach provides an intuitive, overarching framework for predictive inference.
ISSN:1099-4300

Similar Items