Intersection Information Based on Common Randomness

The introduction of the partial information decomposition generated a flurry of proposals for defining an intersection information that quantifies how much of “the same information” two or more random variables specify about a target random variable. As of yet, none is wholly satisfactory. A palatab...

Full description

Bibliographic Details
Main Authors:	Virgil Griffith, Edwin K. P. Chong, Ryan G. James, Christopher J. Ellison, James P. Crutchfield
Format:	Article
Language:	English
Published:	MDPI AG 2014-04-01
Series:	Entropy
Subjects:	intersection information partial information decomposition lattice Gács–Körner synergy redundant information
Online Access:	http://www.mdpi.com/1099-4300/16/4/1985

id	doaj-c074a02897264fb291de7bf0203930c1
record_format	Article
spelling	doaj-c074a02897264fb291de7bf0203930c12020-11-25T01:01:06ZengMDPI AGEntropy1099-43002014-04-011641985200010.3390/e16041985e16041985Intersection Information Based on Common RandomnessVirgil Griffith0Edwin K. P. Chong1Ryan G. James2Christopher J. Ellison3James P. Crutchfield4Computation and Neural Systems, Caltech, Pasadena, CA 91125, USADept. of Electrical & Computer Engineering, Colorado State University, Fort Collins, CO 80523, USADepartment of Computer Science, University of Colorado, Boulder, CO 80309, USACenter for Complexity and Collective Computation, Wisconsin Institute for Discovery, University of Wisconsin-Madison, Madison, WI 53715, USAComplexity Sciences Center and Physics Dept, University of California Davis, Davis, CA 95616, USAThe introduction of the partial information decomposition generated a flurry of proposals for defining an intersection information that quantifies how much of “the same information” two or more random variables specify about a target random variable. As of yet, none is wholly satisfactory. A palatable measure of intersection information would provide a principled way to quantify slippery concepts, such as synergy. Here, we introduce an intersection information measure based on the Gács-Körner common random variable that is the first to satisfy the coveted target monotonicity property. Our measure is imperfect, too, and we suggest directions for improvement.http://www.mdpi.com/1099-4300/16/4/1985intersection informationpartial information decompositionlatticeGács–Körnersynergyredundant information
collection	DOAJ
language	English
format	Article
sources	DOAJ
author	Virgil Griffith Edwin K. P. Chong Ryan G. James Christopher J. Ellison James P. Crutchfield
spellingShingle	Virgil Griffith Edwin K. P. Chong Ryan G. James Christopher J. Ellison James P. Crutchfield Intersection Information Based on Common Randomness Entropy intersection information partial information decomposition lattice Gács–Körner synergy redundant information
author_facet	Virgil Griffith Edwin K. P. Chong Ryan G. James Christopher J. Ellison James P. Crutchfield
author_sort	Virgil Griffith
title	Intersection Information Based on Common Randomness
title_short	Intersection Information Based on Common Randomness
title_full	Intersection Information Based on Common Randomness
title_fullStr	Intersection Information Based on Common Randomness
title_full_unstemmed	Intersection Information Based on Common Randomness
title_sort	intersection information based on common randomness
publisher	MDPI AG
series	Entropy
issn	1099-4300
publishDate	2014-04-01
description	The introduction of the partial information decomposition generated a flurry of proposals for defining an intersection information that quantifies how much of “the same information” two or more random variables specify about a target random variable. As of yet, none is wholly satisfactory. A palatable measure of intersection information would provide a principled way to quantify slippery concepts, such as synergy. Here, we introduce an intersection information measure based on the Gács-Körner common random variable that is the first to satisfy the coveted target monotonicity property. Our measure is imperfect, too, and we suggest directions for improvement.
topic	intersection information partial information decomposition lattice Gács–Körner synergy redundant information
url	http://www.mdpi.com/1099-4300/16/4/1985
work_keys_str_mv	AT virgilgriffith intersectioninformationbasedoncommonrandomness AT edwinkpchong intersectioninformationbasedoncommonrandomness AT ryangjames intersectioninformationbasedoncommonrandomness AT christopherjellison intersectioninformationbasedoncommonrandomness AT jamespcrutchfield intersectioninformationbasedoncommonrandomness
_version_	1725210762663690240

Intersection Information Based on Common Randomness

Similar Items