Topological features determining the error in the inference of networks using transfer entropy

The problem of inferring interactions from observations of individual behavior in networked dynamical systems is ubiquitous in science and engineering. From brain circuits to financial networks, there is a dire need for robust methodologies that can unveil network structures from individual time ser...

Full description

Bibliographic Details
Main Authors: Roy H. Goodman, Maurizio Porfiri
Format: Article
Language:English
Published: AIMS Press 2020-05-01
Series:Mathematics in Engineering
Subjects:
Online Access:https://www.aimspress.com/article/10.3934/mine.2020003/fulltext.html
id doaj-2d94cfcf451f4307af510a6f55b639eb
record_format Article
spelling doaj-2d94cfcf451f4307af510a6f55b639eb2020-11-25T03:04:10ZengAIMS PressMathematics in Engineering2640-35012020-05-0121345410.3934/mine.2020003Topological features determining the error in the inference of networks using transfer entropyRoy H. Goodman0Maurizio Porfiri11 Department of Mathematical Sciences, New Jersey Institute of Technology, Newark, New Jersey 07102, USA2 Department of Mechanical and Aerospace Engineering & Department of Biomedical Engineering, New York University, Tandon School of Engineering, Brooklyn, New York 11201, USAThe problem of inferring interactions from observations of individual behavior in networked dynamical systems is ubiquitous in science and engineering. From brain circuits to financial networks, there is a dire need for robust methodologies that can unveil network structures from individual time series. Originally formulated to identify asymmetries in pairs of coupled dynamical systems, transfer entropy has been proposed as a model-free, computationally-inexpensive framework for network inference. While previous studies have cataloged a library of pathological instances in which transfer entropy-based network reconstruction can fail, we presently lack analytical results that can help quantify the accuracy of the identification and pinpoint scenarios where false inferences results are more likely to be registered. Here, we present a detailed analytical study of a Boolean network model of policy diffusion. Through perturbation theory, we establish a closed-form expression for the transfer entropy between any pair of nodes in the network up to the third order in an expansion parameter that is associated with the spontaneous activity of the nodes. While for slowly-varying dynamics transfer entropy is successful in capturing the weight of any link, for faster dynamics the error in the inference is controlled by local topological features of the node pair. Specifically, the error in the inference of a weight between two nodes depends on the mismatch between their weighted indegrees that serves as a common uncertainty bath upon which we must tackle the inference problem. Interestingly, an equivalent result is discovered when numerically studying a network of coupled chaotic tent maps, suggesting that heterogeneity in the in-degree is a critical factor that can undermine the success of transfer entropy-based network inference.https://www.aimspress.com/article/10.3934/mine.2020003/fulltext.htmlboolean networkdata-drivendiscrete systemsinformation theorymarkov chainperturbation theorypolicy diffusion
collection DOAJ
language English
format Article
sources DOAJ
author Roy H. Goodman
Maurizio Porfiri
spellingShingle Roy H. Goodman
Maurizio Porfiri
Topological features determining the error in the inference of networks using transfer entropy
Mathematics in Engineering
boolean network
data-driven
discrete systems
information theory
markov chain
perturbation theory
policy diffusion
author_facet Roy H. Goodman
Maurizio Porfiri
author_sort Roy H. Goodman
title Topological features determining the error in the inference of networks using transfer entropy
title_short Topological features determining the error in the inference of networks using transfer entropy
title_full Topological features determining the error in the inference of networks using transfer entropy
title_fullStr Topological features determining the error in the inference of networks using transfer entropy
title_full_unstemmed Topological features determining the error in the inference of networks using transfer entropy
title_sort topological features determining the error in the inference of networks using transfer entropy
publisher AIMS Press
series Mathematics in Engineering
issn 2640-3501
publishDate 2020-05-01
description The problem of inferring interactions from observations of individual behavior in networked dynamical systems is ubiquitous in science and engineering. From brain circuits to financial networks, there is a dire need for robust methodologies that can unveil network structures from individual time series. Originally formulated to identify asymmetries in pairs of coupled dynamical systems, transfer entropy has been proposed as a model-free, computationally-inexpensive framework for network inference. While previous studies have cataloged a library of pathological instances in which transfer entropy-based network reconstruction can fail, we presently lack analytical results that can help quantify the accuracy of the identification and pinpoint scenarios where false inferences results are more likely to be registered. Here, we present a detailed analytical study of a Boolean network model of policy diffusion. Through perturbation theory, we establish a closed-form expression for the transfer entropy between any pair of nodes in the network up to the third order in an expansion parameter that is associated with the spontaneous activity of the nodes. While for slowly-varying dynamics transfer entropy is successful in capturing the weight of any link, for faster dynamics the error in the inference is controlled by local topological features of the node pair. Specifically, the error in the inference of a weight between two nodes depends on the mismatch between their weighted indegrees that serves as a common uncertainty bath upon which we must tackle the inference problem. Interestingly, an equivalent result is discovered when numerically studying a network of coupled chaotic tent maps, suggesting that heterogeneity in the in-degree is a critical factor that can undermine the success of transfer entropy-based network inference.
topic boolean network
data-driven
discrete systems
information theory
markov chain
perturbation theory
policy diffusion
url https://www.aimspress.com/article/10.3934/mine.2020003/fulltext.html
work_keys_str_mv AT royhgoodman topologicalfeaturesdeterminingtheerrorintheinferenceofnetworksusingtransferentropy
AT maurizioporfiri topologicalfeaturesdeterminingtheerrorintheinferenceofnetworksusingtransferentropy
_version_ 1724682539383128064