An Iterative Information-Theoretic Approach to the Detection of Structures in Complex Systems

Systems that exhibit complex behaviours often contain inherent dynamical structures which evolve over time in a coordinated way. In this paper, we present a methodology based on the Relevance Index method aimed at revealing the dynamical structures hidden in complex systems. The method iterates two...

Full description

Bibliographic Details
Main Authors: Marco Villani, Laura Sani, Riccardo Pecori, Michele Amoretti, Andrea Roli, Monica Mordonini, Roberto Serra, Stefano Cagnoni
Format: Article
Language:English
Published: Hindawi-Wiley 2018-01-01
Series:Complexity
Online Access:http://dx.doi.org/10.1155/2018/3687839
id doaj-b7eed64e983145c7948e41774171a679
record_format Article
spelling doaj-b7eed64e983145c7948e41774171a6792020-11-25T00:50:04ZengHindawi-WileyComplexity1076-27871099-05262018-01-01201810.1155/2018/36878393687839An Iterative Information-Theoretic Approach to the Detection of Structures in Complex SystemsMarco Villani0Laura Sani1Riccardo Pecori2Michele Amoretti3Andrea Roli4Monica Mordonini5Roberto Serra6Stefano Cagnoni7Department of Physics, Informatics and Mathematics, University of Modena and Reggio Emilia, Modena, ItalyDepartment of Engineering and Architecture, University of Parma, Parma, ItalyDepartment of Engineering and Architecture, University of Parma, Parma, ItalyDepartment of Engineering and Architecture, University of Parma, Parma, ItalyDepartment of Computer Science and Engineering (DISI), University of Bologna, Bologna, ItalyDepartment of Engineering and Architecture, University of Parma, Parma, ItalyDepartment of Physics, Informatics and Mathematics, University of Modena and Reggio Emilia, Modena, ItalyDepartment of Engineering and Architecture, University of Parma, Parma, ItalySystems that exhibit complex behaviours often contain inherent dynamical structures which evolve over time in a coordinated way. In this paper, we present a methodology based on the Relevance Index method aimed at revealing the dynamical structures hidden in complex systems. The method iterates two basic steps: detection of relevant variable sets based on the computation of the Relevance Index, and application of a sieving algorithm, which refines the results. This approach is able to highlight the organization of a complex system into sets of variables, which interact with one another at different hierarchical levels, detected, in turn, in the different iterations of the sieve. The method can be applied directly to systems composed of a small number of variables, whereas it requires the help of a custom metaheuristic in case of systems with larger dimensions. We have evaluated the potential of the method by applying it to three case studies: synthetic data generated by a nonlinear stochastic dynamical system, a small-sized and well-known system modelling a catalytic reaction, and a larger one, which describes the interactions within a social community, that requires the use of the metaheuristic. The experiments we made to validate the method produced interesting results, effectively uncovering hidden details of the systems to which it was applied.http://dx.doi.org/10.1155/2018/3687839
collection DOAJ
language English
format Article
sources DOAJ
author Marco Villani
Laura Sani
Riccardo Pecori
Michele Amoretti
Andrea Roli
Monica Mordonini
Roberto Serra
Stefano Cagnoni
spellingShingle Marco Villani
Laura Sani
Riccardo Pecori
Michele Amoretti
Andrea Roli
Monica Mordonini
Roberto Serra
Stefano Cagnoni
An Iterative Information-Theoretic Approach to the Detection of Structures in Complex Systems
Complexity
author_facet Marco Villani
Laura Sani
Riccardo Pecori
Michele Amoretti
Andrea Roli
Monica Mordonini
Roberto Serra
Stefano Cagnoni
author_sort Marco Villani
title An Iterative Information-Theoretic Approach to the Detection of Structures in Complex Systems
title_short An Iterative Information-Theoretic Approach to the Detection of Structures in Complex Systems
title_full An Iterative Information-Theoretic Approach to the Detection of Structures in Complex Systems
title_fullStr An Iterative Information-Theoretic Approach to the Detection of Structures in Complex Systems
title_full_unstemmed An Iterative Information-Theoretic Approach to the Detection of Structures in Complex Systems
title_sort iterative information-theoretic approach to the detection of structures in complex systems
publisher Hindawi-Wiley
series Complexity
issn 1076-2787
1099-0526
publishDate 2018-01-01
description Systems that exhibit complex behaviours often contain inherent dynamical structures which evolve over time in a coordinated way. In this paper, we present a methodology based on the Relevance Index method aimed at revealing the dynamical structures hidden in complex systems. The method iterates two basic steps: detection of relevant variable sets based on the computation of the Relevance Index, and application of a sieving algorithm, which refines the results. This approach is able to highlight the organization of a complex system into sets of variables, which interact with one another at different hierarchical levels, detected, in turn, in the different iterations of the sieve. The method can be applied directly to systems composed of a small number of variables, whereas it requires the help of a custom metaheuristic in case of systems with larger dimensions. We have evaluated the potential of the method by applying it to three case studies: synthetic data generated by a nonlinear stochastic dynamical system, a small-sized and well-known system modelling a catalytic reaction, and a larger one, which describes the interactions within a social community, that requires the use of the metaheuristic. The experiments we made to validate the method produced interesting results, effectively uncovering hidden details of the systems to which it was applied.
url http://dx.doi.org/10.1155/2018/3687839
work_keys_str_mv AT marcovillani aniterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems
AT laurasani aniterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems
AT riccardopecori aniterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems
AT micheleamoretti aniterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems
AT andrearoli aniterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems
AT monicamordonini aniterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems
AT robertoserra aniterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems
AT stefanocagnoni aniterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems
AT marcovillani iterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems
AT laurasani iterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems
AT riccardopecori iterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems
AT micheleamoretti iterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems
AT andrearoli iterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems
AT monicamordonini iterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems
AT robertoserra iterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems
AT stefanocagnoni iterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems
_version_ 1725249487677423616