An Iterative Information-Theoretic Approach to the Detection of Structures in Complex Systems
Systems that exhibit complex behaviours often contain inherent dynamical structures which evolve over time in a coordinated way. In this paper, we present a methodology based on the Relevance Index method aimed at revealing the dynamical structures hidden in complex systems. The method iterates two...
Main Authors: | , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Hindawi-Wiley
2018-01-01
|
Series: | Complexity |
Online Access: | http://dx.doi.org/10.1155/2018/3687839 |
id |
doaj-b7eed64e983145c7948e41774171a679 |
---|---|
record_format |
Article |
spelling |
doaj-b7eed64e983145c7948e41774171a6792020-11-25T00:50:04ZengHindawi-WileyComplexity1076-27871099-05262018-01-01201810.1155/2018/36878393687839An Iterative Information-Theoretic Approach to the Detection of Structures in Complex SystemsMarco Villani0Laura Sani1Riccardo Pecori2Michele Amoretti3Andrea Roli4Monica Mordonini5Roberto Serra6Stefano Cagnoni7Department of Physics, Informatics and Mathematics, University of Modena and Reggio Emilia, Modena, ItalyDepartment of Engineering and Architecture, University of Parma, Parma, ItalyDepartment of Engineering and Architecture, University of Parma, Parma, ItalyDepartment of Engineering and Architecture, University of Parma, Parma, ItalyDepartment of Computer Science and Engineering (DISI), University of Bologna, Bologna, ItalyDepartment of Engineering and Architecture, University of Parma, Parma, ItalyDepartment of Physics, Informatics and Mathematics, University of Modena and Reggio Emilia, Modena, ItalyDepartment of Engineering and Architecture, University of Parma, Parma, ItalySystems that exhibit complex behaviours often contain inherent dynamical structures which evolve over time in a coordinated way. In this paper, we present a methodology based on the Relevance Index method aimed at revealing the dynamical structures hidden in complex systems. The method iterates two basic steps: detection of relevant variable sets based on the computation of the Relevance Index, and application of a sieving algorithm, which refines the results. This approach is able to highlight the organization of a complex system into sets of variables, which interact with one another at different hierarchical levels, detected, in turn, in the different iterations of the sieve. The method can be applied directly to systems composed of a small number of variables, whereas it requires the help of a custom metaheuristic in case of systems with larger dimensions. We have evaluated the potential of the method by applying it to three case studies: synthetic data generated by a nonlinear stochastic dynamical system, a small-sized and well-known system modelling a catalytic reaction, and a larger one, which describes the interactions within a social community, that requires the use of the metaheuristic. The experiments we made to validate the method produced interesting results, effectively uncovering hidden details of the systems to which it was applied.http://dx.doi.org/10.1155/2018/3687839 |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Marco Villani Laura Sani Riccardo Pecori Michele Amoretti Andrea Roli Monica Mordonini Roberto Serra Stefano Cagnoni |
spellingShingle |
Marco Villani Laura Sani Riccardo Pecori Michele Amoretti Andrea Roli Monica Mordonini Roberto Serra Stefano Cagnoni An Iterative Information-Theoretic Approach to the Detection of Structures in Complex Systems Complexity |
author_facet |
Marco Villani Laura Sani Riccardo Pecori Michele Amoretti Andrea Roli Monica Mordonini Roberto Serra Stefano Cagnoni |
author_sort |
Marco Villani |
title |
An Iterative Information-Theoretic Approach to the Detection of Structures in Complex Systems |
title_short |
An Iterative Information-Theoretic Approach to the Detection of Structures in Complex Systems |
title_full |
An Iterative Information-Theoretic Approach to the Detection of Structures in Complex Systems |
title_fullStr |
An Iterative Information-Theoretic Approach to the Detection of Structures in Complex Systems |
title_full_unstemmed |
An Iterative Information-Theoretic Approach to the Detection of Structures in Complex Systems |
title_sort |
iterative information-theoretic approach to the detection of structures in complex systems |
publisher |
Hindawi-Wiley |
series |
Complexity |
issn |
1076-2787 1099-0526 |
publishDate |
2018-01-01 |
description |
Systems that exhibit complex behaviours often contain inherent dynamical structures which evolve over time in a coordinated way. In this paper, we present a methodology based on the Relevance Index method aimed at revealing the dynamical structures hidden in complex systems. The method iterates two basic steps: detection of relevant variable sets based on the computation of the Relevance Index, and application of a sieving algorithm, which refines the results. This approach is able to highlight the organization of a complex system into sets of variables, which interact with one another at different hierarchical levels, detected, in turn, in the different iterations of the sieve. The method can be applied directly to systems composed of a small number of variables, whereas it requires the help of a custom metaheuristic in case of systems with larger dimensions. We have evaluated the potential of the method by applying it to three case studies: synthetic data generated by a nonlinear stochastic dynamical system, a small-sized and well-known system modelling a catalytic reaction, and a larger one, which describes the interactions within a social community, that requires the use of the metaheuristic. The experiments we made to validate the method produced interesting results, effectively uncovering hidden details of the systems to which it was applied. |
url |
http://dx.doi.org/10.1155/2018/3687839 |
work_keys_str_mv |
AT marcovillani aniterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems AT laurasani aniterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems AT riccardopecori aniterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems AT micheleamoretti aniterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems AT andrearoli aniterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems AT monicamordonini aniterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems AT robertoserra aniterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems AT stefanocagnoni aniterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems AT marcovillani iterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems AT laurasani iterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems AT riccardopecori iterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems AT micheleamoretti iterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems AT andrearoli iterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems AT monicamordonini iterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems AT robertoserra iterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems AT stefanocagnoni iterativeinformationtheoreticapproachtothedetectionofstructuresincomplexsystems |
_version_ |
1725249487677423616 |