Engineering Emergence for Cluster Configuration

• Main Author: Richard Anthony
• Format: Article
• Language: English
• Published: International Institute of Informatics and Cybernetics 2005-04-01
• Series: Journal of Systemics, Cybernetics and Informatics
• Subjects: Scalability; Fault-Tolerance; emergence; Dynamic Cluster Management; Layered Architecture; Self-Healing
• Online Access: http://www.iiisci.org/Journal/CV$/sci/pdfs/P165301.pdf

Distributed applications are being deployed on ever-increasing scale and with ever-increasing functionality. Due to the accompanying increase in behavioural complexity, self-management abilities, such as self-healing, have become core requirements. A key challenge is the smooth embedding of such functionality into our systems. Natural distributed systems such as ant colonies have evolved highly efficient behaviour. These emergent systems achieve high scalability through the use of low complexity communication strategies and are highly robust through large-scale replication of simple, anonymous entities. Ways to engineer this fundamentally non-deterministic behaviour for use in distributed applications are being explored. An emergent, dynamic, cluster management scheme, which forms part of a hierarchical resource management architecture, is presented. Natural biological systems, which embed self-healing behaviour at several levels, have influenced the architecture. The resulting system is a simple, lightweight and highly robust platform on which autonomic applications can be deployed.