A local algorithm to approximate the global clustering of streams generated in ubiquitous sensor networks

In ubiquitous streaming data sources, such as sensor networks, clustering nodes by the data they produce gives insights on the phenomenon being monitored. However, centralized algorithms force communication and storage requirements to grow unbounded. This article presents L2GClust, an algorithm to c...

Full description

Bibliographic Details
Main Authors: Pedro Pereira Rodrigues, João Araújo, João Gama, Luís Lopes
Format: Article
Language:English
Published: SAGE Publishing 2018-10-01
Series:International Journal of Distributed Sensor Networks
Online Access:https://doi.org/10.1177/1550147718808239
id doaj-71ebf9ddc2294d0c9b9e26137a2a68a7
record_format Article
spelling doaj-71ebf9ddc2294d0c9b9e26137a2a68a72020-11-25T03:29:31ZengSAGE PublishingInternational Journal of Distributed Sensor Networks1550-14772018-10-011410.1177/1550147718808239A local algorithm to approximate the global clustering of streams generated in ubiquitous sensor networksPedro Pereira Rodrigues0João Araújo1João Gama2Luís Lopes3Artificial Intelligence and Decision Support Laboratory (LIAAD), INESC TEC, Porto, PortugalCentre for Research in Advanced Computing Systems (CRACS), INESC TEC, Porto, PortugalFaculty of Economics (FEP), University of Porto, Porto, PortugalDepartment of Computer Science, Faculty of Sciences (DCC-FCUP), University of Porto, Porto, PortugalIn ubiquitous streaming data sources, such as sensor networks, clustering nodes by the data they produce gives insights on the phenomenon being monitored. However, centralized algorithms force communication and storage requirements to grow unbounded. This article presents L2GClust, an algorithm to compute local clusterings at each node as an approximation of the global clustering. L2GClust performs local clustering of the sources based on the moving average of each node’s data over time: the moving average is approximated using memory-less statistics; clustering is based on the furthest-point algorithm applied to the centroids computed by the node’s direct neighbors. Evaluation is performed both on synthetic and real sensor data, using a state-of-the-art sensor network simulator and measuring sensitivity to network size, number of clusters, cluster overlapping, and communication incompleteness. A high level of agreement was found between local and global clusterings, with special emphasis on separability agreement, while an overall robustness to incomplete communications emerged. Communication reduction was also theoretically shown, with communication ratios empirically evaluated for large networks. L2GClust is able to keep a good approximation of the global clustering, using less communication than a centralized alternative, supporting the recommendation to use local algorithms for distributed clustering of streaming data sources.https://doi.org/10.1177/1550147718808239
collection DOAJ
language English
format Article
sources DOAJ
author Pedro Pereira Rodrigues
João Araújo
João Gama
Luís Lopes
spellingShingle Pedro Pereira Rodrigues
João Araújo
João Gama
Luís Lopes
A local algorithm to approximate the global clustering of streams generated in ubiquitous sensor networks
International Journal of Distributed Sensor Networks
author_facet Pedro Pereira Rodrigues
João Araújo
João Gama
Luís Lopes
author_sort Pedro Pereira Rodrigues
title A local algorithm to approximate the global clustering of streams generated in ubiquitous sensor networks
title_short A local algorithm to approximate the global clustering of streams generated in ubiquitous sensor networks
title_full A local algorithm to approximate the global clustering of streams generated in ubiquitous sensor networks
title_fullStr A local algorithm to approximate the global clustering of streams generated in ubiquitous sensor networks
title_full_unstemmed A local algorithm to approximate the global clustering of streams generated in ubiquitous sensor networks
title_sort local algorithm to approximate the global clustering of streams generated in ubiquitous sensor networks
publisher SAGE Publishing
series International Journal of Distributed Sensor Networks
issn 1550-1477
publishDate 2018-10-01
description In ubiquitous streaming data sources, such as sensor networks, clustering nodes by the data they produce gives insights on the phenomenon being monitored. However, centralized algorithms force communication and storage requirements to grow unbounded. This article presents L2GClust, an algorithm to compute local clusterings at each node as an approximation of the global clustering. L2GClust performs local clustering of the sources based on the moving average of each node’s data over time: the moving average is approximated using memory-less statistics; clustering is based on the furthest-point algorithm applied to the centroids computed by the node’s direct neighbors. Evaluation is performed both on synthetic and real sensor data, using a state-of-the-art sensor network simulator and measuring sensitivity to network size, number of clusters, cluster overlapping, and communication incompleteness. A high level of agreement was found between local and global clusterings, with special emphasis on separability agreement, while an overall robustness to incomplete communications emerged. Communication reduction was also theoretically shown, with communication ratios empirically evaluated for large networks. L2GClust is able to keep a good approximation of the global clustering, using less communication than a centralized alternative, supporting the recommendation to use local algorithms for distributed clustering of streaming data sources.
url https://doi.org/10.1177/1550147718808239
work_keys_str_mv AT pedropereirarodrigues alocalalgorithmtoapproximatetheglobalclusteringofstreamsgeneratedinubiquitoussensornetworks
AT joaoaraujo alocalalgorithmtoapproximatetheglobalclusteringofstreamsgeneratedinubiquitoussensornetworks
AT joaogama alocalalgorithmtoapproximatetheglobalclusteringofstreamsgeneratedinubiquitoussensornetworks
AT luislopes alocalalgorithmtoapproximatetheglobalclusteringofstreamsgeneratedinubiquitoussensornetworks
AT pedropereirarodrigues localalgorithmtoapproximatetheglobalclusteringofstreamsgeneratedinubiquitoussensornetworks
AT joaoaraujo localalgorithmtoapproximatetheglobalclusteringofstreamsgeneratedinubiquitoussensornetworks
AT joaogama localalgorithmtoapproximatetheglobalclusteringofstreamsgeneratedinubiquitoussensornetworks
AT luislopes localalgorithmtoapproximatetheglobalclusteringofstreamsgeneratedinubiquitoussensornetworks
_version_ 1724578739807846400