An Automated Pipeline for Image Processing and Data Treatment to Track Activity Rhythms of <i>Paragorgia arborea</i> in Relation to Hydrographic Conditions

Imaging technologies are being deployed on cabled observatory networks worldwide. They allow for the monitoring of the biological activity of deep-sea organisms on temporal scales that were never attained before. In this paper, we customized Convolutional Neural Network image processing to track beh...

Full description

Bibliographic Details
Main Authors: Ander Zuazo, Jordi Grinyó, Vanesa López-Vázquez, Erik Rodríguez, Corrado Costa, Luciano Ortenzi, Sascha Flögel, Javier Valencia, Simone Marini, Guosong Zhang, Henning Wehde, Jacopo Aguzzi
Format: Article
Language:English
Published: MDPI AG 2020-11-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/21/6281
id doaj-7fbbb0ae08b04b848d5015ba19be4376
record_format Article
spelling doaj-7fbbb0ae08b04b848d5015ba19be43762020-11-25T04:08:05ZengMDPI AGSensors1424-82202020-11-01206281628110.3390/s20216281An Automated Pipeline for Image Processing and Data Treatment to Track Activity Rhythms of <i>Paragorgia arborea</i> in Relation to Hydrographic ConditionsAnder Zuazo0Jordi Grinyó1Vanesa López-Vázquez2Erik Rodríguez3Corrado Costa4Luciano Ortenzi5Sascha Flögel6Javier Valencia7Simone Marini8Guosong Zhang9Henning Wehde10Jacopo Aguzzi11Deusto Sistemas, 01015 Vitoria-Gasteiz, SpainInstituto de Cièncias del Mar (ICM-CSIC), E-08003 Barcelona, SpainDS Labs, 01015 Vitoria-Gasteiz, SpainDS Labs, 01015 Vitoria-Gasteiz, SpainConsiglio per la ricerca in agricoltura e l’analisi dell’economia agraria (CREA)-Centro di ricerca Ingegneria e Trasformazioni agroalimentari, Via della Pascolare 16, Monterotondo, 00015 Rome, ItalyConsiglio per la ricerca in agricoltura e l’analisi dell’economia agraria (CREA)-Centro di ricerca Ingegneria e Trasformazioni agroalimentari, Via della Pascolare 16, Monterotondo, 00015 Rome, ItalyGEOMAR, Helmholtz Centre for Ocean Research Kiel, 24148 Kiel, GermanyDS Labs, 01015 Vitoria-Gasteiz, SpainInstitute of Marine Sciences, CNR, 19032 La Spezia, ItalyInstitute of Marine Research, N-5817 Bergen, NorwayInstitute of Marine Research, N-5817 Bergen, NorwayInstituto de Cièncias del Mar (ICM-CSIC), E-08003 Barcelona, SpainImaging technologies are being deployed on cabled observatory networks worldwide. They allow for the monitoring of the biological activity of deep-sea organisms on temporal scales that were never attained before. In this paper, we customized Convolutional Neural Network image processing to track behavioral activities in an iconic conservation deep-sea species—the bubblegum coral <i>Paragorgia arborea</i>—in response to ambient oceanographic conditions at the Lofoten-Vesterålen observatory. Images and concomitant oceanographic data were taken hourly from February to June 2018. We considered coral activity in terms of bloated, semi-bloated and non-bloated surfaces, as proxy for polyp filtering, retraction and transient activity, respectively. A test accuracy of 90.47% was obtained. Chronobiology-oriented statistics and advanced Artificial Neural Network (ANN) multivariate regression modeling proved that a daily coral filtering rhythm occurs within one major dusk phase, being independent from tides. Polyp activity, in particular extrusion, increased from March to June, and was able to cope with an increase in chlorophyll concentration, indicating the existence of seasonality. Our study shows that it is possible to establish a model for the development of automated pipelines that are able to extract biological information from times series of images. These are helpful to obtain multidisciplinary information from cabled observatory infrastructures.https://www.mdpi.com/1424-8220/20/21/6281neural networkdeep-seacold water coral (CWC)automated video imagingfiltering rhythmstides
collection DOAJ
language English
format Article
sources DOAJ
author Ander Zuazo
Jordi Grinyó
Vanesa López-Vázquez
Erik Rodríguez
Corrado Costa
Luciano Ortenzi
Sascha Flögel
Javier Valencia
Simone Marini
Guosong Zhang
Henning Wehde
Jacopo Aguzzi
spellingShingle Ander Zuazo
Jordi Grinyó
Vanesa López-Vázquez
Erik Rodríguez
Corrado Costa
Luciano Ortenzi
Sascha Flögel
Javier Valencia
Simone Marini
Guosong Zhang
Henning Wehde
Jacopo Aguzzi
An Automated Pipeline for Image Processing and Data Treatment to Track Activity Rhythms of <i>Paragorgia arborea</i> in Relation to Hydrographic Conditions
Sensors
neural network
deep-sea
cold water coral (CWC)
automated video imaging
filtering rhythms
tides
author_facet Ander Zuazo
Jordi Grinyó
Vanesa López-Vázquez
Erik Rodríguez
Corrado Costa
Luciano Ortenzi
Sascha Flögel
Javier Valencia
Simone Marini
Guosong Zhang
Henning Wehde
Jacopo Aguzzi
author_sort Ander Zuazo
title An Automated Pipeline for Image Processing and Data Treatment to Track Activity Rhythms of <i>Paragorgia arborea</i> in Relation to Hydrographic Conditions
title_short An Automated Pipeline for Image Processing and Data Treatment to Track Activity Rhythms of <i>Paragorgia arborea</i> in Relation to Hydrographic Conditions
title_full An Automated Pipeline for Image Processing and Data Treatment to Track Activity Rhythms of <i>Paragorgia arborea</i> in Relation to Hydrographic Conditions
title_fullStr An Automated Pipeline for Image Processing and Data Treatment to Track Activity Rhythms of <i>Paragorgia arborea</i> in Relation to Hydrographic Conditions
title_full_unstemmed An Automated Pipeline for Image Processing and Data Treatment to Track Activity Rhythms of <i>Paragorgia arborea</i> in Relation to Hydrographic Conditions
title_sort automated pipeline for image processing and data treatment to track activity rhythms of <i>paragorgia arborea</i> in relation to hydrographic conditions
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2020-11-01
description Imaging technologies are being deployed on cabled observatory networks worldwide. They allow for the monitoring of the biological activity of deep-sea organisms on temporal scales that were never attained before. In this paper, we customized Convolutional Neural Network image processing to track behavioral activities in an iconic conservation deep-sea species—the bubblegum coral <i>Paragorgia arborea</i>—in response to ambient oceanographic conditions at the Lofoten-Vesterålen observatory. Images and concomitant oceanographic data were taken hourly from February to June 2018. We considered coral activity in terms of bloated, semi-bloated and non-bloated surfaces, as proxy for polyp filtering, retraction and transient activity, respectively. A test accuracy of 90.47% was obtained. Chronobiology-oriented statistics and advanced Artificial Neural Network (ANN) multivariate regression modeling proved that a daily coral filtering rhythm occurs within one major dusk phase, being independent from tides. Polyp activity, in particular extrusion, increased from March to June, and was able to cope with an increase in chlorophyll concentration, indicating the existence of seasonality. Our study shows that it is possible to establish a model for the development of automated pipelines that are able to extract biological information from times series of images. These are helpful to obtain multidisciplinary information from cabled observatory infrastructures.
topic neural network
deep-sea
cold water coral (CWC)
automated video imaging
filtering rhythms
tides
url https://www.mdpi.com/1424-8220/20/21/6281
work_keys_str_mv AT anderzuazo anautomatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT jordigrinyo anautomatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT vanesalopezvazquez anautomatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT erikrodriguez anautomatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT corradocosta anautomatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT lucianoortenzi anautomatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT saschaflogel anautomatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT javiervalencia anautomatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT simonemarini anautomatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT guosongzhang anautomatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT henningwehde anautomatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT jacopoaguzzi anautomatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT anderzuazo automatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT jordigrinyo automatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT vanesalopezvazquez automatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT erikrodriguez automatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT corradocosta automatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT lucianoortenzi automatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT saschaflogel automatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT javiervalencia automatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT simonemarini automatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT guosongzhang automatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT henningwehde automatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
AT jacopoaguzzi automatedpipelineforimageprocessinganddatatreatmenttotrackactivityrhythmsofiparagorgiaarboreaiinrelationtohydrographicconditions
_version_ 1724426786120400896