PlantES: A Plant Electrophysiological Multi-Source Data Online Analysis and Sharing Platform

At present, plant electrophysiological data volumes and complexity are increasing rapidly. It causes the demand for efficient management of big data, data sharing among research groups, and fast analysis. In this paper, we proposed PlantES (Plant Electrophysiological Data Sharing), a distributed com...

Full description

Bibliographic Details
Main Authors: Chao Song, Xiao-Huang Qin, Qiao Zhou, Zi-Yang Wang, Wei-He Liu, Jun Li, Lan Huang, Yang Chen, Guiliang Tang, Dong-Jie Zhao, Zhong-Yi Wang
Format: Article
Language:English
Published: MDPI AG 2018-11-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/8/11/2269
id doaj-049d0f8d3a1c44d8a5f3efc21969fd93
record_format Article
spelling doaj-049d0f8d3a1c44d8a5f3efc21969fd932020-11-25T01:06:29ZengMDPI AGApplied Sciences2076-34172018-11-01811226910.3390/app8112269app8112269PlantES: A Plant Electrophysiological Multi-Source Data Online Analysis and Sharing PlatformChao Song0Xiao-Huang Qin1Qiao Zhou2Zi-Yang Wang3Wei-He Liu4Jun Li5Lan Huang6Yang Chen7Guiliang Tang8Dong-Jie Zhao9Zhong-Yi Wang10College of Information and Electrical Engineering, China Agricultural University, Beijing 100083, ChinaCollege of Information and Electrical Engineering, China Agricultural University, Beijing 100083, ChinaCollege of Information and Electrical Engineering, China Agricultural University, Beijing 100083, ChinaCollege of Information and Electrical Engineering, China Agricultural University, Beijing 100083, ChinaCollege of Information and Electrical Engineering, China Agricultural University, Beijing 100083, ChinaCollege of Information and Electrical Engineering, China Agricultural University, Beijing 100083, ChinaCollege of Information and Electrical Engineering, China Agricultural University, Beijing 100083, ChinaThe Jackson Laboratory for Genomic Medicine, Farmington, CT 06032, USADepartment of Biological Sciences, Michigan Technological University, Houghton, MI 49931-1295, USAInstitute for Future, Qingdao University, Qingdao 266071, ChinaCollege of Information and Electrical Engineering, China Agricultural University, Beijing 100083, ChinaAt present, plant electrophysiological data volumes and complexity are increasing rapidly. It causes the demand for efficient management of big data, data sharing among research groups, and fast analysis. In this paper, we proposed PlantES (Plant Electrophysiological Data Sharing), a distributed computing-based prototype system that can be used to store, manage, visualize, analyze, and share plant electrophysiological data. We deliberately designed a storage schema to manage the multi-source plant electrophysiological data by integrating distributed storage systems HDFS and HBase to access all kinds of files efficiently. To improve the online analysis efficiency, parallel computing algorithms on Spark were proposed and implemented, e.g., plant electrical signals extraction method, the adaptive derivative threshold algorithm, and template matching algorithm. The experimental results indicated that Spark efficiently improves the online analysis. Meanwhile, the online visualization and sharing of multiple types of data in the web browser were implemented. Our prototype platform provides a solution for web-based sharing and analysis of plant electrophysiological multi-source data and improves the comprehension of plant electrical signals from a systemic perspective.https://www.mdpi.com/2076-3417/8/11/2269plant electrical signalsonline analysisparallelizationSparkHadoopweb system
collection DOAJ
language English
format Article
sources DOAJ
author Chao Song
Xiao-Huang Qin
Qiao Zhou
Zi-Yang Wang
Wei-He Liu
Jun Li
Lan Huang
Yang Chen
Guiliang Tang
Dong-Jie Zhao
Zhong-Yi Wang
spellingShingle Chao Song
Xiao-Huang Qin
Qiao Zhou
Zi-Yang Wang
Wei-He Liu
Jun Li
Lan Huang
Yang Chen
Guiliang Tang
Dong-Jie Zhao
Zhong-Yi Wang
PlantES: A Plant Electrophysiological Multi-Source Data Online Analysis and Sharing Platform
Applied Sciences
plant electrical signals
online analysis
parallelization
Spark
Hadoop
web system
author_facet Chao Song
Xiao-Huang Qin
Qiao Zhou
Zi-Yang Wang
Wei-He Liu
Jun Li
Lan Huang
Yang Chen
Guiliang Tang
Dong-Jie Zhao
Zhong-Yi Wang
author_sort Chao Song
title PlantES: A Plant Electrophysiological Multi-Source Data Online Analysis and Sharing Platform
title_short PlantES: A Plant Electrophysiological Multi-Source Data Online Analysis and Sharing Platform
title_full PlantES: A Plant Electrophysiological Multi-Source Data Online Analysis and Sharing Platform
title_fullStr PlantES: A Plant Electrophysiological Multi-Source Data Online Analysis and Sharing Platform
title_full_unstemmed PlantES: A Plant Electrophysiological Multi-Source Data Online Analysis and Sharing Platform
title_sort plantes: a plant electrophysiological multi-source data online analysis and sharing platform
publisher MDPI AG
series Applied Sciences
issn 2076-3417
publishDate 2018-11-01
description At present, plant electrophysiological data volumes and complexity are increasing rapidly. It causes the demand for efficient management of big data, data sharing among research groups, and fast analysis. In this paper, we proposed PlantES (Plant Electrophysiological Data Sharing), a distributed computing-based prototype system that can be used to store, manage, visualize, analyze, and share plant electrophysiological data. We deliberately designed a storage schema to manage the multi-source plant electrophysiological data by integrating distributed storage systems HDFS and HBase to access all kinds of files efficiently. To improve the online analysis efficiency, parallel computing algorithms on Spark were proposed and implemented, e.g., plant electrical signals extraction method, the adaptive derivative threshold algorithm, and template matching algorithm. The experimental results indicated that Spark efficiently improves the online analysis. Meanwhile, the online visualization and sharing of multiple types of data in the web browser were implemented. Our prototype platform provides a solution for web-based sharing and analysis of plant electrophysiological multi-source data and improves the comprehension of plant electrical signals from a systemic perspective.
topic plant electrical signals
online analysis
parallelization
Spark
Hadoop
web system
url https://www.mdpi.com/2076-3417/8/11/2269
work_keys_str_mv AT chaosong plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform
AT xiaohuangqin plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform
AT qiaozhou plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform
AT ziyangwang plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform
AT weiheliu plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform
AT junli plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform
AT lanhuang plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform
AT yangchen plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform
AT guiliangtang plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform
AT dongjiezhao plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform
AT zhongyiwang plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform
_version_ 1725189909279408128