PlantES: A Plant Electrophysiological Multi-Source Data Online Analysis and Sharing Platform
At present, plant electrophysiological data volumes and complexity are increasing rapidly. It causes the demand for efficient management of big data, data sharing among research groups, and fast analysis. In this paper, we proposed PlantES (Plant Electrophysiological Data Sharing), a distributed com...
Main Authors: | , , , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2018-11-01
|
Series: | Applied Sciences |
Subjects: | |
Online Access: | https://www.mdpi.com/2076-3417/8/11/2269 |
id |
doaj-049d0f8d3a1c44d8a5f3efc21969fd93 |
---|---|
record_format |
Article |
spelling |
doaj-049d0f8d3a1c44d8a5f3efc21969fd932020-11-25T01:06:29ZengMDPI AGApplied Sciences2076-34172018-11-01811226910.3390/app8112269app8112269PlantES: A Plant Electrophysiological Multi-Source Data Online Analysis and Sharing PlatformChao Song0Xiao-Huang Qin1Qiao Zhou2Zi-Yang Wang3Wei-He Liu4Jun Li5Lan Huang6Yang Chen7Guiliang Tang8Dong-Jie Zhao9Zhong-Yi Wang10College of Information and Electrical Engineering, China Agricultural University, Beijing 100083, ChinaCollege of Information and Electrical Engineering, China Agricultural University, Beijing 100083, ChinaCollege of Information and Electrical Engineering, China Agricultural University, Beijing 100083, ChinaCollege of Information and Electrical Engineering, China Agricultural University, Beijing 100083, ChinaCollege of Information and Electrical Engineering, China Agricultural University, Beijing 100083, ChinaCollege of Information and Electrical Engineering, China Agricultural University, Beijing 100083, ChinaCollege of Information and Electrical Engineering, China Agricultural University, Beijing 100083, ChinaThe Jackson Laboratory for Genomic Medicine, Farmington, CT 06032, USADepartment of Biological Sciences, Michigan Technological University, Houghton, MI 49931-1295, USAInstitute for Future, Qingdao University, Qingdao 266071, ChinaCollege of Information and Electrical Engineering, China Agricultural University, Beijing 100083, ChinaAt present, plant electrophysiological data volumes and complexity are increasing rapidly. It causes the demand for efficient management of big data, data sharing among research groups, and fast analysis. In this paper, we proposed PlantES (Plant Electrophysiological Data Sharing), a distributed computing-based prototype system that can be used to store, manage, visualize, analyze, and share plant electrophysiological data. We deliberately designed a storage schema to manage the multi-source plant electrophysiological data by integrating distributed storage systems HDFS and HBase to access all kinds of files efficiently. To improve the online analysis efficiency, parallel computing algorithms on Spark were proposed and implemented, e.g., plant electrical signals extraction method, the adaptive derivative threshold algorithm, and template matching algorithm. The experimental results indicated that Spark efficiently improves the online analysis. Meanwhile, the online visualization and sharing of multiple types of data in the web browser were implemented. Our prototype platform provides a solution for web-based sharing and analysis of plant electrophysiological multi-source data and improves the comprehension of plant electrical signals from a systemic perspective.https://www.mdpi.com/2076-3417/8/11/2269plant electrical signalsonline analysisparallelizationSparkHadoopweb system |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Chao Song Xiao-Huang Qin Qiao Zhou Zi-Yang Wang Wei-He Liu Jun Li Lan Huang Yang Chen Guiliang Tang Dong-Jie Zhao Zhong-Yi Wang |
spellingShingle |
Chao Song Xiao-Huang Qin Qiao Zhou Zi-Yang Wang Wei-He Liu Jun Li Lan Huang Yang Chen Guiliang Tang Dong-Jie Zhao Zhong-Yi Wang PlantES: A Plant Electrophysiological Multi-Source Data Online Analysis and Sharing Platform Applied Sciences plant electrical signals online analysis parallelization Spark Hadoop web system |
author_facet |
Chao Song Xiao-Huang Qin Qiao Zhou Zi-Yang Wang Wei-He Liu Jun Li Lan Huang Yang Chen Guiliang Tang Dong-Jie Zhao Zhong-Yi Wang |
author_sort |
Chao Song |
title |
PlantES: A Plant Electrophysiological Multi-Source Data Online Analysis and Sharing Platform |
title_short |
PlantES: A Plant Electrophysiological Multi-Source Data Online Analysis and Sharing Platform |
title_full |
PlantES: A Plant Electrophysiological Multi-Source Data Online Analysis and Sharing Platform |
title_fullStr |
PlantES: A Plant Electrophysiological Multi-Source Data Online Analysis and Sharing Platform |
title_full_unstemmed |
PlantES: A Plant Electrophysiological Multi-Source Data Online Analysis and Sharing Platform |
title_sort |
plantes: a plant electrophysiological multi-source data online analysis and sharing platform |
publisher |
MDPI AG |
series |
Applied Sciences |
issn |
2076-3417 |
publishDate |
2018-11-01 |
description |
At present, plant electrophysiological data volumes and complexity are increasing rapidly. It causes the demand for efficient management of big data, data sharing among research groups, and fast analysis. In this paper, we proposed PlantES (Plant Electrophysiological Data Sharing), a distributed computing-based prototype system that can be used to store, manage, visualize, analyze, and share plant electrophysiological data. We deliberately designed a storage schema to manage the multi-source plant electrophysiological data by integrating distributed storage systems HDFS and HBase to access all kinds of files efficiently. To improve the online analysis efficiency, parallel computing algorithms on Spark were proposed and implemented, e.g., plant electrical signals extraction method, the adaptive derivative threshold algorithm, and template matching algorithm. The experimental results indicated that Spark efficiently improves the online analysis. Meanwhile, the online visualization and sharing of multiple types of data in the web browser were implemented. Our prototype platform provides a solution for web-based sharing and analysis of plant electrophysiological multi-source data and improves the comprehension of plant electrical signals from a systemic perspective. |
topic |
plant electrical signals online analysis parallelization Spark Hadoop web system |
url |
https://www.mdpi.com/2076-3417/8/11/2269 |
work_keys_str_mv |
AT chaosong plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform AT xiaohuangqin plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform AT qiaozhou plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform AT ziyangwang plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform AT weiheliu plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform AT junli plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform AT lanhuang plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform AT yangchen plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform AT guiliangtang plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform AT dongjiezhao plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform AT zhongyiwang plantesaplantelectrophysiologicalmultisourcedataonlineanalysisandsharingplatform |
_version_ |
1725189909279408128 |