A Spark-Based High Performance Computational Approach for Simulating Typhoon Wind Fields

The impacts of typhoons on coastal areas around the globe necessitate the risk assessments of typhoon events to analyze their paths, intensity, and impacts on the environment for disaster prevention and reduction as well as for the scientific assessments of typhoon impacts. To this end, the typhoon...

Full description

Bibliographic Details
Main Authors: Shaofu Lin, Weihua Fang, Xinyu Wu, Yiran Chen, Zhou Huang
Format: Article
Language:English
Published: IEEE 2018-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8396261/
id doaj-343274876a4649a7abf4ac75ece605da
record_format Article
spelling doaj-343274876a4649a7abf4ac75ece605da2021-03-29T21:05:38ZengIEEEIEEE Access2169-35362018-01-016390723908510.1109/ACCESS.2018.28507688396261A Spark-Based High Performance Computational Approach for Simulating Typhoon Wind FieldsShaofu Lin0Weihua Fang1Xinyu Wu2Yiran Chen3https://orcid.org/0000-0001-6626-5413Zhou Huang4https://orcid.org/0000-0002-1255-1913Beijing Advanced Innovation Center for Future Internet Technology, Beijing University of Technology, Beijing, ChinaKey Laboratory of Environmental Change and Natural Disaster of Ministry of Education, Faculty of Geographical Science, Beijing Normal University, Beijing, ChinaInstitute of Remote Sensing and Geographical Information Systems, Peking University, Beijing, ChinaInstitute of Remote Sensing and Geographical Information Systems, Peking University, Beijing, ChinaInstitute of Remote Sensing and Geographical Information Systems, Peking University, Beijing, ChinaThe impacts of typhoons on coastal areas around the globe necessitate the risk assessments of typhoon events to analyze their paths, intensity, and impacts on the environment for disaster prevention and reduction as well as for the scientific assessments of typhoon impacts. To this end, the typhoon wind field needs to be obtained by inversion to attain its temporal and spatial scopes of influence and disaster-inducing intensities using simulation algorithms that are based on the existing typhoon path data. The wind field calculation is a typical kind of compute-intensive processing. It is time-consuming (especially when the temporal resolution and the spatial resolution are high) to an extent, which makes it difficult for a traditional stand-alone computation to meet the application needs for typhoon risk assessments. Therefore, studies need to be conducted to accelerate the wind field calculations. Currently, the most economical and relatively feasible method is to rapidly generate a large quantity of typhoon risk data using multi-thread, graphics processing unit computing or clustering technologies (e.g., cloud computing). Hence, we have attempted to use the latest cloud computing framework, Spark, for the rapid simulation of the typhoon wind field. This paper proposed a storage model for typhoon paths and wind fields under the Spark environment, as well as a wind field parallel acceleration method based on Spark. Using this approach, we have calculated a total of 1038 historical wind fields that impacted the northwestern Pacific Ocean from 1949 to 2014. The results indicate that the Spark-based wind field computation method proposed in this paper has a greater advantage in terms of performance, which facilitates the typhoon risk assessment feasibility.https://ieeexplore.ieee.org/document/8396261/Typhoon windrisk assessmentcloud computingSparkgeographic information system
collection DOAJ
language English
format Article
sources DOAJ
author Shaofu Lin
Weihua Fang
Xinyu Wu
Yiran Chen
Zhou Huang
spellingShingle Shaofu Lin
Weihua Fang
Xinyu Wu
Yiran Chen
Zhou Huang
A Spark-Based High Performance Computational Approach for Simulating Typhoon Wind Fields
IEEE Access
Typhoon wind
risk assessment
cloud computing
Spark
geographic information system
author_facet Shaofu Lin
Weihua Fang
Xinyu Wu
Yiran Chen
Zhou Huang
author_sort Shaofu Lin
title A Spark-Based High Performance Computational Approach for Simulating Typhoon Wind Fields
title_short A Spark-Based High Performance Computational Approach for Simulating Typhoon Wind Fields
title_full A Spark-Based High Performance Computational Approach for Simulating Typhoon Wind Fields
title_fullStr A Spark-Based High Performance Computational Approach for Simulating Typhoon Wind Fields
title_full_unstemmed A Spark-Based High Performance Computational Approach for Simulating Typhoon Wind Fields
title_sort spark-based high performance computational approach for simulating typhoon wind fields
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2018-01-01
description The impacts of typhoons on coastal areas around the globe necessitate the risk assessments of typhoon events to analyze their paths, intensity, and impacts on the environment for disaster prevention and reduction as well as for the scientific assessments of typhoon impacts. To this end, the typhoon wind field needs to be obtained by inversion to attain its temporal and spatial scopes of influence and disaster-inducing intensities using simulation algorithms that are based on the existing typhoon path data. The wind field calculation is a typical kind of compute-intensive processing. It is time-consuming (especially when the temporal resolution and the spatial resolution are high) to an extent, which makes it difficult for a traditional stand-alone computation to meet the application needs for typhoon risk assessments. Therefore, studies need to be conducted to accelerate the wind field calculations. Currently, the most economical and relatively feasible method is to rapidly generate a large quantity of typhoon risk data using multi-thread, graphics processing unit computing or clustering technologies (e.g., cloud computing). Hence, we have attempted to use the latest cloud computing framework, Spark, for the rapid simulation of the typhoon wind field. This paper proposed a storage model for typhoon paths and wind fields under the Spark environment, as well as a wind field parallel acceleration method based on Spark. Using this approach, we have calculated a total of 1038 historical wind fields that impacted the northwestern Pacific Ocean from 1949 to 2014. The results indicate that the Spark-based wind field computation method proposed in this paper has a greater advantage in terms of performance, which facilitates the typhoon risk assessment feasibility.
topic Typhoon wind
risk assessment
cloud computing
Spark
geographic information system
url https://ieeexplore.ieee.org/document/8396261/
work_keys_str_mv AT shaofulin asparkbasedhighperformancecomputationalapproachforsimulatingtyphoonwindfields
AT weihuafang asparkbasedhighperformancecomputationalapproachforsimulatingtyphoonwindfields
AT xinyuwu asparkbasedhighperformancecomputationalapproachforsimulatingtyphoonwindfields
AT yiranchen asparkbasedhighperformancecomputationalapproachforsimulatingtyphoonwindfields
AT zhouhuang asparkbasedhighperformancecomputationalapproachforsimulatingtyphoonwindfields
AT shaofulin sparkbasedhighperformancecomputationalapproachforsimulatingtyphoonwindfields
AT weihuafang sparkbasedhighperformancecomputationalapproachforsimulatingtyphoonwindfields
AT xinyuwu sparkbasedhighperformancecomputationalapproachforsimulatingtyphoonwindfields
AT yiranchen sparkbasedhighperformancecomputationalapproachforsimulatingtyphoonwindfields
AT zhouhuang sparkbasedhighperformancecomputationalapproachforsimulatingtyphoonwindfields
_version_ 1724193529815629824