HyperBSA: A High-Performance Consortium Blockchain Storage Architecture for Massive Data

With the considerable exploration of blockchain in various industrial fields, the storage architectures of mainstream consortium blockchains exhibit significant performance limitations, which can't meet the requirements of efficient data access with massive data storage in enterprise-level busi...

Full description

Bibliographic Details
Main Authors: Xiao Chen, Kejie Zhang, Xiubo Liang, Weiwei Qiu, Zhigang Zhang, Ding Tu
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9208749/
id doaj-5ba780bfe4e6480397475f6edcd54a52
record_format Article
spelling doaj-5ba780bfe4e6480397475f6edcd54a522021-03-30T04:50:33ZengIEEEIEEE Access2169-35362020-01-01817840217841310.1109/ACCESS.2020.30276109208749HyperBSA: A High-Performance Consortium Blockchain Storage Architecture for Massive DataXiao Chen0Kejie Zhang1Xiubo Liang2https://orcid.org/0000-0002-4749-5552Weiwei Qiu3Zhigang Zhang4Ding Tu5CFETS Information Technology (Shanghai) Company Ltd., Shanghai, ChinaHangzhou Qulian Technology Company Ltd., Hangzhou, ChinaCollege of Software Technology, Zhejiang University, Ningbo, ChinaHangzhou Qulian Technology Company Ltd., Hangzhou, ChinaCFETS Information Technology (Shanghai) Company Ltd., Shanghai, ChinaCFETS Information Technology (Shanghai) Company Ltd., Shanghai, ChinaWith the considerable exploration of blockchain in various industrial fields, the storage architectures of mainstream consortium blockchains exhibit significant performance limitations, which can't meet the requirements of efficient data access with massive data storage in enterprise-level business scenarios. In this paper, we creatively divided the underlying data of the consortium blockchain into two categories: continuous data and state data and proposed a new storage architecture to store and operate these two types of data efficiently. For continuous data, we designed a specialized index-based storage engine. For state data, we proposed a multi-level cache mechanism with a secure and integrated data persistence policy. In addition, a pluggable Client/Server mode is employed to achieve flexible distributed extension. A series of experiments are conducted to show the effectiveness of our architecture. Compared with mainstream consortium blockchain storage architecture based on LevelDB, the average time-consuming decreases 81.85%/82.47% for reading/writing continuous data and 22.21%/48.99% for reading/writing state data. Compared with the storage architecture based on distributed database TiKV, the time-consuming decreases more significantly. This storage architecture has been integrated into the enterprise-level consortium blockchain platform Hyperchain, which has supported the efficient running of dozens of large-scale commercial blockchain projects with massive data.https://ieeexplore.ieee.org/document/9208749/Consortium blockchainstorage architecturecontinuous datastate datadistributed extension
collection DOAJ
language English
format Article
sources DOAJ
author Xiao Chen
Kejie Zhang
Xiubo Liang
Weiwei Qiu
Zhigang Zhang
Ding Tu
spellingShingle Xiao Chen
Kejie Zhang
Xiubo Liang
Weiwei Qiu
Zhigang Zhang
Ding Tu
HyperBSA: A High-Performance Consortium Blockchain Storage Architecture for Massive Data
IEEE Access
Consortium blockchain
storage architecture
continuous data
state data
distributed extension
author_facet Xiao Chen
Kejie Zhang
Xiubo Liang
Weiwei Qiu
Zhigang Zhang
Ding Tu
author_sort Xiao Chen
title HyperBSA: A High-Performance Consortium Blockchain Storage Architecture for Massive Data
title_short HyperBSA: A High-Performance Consortium Blockchain Storage Architecture for Massive Data
title_full HyperBSA: A High-Performance Consortium Blockchain Storage Architecture for Massive Data
title_fullStr HyperBSA: A High-Performance Consortium Blockchain Storage Architecture for Massive Data
title_full_unstemmed HyperBSA: A High-Performance Consortium Blockchain Storage Architecture for Massive Data
title_sort hyperbsa: a high-performance consortium blockchain storage architecture for massive data
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description With the considerable exploration of blockchain in various industrial fields, the storage architectures of mainstream consortium blockchains exhibit significant performance limitations, which can't meet the requirements of efficient data access with massive data storage in enterprise-level business scenarios. In this paper, we creatively divided the underlying data of the consortium blockchain into two categories: continuous data and state data and proposed a new storage architecture to store and operate these two types of data efficiently. For continuous data, we designed a specialized index-based storage engine. For state data, we proposed a multi-level cache mechanism with a secure and integrated data persistence policy. In addition, a pluggable Client/Server mode is employed to achieve flexible distributed extension. A series of experiments are conducted to show the effectiveness of our architecture. Compared with mainstream consortium blockchain storage architecture based on LevelDB, the average time-consuming decreases 81.85%/82.47% for reading/writing continuous data and 22.21%/48.99% for reading/writing state data. Compared with the storage architecture based on distributed database TiKV, the time-consuming decreases more significantly. This storage architecture has been integrated into the enterprise-level consortium blockchain platform Hyperchain, which has supported the efficient running of dozens of large-scale commercial blockchain projects with massive data.
topic Consortium blockchain
storage architecture
continuous data
state data
distributed extension
url https://ieeexplore.ieee.org/document/9208749/
work_keys_str_mv AT xiaochen hyperbsaahighperformanceconsortiumblockchainstoragearchitectureformassivedata
AT kejiezhang hyperbsaahighperformanceconsortiumblockchainstoragearchitectureformassivedata
AT xiuboliang hyperbsaahighperformanceconsortiumblockchainstoragearchitectureformassivedata
AT weiweiqiu hyperbsaahighperformanceconsortiumblockchainstoragearchitectureformassivedata
AT zhigangzhang hyperbsaahighperformanceconsortiumblockchainstoragearchitectureformassivedata
AT dingtu hyperbsaahighperformanceconsortiumblockchainstoragearchitectureformassivedata
_version_ 1724181100092194816