Keyword Search in Decentralized Storage Systems

The emerging decentralized storage systems (DSSs), such as InterPlanetary File System (IPFS), Storj, and Sia, provide people with a new storage model. Instead of being centrally managed, the data are sliced up and distributed across the nodes of the network. Furthermore, each data object is uniquely...

Full description

Bibliographic Details
Main Authors: Liyan Zhu, Chuqiao Xiao, Xueqing Gong
Format: Article
Language:English
Published: MDPI AG 2020-12-01
Series:Electronics
Subjects:
Online Access:https://www.mdpi.com/2079-9292/9/12/2041
id doaj-8ff06f7039464d018975ac8b4c75d78e
record_format Article
spelling doaj-8ff06f7039464d018975ac8b4c75d78e2020-12-03T00:01:19ZengMDPI AGElectronics2079-92922020-12-0192041204110.3390/electronics9122041Keyword Search in Decentralized Storage SystemsLiyan Zhu0Chuqiao Xiao1Xueqing Gong2School of Software Engineering, East China Normal University, Shanghai 200062, ChinaSchool of Software Engineering, East China Normal University, Shanghai 200062, ChinaSchool of Software Engineering, East China Normal University, Shanghai 200062, ChinaThe emerging decentralized storage systems (DSSs), such as InterPlanetary File System (IPFS), Storj, and Sia, provide people with a new storage model. Instead of being centrally managed, the data are sliced up and distributed across the nodes of the network. Furthermore, each data object is uniquely identified by a cryptographic hash (ObjectId) and can only be retrieved by ObjectId. Compared with the search functions provided by the existing centralized storage systems, the application scenarios of the DSSs are subject to certain restrictions. In this paper, we first apply decentralized B+Tree and HashMap to the DSSs to provide keyword search. Both indexes are kept in blocks. Since these blocks may be scattered on multiple nodes, we ensure that all operations involve as few blocks as possible to reduce network cost and response time. In addition, the version control and version merging algorithms are designed to effectively organize the indexes and facilitate data integration. The experimental results prove that our indexes have excellent availability and scalability.https://www.mdpi.com/2079-9292/9/12/2041decentralized storage systemskeyword searchdecentralized B+Treedecentralized HashMap
collection DOAJ
language English
format Article
sources DOAJ
author Liyan Zhu
Chuqiao Xiao
Xueqing Gong
spellingShingle Liyan Zhu
Chuqiao Xiao
Xueqing Gong
Keyword Search in Decentralized Storage Systems
Electronics
decentralized storage systems
keyword search
decentralized B+Tree
decentralized HashMap
author_facet Liyan Zhu
Chuqiao Xiao
Xueqing Gong
author_sort Liyan Zhu
title Keyword Search in Decentralized Storage Systems
title_short Keyword Search in Decentralized Storage Systems
title_full Keyword Search in Decentralized Storage Systems
title_fullStr Keyword Search in Decentralized Storage Systems
title_full_unstemmed Keyword Search in Decentralized Storage Systems
title_sort keyword search in decentralized storage systems
publisher MDPI AG
series Electronics
issn 2079-9292
publishDate 2020-12-01
description The emerging decentralized storage systems (DSSs), such as InterPlanetary File System (IPFS), Storj, and Sia, provide people with a new storage model. Instead of being centrally managed, the data are sliced up and distributed across the nodes of the network. Furthermore, each data object is uniquely identified by a cryptographic hash (ObjectId) and can only be retrieved by ObjectId. Compared with the search functions provided by the existing centralized storage systems, the application scenarios of the DSSs are subject to certain restrictions. In this paper, we first apply decentralized B+Tree and HashMap to the DSSs to provide keyword search. Both indexes are kept in blocks. Since these blocks may be scattered on multiple nodes, we ensure that all operations involve as few blocks as possible to reduce network cost and response time. In addition, the version control and version merging algorithms are designed to effectively organize the indexes and facilitate data integration. The experimental results prove that our indexes have excellent availability and scalability.
topic decentralized storage systems
keyword search
decentralized B+Tree
decentralized HashMap
url https://www.mdpi.com/2079-9292/9/12/2041
work_keys_str_mv AT liyanzhu keywordsearchindecentralizedstoragesystems
AT chuqiaoxiao keywordsearchindecentralizedstoragesystems
AT xueqinggong keywordsearchindecentralizedstoragesystems
_version_ 1724401751701848064