Customized Interfaces for Modern Storage Devices
In the past decade, we have seen two major evolutions on storage technologies: flash storage and non-volatile memory. These storage technologies are both vastly different in their properties and implementations than the disk-based storage devices that current soft- ware stacks and applications have...
Main Author: | |
---|---|
Format: | Others |
Published: |
FIU Digital Commons
2017
|
Subjects: | |
Online Access: | http://digitalcommons.fiu.edu/etd/3165 http://digitalcommons.fiu.edu/cgi/viewcontent.cgi?article=4234&context=etd |
id |
ndltd-fiu.edu-oai-digitalcommons.fiu.edu-etd-4234 |
---|---|
record_format |
oai_dc |
spelling |
ndltd-fiu.edu-oai-digitalcommons.fiu.edu-etd-42342018-01-05T15:34:48Z Customized Interfaces for Modern Storage Devices Marmol, Leonardo In the past decade, we have seen two major evolutions on storage technologies: flash storage and non-volatile memory. These storage technologies are both vastly different in their properties and implementations than the disk-based storage devices that current soft- ware stacks and applications have been built for and optimized over several decades. The second major trend that the industry has been witnessing is new classes of applications that are moving away from the conventional ACID (SQL) database access to storage. The resulting new class of NoSQL and in-memory storage applications consume storage using entirely new application programmer interfaces than their predecessors. The most significant outcome given these trends is that there is a great mismatch in terms of both application access interfaces and implementations of storage stacks when consuming these new technologies. In this work, we study the unique, intrinsic properties of current and next-generation storage technologies and propose new interfaces that allow application developers to get the most out of these storage technologies without having to become storage experts them- selves. We first build a new type of NoSQL key-value (KV) store that is FTL-aware rather than flash optimized. Our novel FTL cooperative design for KV store proofed to simplify development and outperformed state of the art KV stores, while reducing write amplification. Next, to address the growing relevance of byte-addressable persistent memory, we build a new type of KV store that is customized and optimized for persistent memory. The resulting KV store illustrates how to program persistent effectively while exposing a simpler interface and performing better than more general solutions. As the final component of the thesis, we build a generic, native storage solution for byte-addressable persistent memory. This new solution provides the most generic interface to applications, allow- ing applications to store and manipulate arbitrarily structured data with strong durability and consistency properties. With this new solution, existing applications as well as new “green field” applications will get to experience native performance and interfaces that are customized for the next storage technology evolution. 2017-03-31T07:00:00Z text application/pdf http://digitalcommons.fiu.edu/etd/3165 http://digitalcommons.fiu.edu/cgi/viewcontent.cgi?article=4234&context=etd http://creativecommons.org/licenses/by/4.0/ FIU Electronic Theses and Dissertations FIU Digital Commons Computer Science Computer Sciences Physical Sciences and Mathematics |
collection |
NDLTD |
format |
Others
|
sources |
NDLTD |
topic |
Computer Science Computer Sciences Physical Sciences and Mathematics |
spellingShingle |
Computer Science Computer Sciences Physical Sciences and Mathematics Marmol, Leonardo Customized Interfaces for Modern Storage Devices |
description |
In the past decade, we have seen two major evolutions on storage technologies: flash storage and non-volatile memory. These storage technologies are both vastly different in their properties and implementations than the disk-based storage devices that current soft- ware stacks and applications have been built for and optimized over several decades. The second major trend that the industry has been witnessing is new classes of applications that are moving away from the conventional ACID (SQL) database access to storage. The resulting new class of NoSQL and in-memory storage applications consume storage using entirely new application programmer interfaces than their predecessors. The most significant outcome given these trends is that there is a great mismatch in terms of both application access interfaces and implementations of storage stacks when consuming these new technologies.
In this work, we study the unique, intrinsic properties of current and next-generation storage technologies and propose new interfaces that allow application developers to get the most out of these storage technologies without having to become storage experts them- selves. We first build a new type of NoSQL key-value (KV) store that is FTL-aware rather than flash optimized. Our novel FTL cooperative design for KV store proofed to simplify development and outperformed state of the art KV stores, while reducing write amplification. Next, to address the growing relevance of byte-addressable persistent memory, we build a new type of KV store that is customized and optimized for persistent memory. The resulting KV store illustrates how to program persistent effectively while exposing a simpler interface and performing better than more general solutions. As the final component of the thesis, we build a generic, native storage solution for byte-addressable persistent memory. This new solution provides the most generic interface to applications, allow- ing applications to store and manipulate arbitrarily structured data with strong durability and consistency properties. With this new solution, existing applications as well as new “green field” applications will get to experience native performance and interfaces that are customized for the next storage technology evolution. |
author |
Marmol, Leonardo |
author_facet |
Marmol, Leonardo |
author_sort |
Marmol, Leonardo |
title |
Customized Interfaces for Modern Storage Devices |
title_short |
Customized Interfaces for Modern Storage Devices |
title_full |
Customized Interfaces for Modern Storage Devices |
title_fullStr |
Customized Interfaces for Modern Storage Devices |
title_full_unstemmed |
Customized Interfaces for Modern Storage Devices |
title_sort |
customized interfaces for modern storage devices |
publisher |
FIU Digital Commons |
publishDate |
2017 |
url |
http://digitalcommons.fiu.edu/etd/3165 http://digitalcommons.fiu.edu/cgi/viewcontent.cgi?article=4234&context=etd |
work_keys_str_mv |
AT marmolleonardo customizedinterfacesformodernstoragedevices |
_version_ |
1718581662904745984 |