Customized Interfaces for Modern Storage Devices

In the past decade, we have seen two major evolutions on storage technologies: flash storage and non-volatile memory. These storage technologies are both vastly different in their properties and implementations than the disk-based storage devices that current soft- ware stacks and applications have...

Full description

Bibliographic Details
Main Author: Marmol, Leonardo
Format: Others
Published: FIU Digital Commons 2017
Subjects:
Online Access:http://digitalcommons.fiu.edu/etd/3165
http://digitalcommons.fiu.edu/cgi/viewcontent.cgi?article=4234&context=etd
id ndltd-fiu.edu-oai-digitalcommons.fiu.edu-etd-4234
record_format oai_dc
spelling ndltd-fiu.edu-oai-digitalcommons.fiu.edu-etd-42342018-01-05T15:34:48Z Customized Interfaces for Modern Storage Devices Marmol, Leonardo In the past decade, we have seen two major evolutions on storage technologies: flash storage and non-volatile memory. These storage technologies are both vastly different in their properties and implementations than the disk-based storage devices that current soft- ware stacks and applications have been built for and optimized over several decades. The second major trend that the industry has been witnessing is new classes of applications that are moving away from the conventional ACID (SQL) database access to storage. The resulting new class of NoSQL and in-memory storage applications consume storage using entirely new application programmer interfaces than their predecessors. The most significant outcome given these trends is that there is a great mismatch in terms of both application access interfaces and implementations of storage stacks when consuming these new technologies. In this work, we study the unique, intrinsic properties of current and next-generation storage technologies and propose new interfaces that allow application developers to get the most out of these storage technologies without having to become storage experts them- selves. We first build a new type of NoSQL key-value (KV) store that is FTL-aware rather than flash optimized. Our novel FTL cooperative design for KV store proofed to simplify development and outperformed state of the art KV stores, while reducing write amplification. Next, to address the growing relevance of byte-addressable persistent memory, we build a new type of KV store that is customized and optimized for persistent memory. The resulting KV store illustrates how to program persistent effectively while exposing a simpler interface and performing better than more general solutions. As the final component of the thesis, we build a generic, native storage solution for byte-addressable persistent memory. This new solution provides the most generic interface to applications, allow- ing applications to store and manipulate arbitrarily structured data with strong durability and consistency properties. With this new solution, existing applications as well as new “green field” applications will get to experience native performance and interfaces that are customized for the next storage technology evolution. 2017-03-31T07:00:00Z text application/pdf http://digitalcommons.fiu.edu/etd/3165 http://digitalcommons.fiu.edu/cgi/viewcontent.cgi?article=4234&context=etd http://creativecommons.org/licenses/by/4.0/ FIU Electronic Theses and Dissertations FIU Digital Commons Computer Science Computer Sciences Physical Sciences and Mathematics
collection NDLTD
format Others
sources NDLTD
topic Computer Science
Computer Sciences
Physical Sciences and Mathematics
spellingShingle Computer Science
Computer Sciences
Physical Sciences and Mathematics
Marmol, Leonardo
Customized Interfaces for Modern Storage Devices
description In the past decade, we have seen two major evolutions on storage technologies: flash storage and non-volatile memory. These storage technologies are both vastly different in their properties and implementations than the disk-based storage devices that current soft- ware stacks and applications have been built for and optimized over several decades. The second major trend that the industry has been witnessing is new classes of applications that are moving away from the conventional ACID (SQL) database access to storage. The resulting new class of NoSQL and in-memory storage applications consume storage using entirely new application programmer interfaces than their predecessors. The most significant outcome given these trends is that there is a great mismatch in terms of both application access interfaces and implementations of storage stacks when consuming these new technologies. In this work, we study the unique, intrinsic properties of current and next-generation storage technologies and propose new interfaces that allow application developers to get the most out of these storage technologies without having to become storage experts them- selves. We first build a new type of NoSQL key-value (KV) store that is FTL-aware rather than flash optimized. Our novel FTL cooperative design for KV store proofed to simplify development and outperformed state of the art KV stores, while reducing write amplification. Next, to address the growing relevance of byte-addressable persistent memory, we build a new type of KV store that is customized and optimized for persistent memory. The resulting KV store illustrates how to program persistent effectively while exposing a simpler interface and performing better than more general solutions. As the final component of the thesis, we build a generic, native storage solution for byte-addressable persistent memory. This new solution provides the most generic interface to applications, allow- ing applications to store and manipulate arbitrarily structured data with strong durability and consistency properties. With this new solution, existing applications as well as new “green field” applications will get to experience native performance and interfaces that are customized for the next storage technology evolution.
author Marmol, Leonardo
author_facet Marmol, Leonardo
author_sort Marmol, Leonardo
title Customized Interfaces for Modern Storage Devices
title_short Customized Interfaces for Modern Storage Devices
title_full Customized Interfaces for Modern Storage Devices
title_fullStr Customized Interfaces for Modern Storage Devices
title_full_unstemmed Customized Interfaces for Modern Storage Devices
title_sort customized interfaces for modern storage devices
publisher FIU Digital Commons
publishDate 2017
url http://digitalcommons.fiu.edu/etd/3165
http://digitalcommons.fiu.edu/cgi/viewcontent.cgi?article=4234&context=etd
work_keys_str_mv AT marmolleonardo customizedinterfacesformodernstoragedevices
_version_ 1718581662904745984