Dynamo: Handling Scientific Data Across Sites and Storage Media

Dynamo: Handling Scientific Data Across Sites and Storage Media

Abstract Dynamo is a full-stack software solution for scientific data management. Dynamo's architecture is modular, extensible, and customizable, making the software suitable for managing data in a wide range of installation scales, from a few terabytes stored at a single location to hundreds o...

Full description

Bibliographic Details
Main Authors: Iiyama, Yutaro (Author), Maier, Benedikt (Author), Abercrombie, Daniel (Author), Goncharov, Maxim (Author), Paus, Christoph (Author)
Format: Article
Language:English
Published: Springer International Publishing, 2021-11-01T14:33:16Z.
Subjects:
Article
Online Access:Get fulltext
Description
Summary:Abstract Dynamo is a full-stack software solution for scientific data management. Dynamo's architecture is modular, extensible, and customizable, making the software suitable for managing data in a wide range of installation scales, from a few terabytes stored at a single location to hundreds of petabytes distributed across a worldwide computing grid. This article documents the core system design of Dynamo and describes the applications that implement various data management tasks. A brief report is also given on the operational experiences of the system at the CMS experiment at the CERN Large Hadron Collider and at a small-scale analysis facility.

Similar Items