A grid-based distributed database solution for large astronomy datasets

The volume of digital astronomical data is set to expand dramatically over the next ten years, as new satellites, telescopes and instruments come online. For example, both the VISTA [156] and DES [29] programmes will yield databases 20-30 terabytes in size in the coming decade. Storing and accessing...

Full description

Bibliographic Details
Main Author: Xiang, Helen X.
Published: University of Portsmouth 2008
Subjects:
Online Access:http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.494003
Description
Summary:The volume of digital astronomical data is set to expand dramatically over the next ten years, as new satellites, telescopes and instruments come online. For example, both the VISTA [156] and DES [29] programmes will yield databases 20-30 terabytes in size in the coming decade. Storing and accessing such large datasets will be challenging, especially as scientific analysis will require coordinated use of several of these separate multi-terabyte databases, since they will contain complementary data, typically from observations made in different regions of the spectrum. We are exploring the use of emerging distributed database technologies for the management and manipulation of very large astronomical datasets.