arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Computer Science · Computer Networks and Communications

Building a scientific data grid with DiGS.

Beckett, MG, Allton, CR, Davies, CT, Davis, I, Flynn, JM, Grant, EJ, Hamilton, RS, Irving, AC, Kenway, RD, Ostrowski, RH, Perry, JT, Swedlow, JR

· Oxford University Research Archive (ORA) (University of Oxford)

See on the map

Abstract

We provide an insight into the challenge of building and supporting a scientific data infrastructure with reference to our experience working with scientists from computational particle physics and molecular biology. We illustrate how, with modern high-performance computing resources, even small scientific groups can generate huge volumes (petabytes) of valuable scientific data and explain how grid technology can be used to manage, publish, share and curate these data. We describe the DiGS software application, which we have developed to meet the needs of smaller communities and we have highlighted the key elements of its functionality.

More like this