arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

G Adde

5 papers · 2014–2017

2014: 22015: 22016: 02017: 1
2014peak 2 in 20142017

Frequent co-authors

Papers

showing 1–5 of 5 RSS

EOS as the present and future solution for data storage at CERN

AJ Peters, EA Sindrilaru, G Adde

Computer Networks and Communications · Journal of Physics Conference Series · · cited 72× · DOI ↗ · more like this ·

EOS is an open source distributed disk storage system in production since 2011 at CERN. Development focus has been on low-latency analysis use cases for LHC(1) and non- LHC experiments and life-cycle management using JBOD(2) hardware for multi PB storage installations. The EOS design implies a split of hot and cold storage and introduced a change of the traditional HSM(3) functionality based workflows at CERN.The 2015 deployment brings storage at CERN to a new scale and foresees to breach 100 PB of disk storage in a distributed environment using tens of thousands of (heterogeneous) hard drives. EOS has brought to CERN major improvements compared to past storage solutions by allowing quick changes in the quality of service of the storage pools. This allows the data centre to quickly meet the changing performance and reliability requirements of the LHC experiments with minimal data…

Disk storage at CERN: Handling LHC data and beyond

X Espinal, G Adde, Belinda Chan +8 more

Computer Networks and Communications · Journal of Physics Conference Series · · cited 14× · DOI ↗ · more like this ·

The CERN-IT Data Storage and Services (DSS) group stores and provides access to data coming from the LHC and other physics experiments. We implement specialised storage services to provide tools for optimal data management, based on the evolution of data volumes, the available technologies and the observed experiment and users' usage patterns. Our current solutions are CASTOR, for highly-reliable tape-backed storage for heavy-duty Tier-0 workflows, and EOS, for disk-only storage for full-scale analysis activities. CASTOR is evolving towards a simplified disk layer in front of the tape robotics, focusing on recording the primary data from the detectors. EOS is now a well-established storage service used intensively by the four big LHC experiments. Its conceptual design based on multi-replica and in-memory namespace, makes it the perfect system for data intensive workflows. The LHC-Long…

Latest evolution of EOS filesystem

G Adde, Belinda Chan, Dirk Duellmann +9 more

Computer Networks and Communications · Journal of Physics Conference Series · · cited 8× · DOI ↗ · more like this ·

EOS is an open source distributed filesystem developed and used mainly at CERN. It provides low latency, high availability, strong authentication, multiple replication schemas as well as multiple access protocols and features. Deployment and operations remain simple and EOS is currently being used by multiple experiments at CERN providing a total raw storage space of 86PB. A brief overview of EOS's architecture is given then its main and latest features are reviewed and some operations facts are reported. Finally, emphasis is laid on the new infrastructure aware file placement and access engine.

EOS developments

Elvin Alin Sindrilaru, Andreas Peters, G Adde +1 more

Computer Networks and Communications · Journal of Physics Conference Series · · cited 4× · DOI ↗ · more like this ·

CERN has been developing and operating EOS as a disk storage solution successfully for over 6 years. The CERN deployment provides 135 PB and stores 1.2 billion replicas distributed over two computer centres. Deployment includes four LHC instances, a shared instance for smaller experiments and since last year an instance for individual user data as well. The user instance represents the backbone of the CERNBOX service for file sharing. New use cases like synchronisation and sharing, the planned migration to reduce AFS usage at CERN and the continuous growth has brought EOS to new challenges. Recent developments include the integration and evaluation of various technologies to do the transition from a single active in-memory namespace to a scale-out implementation distributed over many meta-data servers. The new architecture aims to separate the data from the application logic and user…

Evaluation of the Huawei UDS cloud storage system for CERN specific data

Maitane Zotes Resines, Seppo Heikkilä, Dirk Duellmann +4 more

Computer Networks and Communications · Journal of Physics Conference Series · · cited 4× · DOI ↗ · more like this ·

Cloud storage is an emerging architecture aiming to provide increased scalability and access performance, compared to more traditional solutions. CERN is evaluating this promise using Huawei UDS and OpenStack SWIFT storage deployments, focusing on the needs of high-energy physics. Both deployed setups implement S3, one of the protocols that are emerging as a standard in the cloud storage market. A set of client machines is used to generate I/O load patterns to evaluate the storage system performance. The presented read and write test results indicate scalability both in metadata and data perspectives. Futher the Huawei UDS cloud storage is shown to be able to recover from a major failure of losing 16 disks. Both cloud storages are finally demonstrated to function as back-end storage systems to a filesystem, which is used to deliver high energy physics software.