arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Computer Science · Computer Networks and Communications

Using SAM datahandling in processing large data volumes

Stefan Stonjek, Morag Burgon-lyon, Richard St. Denis, Valeria Bartsch, Todd Hufmann, Elliot Lipeles, Frank Würthwein

See on the map

Abstract

SAM is the new, grid enabled datahandling system of the CDF experiment at Fermilab. Its core capabilities are storing metadata and locations for data files and transferring the files to the nodes to process them. The system is known to work for physics analysis jobs. To accommodate the compute needs for physics analysis jobs, CDF introduced the CAF batch farm system. Now SAM and CAF are used together to allow the reprocessing of large dataset on big compute farms. The problems faced during the transition and their solutions will be discussed. 1

More like this