Computer Science · Computer Networks and Communications
Using SAM datahandling in processing large data volumes
Stefan Stonjek, Morag Burgon-lyon, Richard St. Denis, Valeria Bartsch, Todd Hufmann, Elliot Lipeles, Frank Würthwein
See on the mapAbstract
SAM is the new, grid enabled datahandling system of the CDF experiment at Fermilab. Its core capabilities are storing metadata and locations for data files and transferring the files to the nodes to process them. The system is known to work for physics analysis jobs. To accommodate the compute needs for physics analysis jobs, CDF introduced the CAF batch farm system. Now SAM and CAF are used together to allow the reprocessing of large dataset on big compute farms. The problems faced during the transition and their solutions will be discussed. 1