Multicore in production: advantages and limits of the multiprocess approach in the ATLAS experiment

S. Binet 1 P. Calafiura 2 M. K. Jha W. Lavrijsen 2 C. Leggett D. Lesny H. Severini D. Smith S. Snyder M. Tatarkhanov V. Tsulaia 2 P. Vangemmeren A. Washbrook
1 Informatique
LAL - Laboratoire de l'Accélérateur Linéaire
2 LBNL - Lawrence Berkeley National Laboratory [Berkeley]
Abstract : The shared memory architecture of multicore CPUs provides HEP developers with the opportunity to reduce the memory footprint of their applications by sharing memory pages between the cores in a processor. ATLAS pioneered the multi-process approach to parallelize HEP applications. Using Linux fork() and the Copy On Write mechanism we implemented a simple event task farm, which allowed us to achieve sharing of almost 80% of memory pages among event worker processes for certain types of reconstruction jobs with negligible CPU overhead. By leaving the task of managing shared memory pages to the operating system, we have been able to parallelize large reconstruction and simulation applications originally written to be run in a single thread of execution with little to no change to the application code. The process of validating AthenaMP for production took ten months of concentrated effort and is expected to continue for several more months. Besides validating the software itself, an important and time-consuming aspect of running multicore applications in production was to configure the ATLAS distributed production system to handle multicore jobs. This entailed defining multicore batch queues, where the unit resource is not a core, but a whole computing node; monitoring the output of many event workers; and adapting the job definition layer to handle computing resources with different event throughputs. We will present scalability and memory usage studies, based on data gathered both on dedicated hardware and at the CERN Computer Center.
Type de document :
Communication dans un congrès
Liste complète des métadonnées
http://hal.in2p3.fr/in2p3-00714479
Contributeur : Sabine Starita <>
Soumis le : mercredi 4 juillet 2012 - 16:46:16
Dernière modification le : jeudi 11 janvier 2018 - 06:26:23

Lien texte intégral

openaccess

Identifiants

Collections

IN2P3 | LAL | CNRS

Citation

S. Binet, P. Calafiura, M. K. Jha, W. Lavrijsen, C. Leggett, et al.. Multicore in production: advantages and limits of the multiprocess approach in the ATLAS experiment. 14th International Workshop on Advanced Computing and Analysis Techniques in Physics Research (ACAT 2011), Sep 2011, Uxbridge, United Kingdom. pp.012018, ⟨10.1088/1742-6596/368/1/012018⟩. ⟨in2p3-00714479⟩

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de la notice

133

Contact

Informations

CCSD