DIRAC pilot framework and the DIRAC Workload Management System - IN2P3 - Institut national de physique nucléaire et de physique des particules Access content directly
Conference Papers Year : 2010

DIRAC pilot framework and the DIRAC Workload Management System

A. Casajus
  • Function : Author
R. Graciani
  • Function : Author
S. Paterson
  • Function : Author

Abstract

DIRAC, the LHCb community Grid solution, has pioneered the use of pilot jobs in the Grid. Pilot Jobs provide a homogeneous interface to an heterogeneous set of computing resources. At the same time, Pilot Jobs allow to delay the scheduling decision to the last moment, thus taking into account the precise running conditions at the resource and last moment requests to the system. The DIRAC Workload Management System provides one single scheduling mechanism for jobs with very different profiles. To achieve an overall optimisation, it organizes pending jobs in task queues, both for individual users and production activities. Task queues are created with jobs having similar requirements. Following the VO policy a priority is assigned to each task queue. Pilot submission and subsequent job matching are based on these priorities following a statistical approach.

Dates and versions

in2p3-00737583 , version 1 (02-10-2012)

Identifiers

Cite

A. Casajus, R. Graciani, S. Paterson, A. Tsaregorodtsev. DIRAC pilot framework and the DIRAC Workload Management System. 17th International Conference on Computing in High Energy and Nuclear Physics (CHEP09), Mar 2009, Prague, Czech Republic. pp.062049, ⟨10.1088/1742-6596/219/6/062049⟩. ⟨in2p3-00737583⟩
20 View
0 Download

Altmetric

Share

Gmail Facebook X LinkedIn More