s'authentifier
version française rss feed
HAL : in2p3-00703324, version 1

Fiche concise  Récupérer au format
DIRAC File Replica and Metadata Catalog
Tsaregorodtsev A., Poss S.
Computing in high Energy and Nuclear Physics (CHEP2012), New-York : États-Unis (2012) - http://hal.in2p3.fr/in2p3-00703324
Informatique/Base de données
DIRAC File Replica and Metadata Catalog
A. Tsaregorodtsev1, S. Poss ()
1 :  CPPM - Centre de Physique des Particules de Marseille
http://marwww.in2p3.fr/
CNRS : UMR7346 – IN2P3 – Université de la Méditerranée - Aix-Marseille II
163, avenue de Luminy - Case 902 - 13288 Marseille cedex 09
France
File replica and metadata catalogs are essential parts of any distributed data management system, which are largely determining its functionality and performance. A new File Catalog (DFC) was developed in the framework of the DIRAC Project that combines both replica and metadata catalog functionality. The DFC design is based on the practical experience with the data management system of the LHCb Collaboration. It is optimized for the most common patterns of the catalog usage in order to achieve maximum performance from the user perspective. The DFC supports bulk operations for replica queries and allows quick analysis of the storage usage globally and for each Storage Element separately. It supports flexible ACL rules with plug-ins for various policies that can be adopted by a particular community. The DFC catalog allows to store various types of metadata associated with the files and directories and to perform efficient queries for the data based on complex metadata combinations. Definition of file ancestor-descendent chains is also possible. It is implemented in the DIRAC distributed computing framework following the standard grid security architecture. In this contribution we describe the design of the DFC and its implementation details. The performance measurements are compared with other grid file catalog implementations. The experience of the DFC Catalog usage in the ILC Collaboration is discussed.
LHCb

Communications sans actes
22/05/2012

Computing in high Energy and Nuclear Physics (CHEP2012)
Poster
New-York
États-Unis
21/05/2012
25/05/2012
A. Tsaregorodtsev