DIRAC Data Management Framework

Abstract : DIRAC Project is developing software for building distributed computing systems for the needs of research communities. It provides a complete solution covering both Workload Management and Data Management tasks of accessing computing and storage resources. The Data Management subsystem of DIRAC includes all the necessary components to organize data in distributed storage systems. It has a versatile File Catalog (DFC) service to keep track of data file physical replicas. This service is a central component to build a logical File System of DIRAC presenting all the distributed storage elements as a single entity for the users with transparent access to the data. The DFC service provides also a Metadata Catalog functionality to classify data with user defined tags. This can be used for an efficient search of the data necessary for a particular analysis. The Data Management system provides also support for usual data management tasks of uploading/downloading, replication, removal files with a special emphasis on the bulk data operations involving large numbers of files. Automation of data operations driven by new data registrations is also possible. In this controbution we will make an overview of the DIRAC Data Management System and will give examples of its usage by several research communities.
Type de document :
Communication dans un congrès
International Symposium on Grids and Clouds 2016, Mar 2016, Taipei, Taiwan. 〈http://event.twgrid.org/isgc2016/information.html〉
Liste complète des métadonnées

http://hal.in2p3.fr/in2p3-01352756
Contributeur : Danielle Cristofol <>
Soumis le : mardi 9 août 2016 - 14:30:47
Dernière modification le : jeudi 18 janvier 2018 - 02:22:44

Identifiants

  • HAL Id : in2p3-01352756, version 1

Collections

Citation

A. Tsaregorodtsev. DIRAC Data Management Framework. International Symposium on Grids and Clouds 2016, Mar 2016, Taipei, Taiwan. 〈http://event.twgrid.org/isgc2016/information.html〉. 〈in2p3-01352756〉

Partager

Métriques

Consultations de la notice

73