Skip to Main content Skip to Navigation
Conference papers

The ATLAS EventIndex: an event catalogue for experiments collecting large amounts of data

Abstract : Modern scientific experiments collect vast amounts of data that must be catalogued to meet multiple use cases and search criteria. In particular, high-energy physics experiments currently in operation produce several billion events per year. A database with the references to the files including each event in every stage of processing is necessary in order to retrieve the selected events from data storage systems. The ATLAS EventIndex project is studying the best way to store the necessary information using modern data storage technologies (Hadoop, HBase etc.) that allow saving in memory key-value pairs and select the best tools to support this application from the point of view of performance, robustness and ease of use. This paper describes the initial design and performance tests and the project evolution towards deployment and operation during 2014.
Document type :
Conference papers
Complete list of metadatas

http://hal.in2p3.fr/in2p3-01015092
Contributor : Sabine Starita <>
Submitted on : Wednesday, June 25, 2014 - 5:03:41 PM
Last modification on : Wednesday, September 16, 2020 - 4:18:58 PM

Links full text

Identifiers

Collections

IN2P3 | LAL | CNRS

Citation

D. Barberis, J. Cranshaw, G. Dimitrov, A. Favareto, Á. Fernández Casaní, et al.. The ATLAS EventIndex: an event catalogue for experiments collecting large amounts of data. 20th International Conference on Computing in High Energy and Nuclear Physics (CHEP2013), Oct 2013, Amsterdam, Netherlands. pp.042002, ⟨10.1088/1742-6596/513/4/042002⟩. ⟨in2p3-01015092⟩

Share

Metrics

Record views

444