A multi-tiered data structure and process management system based on ROOT and CouchDB

G.A. Cox; E. Armengaud; C. Augier; Alain Benoit; L. Bergé; T. Bergmann; J. Blümer; G. Bres; A. Broniatowski; V. Brudanin; B. Censier; M. Chapellier; G. Chardin; F. Charlieux; S. Collin; P. Coulter; O. Crauste; M. De Jésus; J. Domange; L. Dumoulin; K. Eitel; D. Filosofov; N. Fourches; J. Gascon; G. Gerbier; J. Gironnet; M. Gros; S. Henry; S. Hervé; S. Jokisch; A. Juillard; M. Kleifges; H. Kluck; V. Kozlov; H. Kraus; V.A. Kudryavtsev; P. Loaiza; S. Marnieros; A. Menshikov; X.-F. Navick; C. Nones; E. Olivieri; P. Pari; L. Pattavina; B. Paul; M. Robinson; H. Rodenas; S. Rozov; V. Sanglard; B. Schmidt; S. Semikh; D. Tcherniakhovski; A.S. Torrento-Coello; M. Unrau; L. Vagneron; M.A. Verdier; R.J. Walker; M. Weber; E. Yakushev; X. Zhang

doi:10.1016/j.nima.2012.04.049

A multi-tiered data structure and process management system based on ROOT and CouchDB

G.A. Cox E. Armengaud ¹ C. Augier ² Alain Benoit ³ L. Bergé ⁴ T. Bergmann J. Blümer G. Bres ⁵ A. Broniatowski ⁶ V. Brudanin B. Censier ² M. Chapellier ⁶ G. Chardin ⁶ F. Charlieux ² S. Collin ⁶ P. Coulter O. Crauste ⁶ M. De Jésus ² J. Domange ⁷ L. Dumoulin ⁶ K. Eitel D. Filosofov N. Fourches ¹ J. Gascon ² G. Gerbier ¹ J. Gironnet ² M. Gros ¹ S. Henry S. Hervé ¹ S. Jokisch A. Juillard ² M. Kleifges H. Kluck V. Kozlov H. Kraus V.A. Kudryavtsev P. Loaiza ⁸ S. Marnieros ⁶ A. Menshikov X.-F. Navick ¹ C. Nones ¹ E. Olivieri ⁴ P. Pari L. Pattavina ² B. Paul ¹ M. Robinson H. Rodenas ⁹ S. Rozov V. Sanglard ² B. Schmidt S. Semikh D. Tcherniakhovski A.S. Torrento-Coello ¹ M. Unrau L. Vagneron ² M.A. Verdier ² R.J. Walker M. Weber E. Yakushev X. Zhang ¹⁰

1 IRFU - Institut de Recherches sur les lois Fondamentales de l'Univers (ex DAPNIA)

2 IPNL - Institut de Physique Nucléaire de Lyon

3 HELFA

NEEL - Institut Néel

4 CSNSM INSTR

CSNSM - Centre de Spectrométrie Nucléaire et de Spectrométrie de Masse

5 ElecMCBT

NEEL - Institut Néel

6 CSNSM PS1

CSNSM - Centre de Spectrométrie Nucléaire et de Spectrométrie de Masse

7 CSNSM PS1

CSNSM - Centre de Spectrométrie Nucléaire et de Spectrométrie de Masse, IRFU - Institut de Recherches sur les lois Fondamentales de l'Univers (ex DAPNIA)

8 LSM - UMR 6417 - Laboratoire Souterrain de Modane

9 Cryo

NEEL - Institut Néel

10 IRAMIS - Institut Rayonnement Matière de Saclay (ex DRECAM)

Abstract : A multi-tiered data structure, analysis toolkit and data processing management system has been constructed using ROOT and CouchDB. This system is well suited for experiments that acquire many computer files of raw data over the course of months or years, that are distributed to different computing centers and further reduced in size by several steps of data processing. Data handling for experiments searching for rare events extracted from digitized pulse traces typically fit this description. An implementation of this system has been constructed for the EDELWEISS-III experiment and is described here in some detail. This solution may also serve as a prototype system for the proposed EURECA experiment.

Mots-clés : Data structure CouchDB ROOT Data management

Document type :

Journal articles

Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Elsevier, 2012, 684, pp.63-72. <10.1016/j.nima.2012.04.049>

Domain :

Physics / Physics / Instrumentation and Detectors

http://hal.in2p3.fr/in2p3-00703263
Contributor : Christine Hadrossek <>
Submitted on : Friday, June 1, 2012 - 4:11:27 PM
Last modification on : Monday, October 13, 2014 - 3:43:25 PM

A multi-tiered data structure and process management system based on ROOT and CouchDB

Identifiers

Collections

Citation

Export

Share

Metrics

56

Contact