The IceProd Framework: distributed data processing for the IceCube neutrino observatory

Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › fagfællebedømt

Standard

The IceProd Framework : distributed data processing for the IceCube neutrino observatory. / Aartsen, M.G.; Abbasi, R.; Ackermann, M.; Adams, J.; Aguilar, J.A.; Ahlers, M.; Altmann, D.; Arguelles, C.; Auffenberg, J.; Bai, X.; Baker, M.; Barwick, S.W.; Baum, V.; Bay, R.; Koskinen, David Jason; Sarkar, Subir.

I: Journal of Parallel and Distributed Computing, Bind 75, 2015, s. 198-211.

Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › fagfællebedømt

Harvard

Aartsen, MG, Abbasi, R, Ackermann, M, Adams, J, Aguilar, JA, Ahlers, M, Altmann, D, Arguelles, C, Auffenberg, J, Bai, X, Baker, M, Barwick, SW, Baum, V, Bay, R, Koskinen, DJ & Sarkar, S 2015, 'The IceProd Framework: distributed data processing for the IceCube neutrino observatory', Journal of Parallel and Distributed Computing, bind 75, s. 198-211. https://doi.org/10.1016/j.jpdc.2014.08.001

APA

Aartsen, M. G., Abbasi, R., Ackermann, M., Adams, J., Aguilar, J. A., Ahlers, M., Altmann, D., Arguelles, C., Auffenberg, J., Bai, X., Baker, M., Barwick, S. W., Baum, V., Bay, R., Koskinen, D. J., & Sarkar, S. (2015). The IceProd Framework: distributed data processing for the IceCube neutrino observatory. Journal of Parallel and Distributed Computing, 75, 198-211. https://doi.org/10.1016/j.jpdc.2014.08.001

Vancouver

Aartsen MG, Abbasi R, Ackermann M, Adams J, Aguilar JA, Ahlers M o.a. The IceProd Framework: distributed data processing for the IceCube neutrino observatory. Journal of Parallel and Distributed Computing. 2015;75:198-211. https://doi.org/10.1016/j.jpdc.2014.08.001

Author

Aartsen, M.G. ; Abbasi, R. ; Ackermann, M. ; Adams, J. ; Aguilar, J.A. ; Ahlers, M. ; Altmann, D. ; Arguelles, C. ; Auffenberg, J. ; Bai, X. ; Baker, M. ; Barwick, S.W. ; Baum, V. ; Bay, R. ; Koskinen, David Jason ; Sarkar, Subir. / The IceProd Framework : distributed data processing for the IceCube neutrino observatory. I: Journal of Parallel and Distributed Computing. 2015 ; Bind 75. s. 198-211.

Bibtex

@article{6f6d179891474714ba152cd2217c8007,
title = "The IceProd Framework: distributed data processing for the IceCube neutrino observatory",
abstract = "IceCube is a one-gigaton instrument located at the geographic South Pole, designed to detect cosmic neutrinos, iden- tify the particle nature of dark matter, and study high-energy neutrinos themselves. Simulation of the IceCube detector and processing of data require a significant amount of computational resources. IceProd is a distributed management system based on Python, XML-RPC and GridFTP. It is driven by a central database in order to coordinate and admin- ister production of simulations and processing of data produced by the IceCube detector. IceProd runs as a separate layer on top of other middleware and can take advantage of a variety of computing resources, including grids and batch systems such as CREAM, Condor, and PBS. This is accomplished by a set of dedicated daemons that process job submission in a coordinated fashion through the use of middleware plugins that serve to abstract the details of job submission and job management from the framework.",
author = "M.G. Aartsen and R. Abbasi and M. Ackermann and J. Adams and J.A. Aguilar and M. Ahlers and D. Altmann and C. Arguelles and J. Auffenberg and X. Bai and M. Baker and S.W. Barwick and V. Baum and R. Bay and Koskinen, {David Jason} and Subir Sarkar",
year = "2015",
doi = "10.1016/j.jpdc.2014.08.001",
language = "English",
volume = "75",
pages = "198--211",
journal = "Journal of Parallel and Distributed Computing",
issn = "0743-7315",
publisher = "Academic Press",

}

RIS

TY - JOUR

T1 - The IceProd Framework

T2 - distributed data processing for the IceCube neutrino observatory

AU - Aartsen, M.G.

AU - Abbasi, R.

AU - Ackermann, M.

AU - Adams, J.

AU - Aguilar, J.A.

AU - Ahlers, M.

AU - Altmann, D.

AU - Arguelles, C.

AU - Auffenberg, J.

AU - Bai, X.

AU - Baker, M.

AU - Barwick, S.W.

AU - Baum, V.

AU - Bay, R.

AU - Koskinen, David Jason

AU - Sarkar, Subir

PY - 2015

Y1 - 2015

N2 - IceCube is a one-gigaton instrument located at the geographic South Pole, designed to detect cosmic neutrinos, iden- tify the particle nature of dark matter, and study high-energy neutrinos themselves. Simulation of the IceCube detector and processing of data require a significant amount of computational resources. IceProd is a distributed management system based on Python, XML-RPC and GridFTP. It is driven by a central database in order to coordinate and admin- ister production of simulations and processing of data produced by the IceCube detector. IceProd runs as a separate layer on top of other middleware and can take advantage of a variety of computing resources, including grids and batch systems such as CREAM, Condor, and PBS. This is accomplished by a set of dedicated daemons that process job submission in a coordinated fashion through the use of middleware plugins that serve to abstract the details of job submission and job management from the framework.

AB - IceCube is a one-gigaton instrument located at the geographic South Pole, designed to detect cosmic neutrinos, iden- tify the particle nature of dark matter, and study high-energy neutrinos themselves. Simulation of the IceCube detector and processing of data require a significant amount of computational resources. IceProd is a distributed management system based on Python, XML-RPC and GridFTP. It is driven by a central database in order to coordinate and admin- ister production of simulations and processing of data produced by the IceCube detector. IceProd runs as a separate layer on top of other middleware and can take advantage of a variety of computing resources, including grids and batch systems such as CREAM, Condor, and PBS. This is accomplished by a set of dedicated daemons that process job submission in a coordinated fashion through the use of middleware plugins that serve to abstract the details of job submission and job management from the framework.

U2 - 10.1016/j.jpdc.2014.08.001

DO - 10.1016/j.jpdc.2014.08.001

M3 - Journal article

VL - 75

SP - 198

EP - 211

JO - Journal of Parallel and Distributed Computing

JF - Journal of Parallel and Distributed Computing

SN - 0743-7315

ER -

ID: 129935186