Author: Lyard, E.
Paper Title Page
THBPL03 A New ACS Bulk Data Transfer Service for CTA 1116
 
  • M.A. Araya, R.S. Castillo, M.I. Jara, L. Pizarro, H.H. von Brand
    UTFSM, Valparaíso, Chile
  • E. Lyard
    University of Geneva, Geneva, Switzerland
  • I. Oya
    DESY Zeuthen, Zeuthen, Germany
  • I. Oya
    Humboldt University Berlin, Institut für Physik, Berlin, Germany
 
  Funding: Centro Científico Tecnológico de Valparaíso (CONICYT FB-0821)
The ALMA Com­mon Soft­ware (ACS) frame­work pro­vides Bulk Data Trans­fer (BDT) ser­vice im­ple­men­ta­tions that need to be up­dated for new pro­jects that will use ACS, such as the Cherenkov Tele­scope Array (CTA) and other pro­jects, with most cases hav­ing quite dif­fer­ent re­quire­ments than ALMA. We pro­pose a new open-source BDT ser­vice for ACS based on Ze­roMQ, that meets CTA data trans­fer spec­i­fi­ca­tions while main­tain­ing retro-com­pat­i­bil­ity with the closed-source so­lu­tion used in ALMA. The ser­vice uses the push-pull pat­tern for data trans­fer, the pub­lisher-sub­scriber pat­tern for data con­trol, and Pro­to­col Buffers for data se­ri­al­iza­tion, hav­ing also the op­tion to in­te­grate other se­ri­al­iza­tion op­tions eas­ily. Be­sides com­ply­ing with ACS in­ter­face de­f­i­n­i­tion to be used by ACS com­po­nents and clients, the ser­vice pro­vide an in­de­pen­dent API to be used out­side the ACS frame­work. Our ex­per­i­ments show a good com­pro­mise be­tween through­put and com­pu­ta­tional ef­fort, sug­gest­ing that the ser­vice could scale up in terms of num­ber of pro­duc­ers, num­ber of con­sumers and net­work band­width.
 
video icon Talk as video stream: https://youtu.be/F0jOkHOz0uw  
slides icon Slides THBPL03 [7.087 MB]  
DOI • reference for this paper ※ https://doi.org/10.18429/JACoW-ICALEPCS2017-THBPL03  
Export • reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)