Author: Khakhulin, D.
Paper Title Page
TUCPA01 Data Analysis Support in Karabo at European XFEL 245
 
  • H. Fangohr, M. Beg, V. Bondar, D. Boukhelef, S. Brockhauser, C. Danilevski, W. Ehsan, S.G. Esenov, G. Flucke, G. Giovanetti, D. Goeries, S. Hauf, B.C. Heisen, D.G. Hickin, D. Khakhulin, A. Klimovskaia, M. Kuster, P.M. Lang, L.G. Maia, L. Mekinda, T. Michelat, A. Parenti, G. Previtali, H. Santos, A. Silenzi, J. Sztuk-Dambietz, J. Szuba, M. Teichmann, K. Weger, J. Wiggins, K. Wrona, C. Xu
    XFEL. EU, Schenefeld, Germany
  • S. Aplin, A. Barty, M. Kuhn, V. Mariani
    CFEL, Hamburg, Germany
  • T. Kluyver
    University of Southampton, Southampton, United Kingdom
 
  We de­scribe the data analy­sis struc­ture that is in­te­grated into the Karabo frame­work [1] to sup­port sci­en­tific ex­per­i­ments and data analy­sis at Eu­ro­pean XFEL GmbH. The pho­ton sci­ence ex­per­i­ments have a range of data analy­sis re­quire­ments, in­clud­ing on­line (i.e. near real-time dur­ing the ac­tual mea­sure­ment) and of­fline data analy­sis. The Karabo data analy­sis frame­work sup­ports ex­e­cu­tion of au­to­matic data analy­sis for rou­tine tasks, sup­ports com­plex ex­per­i­ment pro­to­cols in­clud­ing data analy­sis feed­back in­te­gra­tion to in­stru­ment con­trol, and sup­ports in­te­gra­tion of ex­ter­nal ap­pli­ca­tions. The on­line data analy­sis is car­ried out using dis­trib­uted and ac­cel­er­a­tor hard­ware (such as GPUs) where re­quired to bal­ance load and achieve near real-time data analy­sis through­put. Analy­sis rou­tines pro­vided by Karabo are im­ple­mented in C++ and Python, and make use of es­tab­lished sci­en­tific li­braries. The XFEL con­trol and analy­sis soft­ware team col­lab­o­rates with users to in­te­grate ex­per­i­ment spe­cific analy­sis codes, pro­to­cols and re­quire­ments into this frame­work, and to make it avail­able for the ex­per­i­ments and sub­se­quent of­fline data analy­sis.
[1] Heisen et al (2013) "Karabo: An Integrated Software Framework Combining Control, Data Management, and Scientific Computing Tasks". Proc. of 14th ICALEPCS 2013, Melbourne, Australia (p. FRCOAAB02)
 
slides icon Slides TUCPA01 [10.507 MB]  
DOI • reference for this paper ※ https://doi.org/10.18429/JACoW-ICALEPCS2017-TUCPA01  
Export • reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)