Author: Allan, D.B.
Paper Title Page
WED3O02 Databroker: An Interface for NSLS-II Data Management System 645
 
  • A. Arkilic, D.B. Allan, D. Chabot, L.R. Dalesio, W.K. Lewis
    BNL, Upton, Long Island, New York, USA
 
  Funding: Brookhaven National Lab, U.S. Department of Energy
A typ­i­cal ex­per­i­ment in­volves not only the raw data from a de­tec­tor, but also re­quires ad­di­tional data from the beam­line. This in­for­ma­tion is largely kept sep­a­rated and ma­nip­u­lated in­di­vid­u­ally, to date. A much more ef­fec­tive ap­proach is to in­te­grate these dif­fer­ent data sources, and make these eas­ily ac­ces­si­ble to data analy­sis clients. NSLS-II data flow sys­tem con­tains mul­ti­ple back­ends with vary­ing data types. Lever­ag­ing the fea­tures of these (meta­data­s­tore, file­store, chan­nel archiver, and Olog), this li­brary pro­vides users with the abil­ity to ac­cess ex­per­i­men­tal data. This ser­vice acts as a sin­gle in­ter­face for time se­ries, data at­tribute, frame data ac­cess and other ex­per­i­ment re­lated in­for­ma­tion.
 
slides icon Slides WED3O02 [2.944 MB]  
Export • reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)  
 
WEPGF043 Metadatastore: A Primary Data Store for NSLS-2 Beamlines 794
 
  • A. Arkilic, D.B. Allan, T.A. Caswell, L.R. Dalesio, W.K. Lewis
    BNL, Upton, Long Island, New York, USA
 
  Funding: Department of Energy, Brookhaven National Lab
The beam­lines at NSLS-II are among the high­est in­stru­mented, and con­trolled of any world­wide. Each beam­line can pro­duce un­struc­tured data sets in var­i­ous for­mats. This data should be made avail­able for data analy­sis and pro­cess­ing for beam­line sci­en­tists and users. Var­i­ous data flow sys­tems are in place in nu­mer­ous syn­chro­trons, how­ever these are very do­main spe­cific and can­not han­dle such un­struc­tured data. We have de­vel­oped a data flow ser­vice, meta­data­s­tore, that man­ages ex­per­i­men­tal data in NSLS-II beam­lines. This ser­vice en­ables data analy­sis and vi­su­al­iza­tion clients to ac­cess this ser­vice ei­ther di­rectly or via data­bro­ker api in a con­sis­tent and par­ti­tion tol­er­ant fash­ion, pro­vid­ing a re­li­able and easy to use in­ter­face to our state-of-the-art beam­lines.
 
Export • reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)