JACoW logo

Joint Accelerator Conferences Website

The Joint Accelerator Conferences Website (JACoW) is an international collaboration that publishes the proceedings of accelerator conferences held around the world.


RIS citation export for WEPGF044: Filestore: A File Management Tool for NSLS-II Beamlines

TY - CONF
AU - Arkilic, A.
AU - Caswell, T.A.
AU - Chabot, D.
AU - Dalesio, L.R.
AU - Lewis, W.K.
ED - Corvetti, Lou
ED - Riches, Kathleen
ED - Schaa, Volker RW
TI - Filestore: A File Management Tool for NSLS-II Beamlines
J2 - Proc. of ICALEPCS2015, Melbourne, Australia, 17-23 October 2015
C1 - Melbourne, Australia
T2 - International Conference on Accelerator and Large Experimental Physics Control Systems
T3 - 15
LA - english
AB - NSLS-II beamlines can generate 72,000 data sets per day resulting in over 2 M data sets in one year. The large amount of data files generated by our beamlines poses a massive file management challenge. In response to this challenge, we have developed filestore, as means to provide users with an interface to stored data. By leveraging features of Python and MongoDB, filestore can store information regarding the location of a file, access and open the file, retrieve a given piece of data in that file, and provide users with a token, a unique identifier allowing them to retrieve each piece of data. Filestore does not interfere with the file source or the storage method and supports any file format, making data within files available for NSLS-II data analysis environment.
PB - JACoW
CP - Geneva, Switzerland
SP - 796
EP - 798
KW - experiment
KW - data-analysis
KW - EPICS
KW - data-acquisition
KW - database
DA - 2015/12
PY - 2015
SN - 978-3-95450-148-9
DO - 10.18429/JACoW-ICALEPCS2015-WEPGF044
UR - http://jacow.org/icalepcs2015/papers/wepgf044.pdf
ER -