Author: Thompson, J.A.
Paper Title Page
WECOBA07 High Speed Detectors: Problems and Solutions 1016
 
  • N.P. Rees, M. Basham, J. Ferner, U.K. Pedersen, T.S. Richter, J.A. Thompson
    Diamond, Oxfordshire, United Kingdom
 
  Diamond has an increasing number of high speed detectors primarily used on Macromolecular Crystallography, Small Angle X-Ray Scattering and Tomography beamlines. Recently, the performance requirements have exceeded the performance available from a single threaded writing process on our Lustre parallel file system, so we have had to investigate other file systems and ways of parallelising the data flow to mitigate this. We report on the some comparative tests between Lustre and GPFS, and some work we have been leading to enhance the HDF5 library to add features that simplify the parallel writing problem.  
slides icon Slides WECOBA07 [0.617 MB]