Abstract
The development of hard X-ray nanoprobe techniques has given rise to a number of experimental methods, like nano-XAS, nano-XRD, nano-XRF, ptychography and tomography. Each method has its own unique data processing algorithms. With the increase in data acquisition rate, the large amount of generated data is now a big challenge to these algorithms. In this work, an intuitive, user-friendly software system is introduced to integrate and manage these algorithms; by taking advantage of the loosely coupled, component-based design approach of the system, the data processing speed of the imaging algorithm is enhanced through optimization of the parallelism efficiency. This study provides meaningful solutions to tackle complexity challenges faced in synchrotron data processing.
Funder
Shanghai Municipal Science and Technology Major Project
National Key Research and Development Program of China
Photon Science Center for Carbon Neutrality
Science and Technology Commission of Shanghai Municipality
National Natural Science foundation of China
Publisher
International Union of Crystallography (IUCr)
Reference30 articles.
1. Benzi, J. & Damodaran, M. (2008). Parallel Computational Fluid Dynamics 2007: Implementations and Experiences on Large Scale and Grid Computing, pp. 91-98. Springer.
2. Bicer, T. (2014). PhD thesis, Ohio State University, USA.
3. Bicer, T., Gursoy, D., Kettimuthu, R., Foster, I. T., Ren, B., De Andrede, V. & De Carlo, F. (2017). Proceedings of the 2017 13th IEEE International Conference on e-Science (e-Science2017), 24-27 October 2017, Auckland, New Zealand, pp. 59-68.
4. High performance data management and analysis for tomography
5. Real-time reconstruction and visualisation towards dynamic feedback control during time-resolved tomography experiments at TOMCAT