JRA Success Stories: Live Processing of Momentum-Resolved STEM Data for First Moment Imaging and Ptychography
Joint Research Activities in ESTEEM3 target the coordinated advancement of methods and infrastructure for the whole microscopy community. This example showcases results from ongoing efforts in JRA3 to advance Open Data, Open Source and Open Interfaces for next-generation TEM applications.
The LiberTEM project, which is supported by ESTEEM3, works towards standardized interfaces for high-throughput distributed live data processing in order to make microscopy using advanced high-performance computational methods as intuitive, interactive and easy to use as conventional microscopy.
The main results of the project
In a collaboration with the Ptychography 4.0 project, live scanning ptychographic reconstruction was demonstrated that allows interactive navigation and adjustments while scanning continuously. Implementing back-end support for live processing was facilitated by the feature-rich and well-documented application programming interface (API) of the Merlin detector from ESTEEM3 partner Quantum Detectors.
LiberTEM allows to cleanly separate aspects of data logistics and back-end interfaces from details of the computational method. This allows to run the same algorithm on different datasets and different detectors without modification, as well as allowing the execution of many different applications in parallel on the same data stream.
The project led to the publication of a peer-reviewed journal article, two open datasets, and three Open Source software packages that are continuously maintained and extended.
- Microscopy and Microanalysis: https://doi.org/10.1017/S1431927621012423
- Datasets https://doi.org/10.5281/zenodo.5113235 and https://doi.org/10.5281/zenodo.5113449
- Improvements in LiberTEM that are released in version 0.7.0: https://libertem.github.io/LiberTEM/changelog.html#v0-7-0, https://doi.org/10.5281/zenodo.4923277
- New extension package LiberTEM-live with back-end support for live data processing, starting with the Quantum Detectors Merlin camera: https://libertem.github.io/LiberTEM-live/, https://doi.org/10.5281/zenodo.4916316
- An optimized implementation of single side band ptychography that is suitable for live data processing and compatible with LiberTEM: https://ptychography-4-0.github.io/ptychography/algorithms.html#single-side-band