Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

'Lazy' loading of Dask arrays from Tiled (SRX) #321

Merged
merged 3 commits into from
Jun 9, 2024

Conversation

dmgav
Copy link
Collaborator

@dmgav dmgav commented Jun 8, 2024

Loading of experimental data from the Tiled server for SRX beamline. Data is loaded and saved to HDF5 file in blocks of ~40,000 pixels and allows to load large maps without excessive memory use. The procedure is efficient for loading and saving the sum of all data. It also works for loading individual channels, but is very slow.

Replaced deprecated BrokenBarHCollection with PolyCollection. PyXRF is now compatible with Matplotlib 3.9.0.

Data collected during 2D step scans still can not be loaded using Tiled.

Fixed

  • Compatibility with Matplotlib 3.9.0: deprecated BrokenBarHCollection was replaced with PolyCollection.

Added

  • Optimized data loaded from Tiled server for SRX beamline.

Changed

Removed

How Has This Been Tested?

@dmgav dmgav merged commit 0467cb9 into NSLS2:master Jun 9, 2024
13 checks passed
@dmgav dmgav deleted the lazy-loading branch June 9, 2024 14:11
@dmgav dmgav restored the lazy-loading branch June 20, 2024 14:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant