Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Speed up image processing #59

Open
gfabbris opened this issue Jan 27, 2022 · 2 comments
Open

Speed up image processing #59

gfabbris opened this issue Jan 27, 2022 · 2 comments

Comments

@gfabbris
Copy link
Contributor

gfabbris commented Jan 27, 2022 •
edited
Loading

The load_images function is a bit slow, especially the normalization. Took ~ 40 seconds to load 5 scans with 392 images in each (goes to ~ 26 if normalization not used). I expected this to be very fast since it's using dask all the way.
@gfabbris gfabbris changed the title Speed up process_images.load_images Speed up image processing Jan 27, 2022
@gfabbris
Copy link
Contributor Author

The RXES data processing is also very slow, ~ 5-7 min to process the same 5 scans/392 images each.,

@gfabbris
Copy link
Contributor Author

gfabbris commented Jan 27, 2022 •
edited
Loading

Seems like it's faster if we get the images (.compute()) before extracting the spectrum. By ~ 5 times.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@gfabbris