Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create zarr-only and zarr + dask benchmarks of trajectory reading #24

Closed
ljwoods2 opened this issue May 29, 2024 · 1 comment
Closed
Labels

Comments

@ljwoods2
Copy link
Collaborator

ljwoods2 commented May 29, 2024

To get a baseline of zarr's optimal performance with h5md and zarrmd files, benchmark reads and writes

  1. only using zarr and
  2. using zarr and dask (in something like a "lazy timeseries"

Choose a benchmark which will force dask to execute lazily-evaluated reads, like computing some kind of average. Run zarrtraj with h5md and zarr files using the same data and chunking patterns to get a fair comparison.

@ljwoods2 ljwoods2 added the GSOC label May 29, 2024
@ljwoods2 ljwoods2 changed the title Create a zarr-only and zarr + dask benchmarks of trajectory reading Create zarr-only and zarr + dask benchmarks of trajectory reading May 29, 2024
@ljwoods2
Copy link
Collaborator Author

Closed by #53

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant