Releases: Lightning-AI/litdata
Releases · Lightning-AI/litdata
Release 0.2.37
What's Changed
Full Changelog: v0.2.36...v0.2.37
Release 0.2.36
Release 0.2.35
What's Changed
- Update(ci): github action's artifact upgrade v4 by @alleeclark in #435
- [pre-commit.ci] pre-commit suggestions by @pre-commit-ci in #444
- Fix: progress bar for merge_datasets by @bhimrazy in #445
- Add support for s3 folders by @tchaton in #447
- Bump to version 0.2.35 by @tchaton in #448
New Contributors
- @alleeclark made their first contribution in #435
- @pre-commit-ci made their first contribution in #444
Full Changelog: v0.2.34...v0.2.35
Release 0.2.34
What's Changed
- Fix the serialization of scalar valued tensors by @enrico-stauss in #431
- Add example on how to filter illegal data by @tchaton in #432
Full Changelog: v0.2.33...v0.2.34
Release 0.2.33
What's Changed
- POC: add tiffile serializer by @robmarkcole in #425
- bump by @robmarkcole in #427
Full Changelog: v0.2.32...v0.2.33
Release 0.2.32
What's Changed
- fix: Add mechanism to inform the user a new version is available by @tchaton in #420
- Version 0.2.32 by @tchaton in #421
Full Changelog: v0.2.31...v0.2.32
Release 0.2.31
v0.2.30
What's Changed
- update tags in pkg metadata by @Borda in #384
- 📝 Update Docs: Merge multiple optimized datasets into one by @bhimrazy in #385
- Fix/large num chunks error by @bhimrazy in #381
- fix: non-deterministic CI test failure by @deependujha in #390
- correct the chunk size by adding header size by @tchaton in #395
- pass storage options to s5cmd by @bhimrazy in #397
- CONTRIBUTING.md for LitData by @deependujha in #391
- Feat: add support for custom cache dir in Streaming Dataset by @bhimrazy in #399
- 📝 docs: specify custom cache directory by @bhimrazy in #405
- Fix broken link for CONTRIBUTING.md by @bhimrazy in #404
- Feat/add support for numpy datatypes in tokensloader by @bhimrazy in #401
- Bump version to 0.2.30 by @bhimrazy in #410
Full Changelog: v0.2.29...v0.2.30
v0.2.29
What's Changed
- Update
PL Data
toLitData
by @bhimrazy in #382 - Fix: Chunks deletion issue by @deependujha in #375
- Bump version 0.2.29 by @deependujha in #383
Full Changelog: v0.2.28...v0.2.29