Skip to content

Commit

Permalink
[pre-commit.ci] auto fixes from pre-commit.com hooks
Browse files Browse the repository at this point in the history
for more information, see https://pre-commit.ci
  • Loading branch information
pre-commit-ci[bot] committed Oct 9, 2024
1 parent bddfcdf commit 4f3f394
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/litdata/streaming/item_loader.py
Original file line number Diff line number Diff line change
Expand Up @@ -313,7 +313,7 @@ def _load_chunk(self, chunk_index: int, chunk_filepath: str) -> None:
offset = (1 + chunk["chunk_size"] + 1) * 4
mmap = np.memmap(chunk_filepath, mode="r", order="C", offset=offset)
self._mmaps[chunk_index] = mmap
self._buffers[chunk_index] = memoryview(mmap)
self._buffers[chunk_index] = memoryview(mmap)

def pre_load_chunk(self, chunk_index: int, chunk_filepath: str) -> None:
# This is called within the prepare chunks thread, so we overlap data loading with data reading.
Expand Down

0 comments on commit 4f3f394

Please sign in to comment.