Skip to content

Commit

Permalink
[pre-commit.ci] auto fixes from pre-commit.com hooks
Browse files Browse the repository at this point in the history
for more information, see https://pre-commit.ci
  • Loading branch information
pre-commit-ci[bot] committed Sep 6, 2024
1 parent 67205ea commit 69fb43d
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion src/litdata/streaming/downloader.py
Original file line number Diff line number Diff line change
Expand Up @@ -244,9 +244,10 @@ def download_s3_file_via_s5cmd(remote_filepath: str, local_filepath: str) -> Non
}

_DEFAULT_STORAGE_OPTIONS = {
"s3":{"config_kwargs": {"retries":{"max_attempts": 1000, "mode": "adaptive"}}},
"s3": {"config_kwargs": {"retries": {"max_attempts": 1000, "mode": "adaptive"}}},
}


def get_complete_storage_options(cloud_provider: str, storage_options: Optional[Dict] = {}) -> Dict:
if storage_options is None:
storage_options = {}
Expand Down

0 comments on commit 69fb43d

Please sign in to comment.