From d852db34a5087bff79a7e9ab1c2dafa3353de4a3 Mon Sep 17 00:00:00 2001 From: William Falcon Date: Fri, 5 Jul 2024 19:28:36 -0400 Subject: [PATCH] Update README.md --- README.md | 18 +++++++++--------- 1 file changed, 9 insertions(+), 9 deletions(-) diff --git a/README.md b/README.md index da7663ae..bce48d9c 100644 --- a/README.md +++ b/README.md @@ -206,7 +206,7 @@ for batch in dataloader:
- ✅ Multi-GPU / Multi-Node Support + ✅ Scale across multiple GPUs or machines   @@ -295,7 +295,7 @@ for batch in tqdm(train_dataloader):
- ✅ Split datasets + ✅ Split datasets for training, validation, and testing   @@ -324,7 +324,7 @@ print(test_dataset)
- ✅ Load a dataset subsample + ✅ Work with smaller subsets of a dataset Work on a smaller, manageable portion of your data to save time and resources.   @@ -341,7 +341,7 @@ print(len(dataset)) # display the length of your data
- ✅ Append or overwrite optimized datasets + ✅ Add or replace data in an optimized dataset   Add new data to an existing dataset or start fresh if needed, providing flexibility in data management. @@ -382,7 +382,7 @@ The `overwrite` mode will delete the existing data and start from fresh.
- ✅ Access subsets of large cloud datasets + ✅ Access dataset parts without downloading everything   Look at specific parts of a large dataset without downloading the whole thing or loading it on a local machine. @@ -428,7 +428,7 @@ for batch in dataloader:
- ✅ Profile loading speed + ✅ Measure and optimize data loading speed   Measure and optimize how fast your data is being loaded, improving efficiency. @@ -446,7 +446,7 @@ This generates a Chrome trace called `result.json`. Then, visualize this trace b
- ✅ Reduce memory footprint + ✅ Reduce memory use for large files   Handle large data files efficiently without using too much of your computer's memory. @@ -500,7 +500,7 @@ dataset = StreamingDataset(..., max_cache_size="10GB")
- ✅ On-Prem Optimizations + ✅ Optimize data loading on networked drives   Optimize data handling for computers on a local network to improve performance for on-site setups. @@ -553,7 +553,7 @@ map(
- ✅ Support S3-Compatible Object Storage + ✅ Support S3-Compatible cloud object storage   Use different cloud storage services, offering data storage flexibility and cost-saving options.