Skip to content

Commit

Permalink
fixed instructions to produce index files
Browse files Browse the repository at this point in the history
  • Loading branch information
Malik Boudiaf authored and Malik Boudiaf committed Apr 16, 2022
1 parent 00ac659 commit 61e8555
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 5 deletions.
4 changes: 2 additions & 2 deletions Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -230,8 +230,8 @@ tiered:
--records_root=${RECORDS} \


indexes:
for source in ilsvrc_2012_v2; do \
index_files:
for source in omniglot aircraft cu_birds dtd quickdraw vgg_flower traffic_sign mscoco ilsvrc_2012_v2; do \
source_path=${RECORDS}/$${source} ;\
find $${source_path} -name '*.tfrecords' -type f -exec sh -c '$(exec)3 -m tfrecord.tools.tfrecord2idx $$2 $${2%.tfrecords}.index' sh $${source_path} {} \; ;\
done ;\
Expand Down
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -57,12 +57,12 @@ pip install -r requirements.txt

### 1.2 Data

To download the META-DATASET, please follow the details instructions provided at [meta-dataset](https://github.com/google-research/meta-dataset) to obtain the `.tfrecords` converted data. Once done, make sure all converted dataset are in a single folder, and execute the following script to produce index files:
To download the META-DATASET, please follow the details instructions provided at [meta-dataset](https://github.com/google-research/meta-dataset) to obtain the `.tfrecords` converted data. Once done, make sure all converted dataset are in a single folder, and execute the following to produce index files:

```bash
bash scripts/make_records/make_index_files.sh <path_to_converted_data>
make index_files
```
This may take a few minutes. Once all this is done, set the `path` variable in [`config/base.yaml`](config/base.yaml#L37) to your data folder.
This may take a few minutes.

### 1.3 Exports

Expand Down

0 comments on commit 61e8555

Please sign in to comment.