You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Ideally, if the tfrecords are created using the API, with the aforementioned change, we can ensure the same number of records in every shard except the last one. Now, if n_volumes is not specified, it can be calculated using this function, which is num_records_first_shard * (num_shards - 1) + num_records_in_last_shard
nobrainer/nobrainer/dataset.py
Lines 115 to 122 in 976691d
If the number of volumes in the shard is too large, this snippet of code can be time-consuming. Alternatives are
n_volumes
and number of files withfile_pattern
to calculatelen(first_shard)
The text was updated successfully, but these errors were encountered: