You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In my implementation, I used DistributedSampler(..., drop_last=False) for validation. This is okay when samples % world_size == 0, so my experiments were fine. However, if this value is non-zero by changing the dataset or number of GPUs, please use drop_last=True then replace num_val_samples with math.floor(num_val_samples / world_size) * world_size to avoid evaluating duplicated samples.
The text was updated successfully, but these errors were encountered:
In my implementation, I used
DistributedSampler(..., drop_last=False)
for validation. This is okay whensamples % world_size == 0
, so my experiments were fine. However, if this value is non-zero by changing the dataset or number of GPUs, please usedrop_last=True
then replacenum_val_samples
withmath.floor(num_val_samples / world_size) * world_size
to avoid evaluating duplicated samples.The text was updated successfully, but these errors were encountered: