Dataset Split for Linear Evaluation and Fine Tuning

[vamsi231297]

Can someone tell me which of the following methods are being used during the evaluation stage :

• Doing pretraining on datasplit1 and during the evaluation we use datasplit1 as train and other split as test
• Doing pretraining on datasplit1 and during the evaluation we use datasplit2 as train and other split as test

[chentingpc]

Both are valid, depends on specific setting. For standard setup, we pretrain on ImageNet and fine-tune / linear eval on ImageNet (eval on their validation set). For transfer learning setup, we pretrain on ImageNet and fine-tune on another dataset (e.g. CIFAR-10 train, and eval on CIFAR-10 test).