Question on the Pretrained Feature Networks (EfficientNets)

[Nikolai10]

Hello @xl-sr,

I am sorry to bother you: I need to translate the Projection Discriminator to TensorFlow. I am however a bit confused about which EfficientNet model to use. In my understanding, your default choice is "EfficientNet-Lite1".

In your code, however, you have used the tf_efficientnet_lite0 variant per default.

I am also a bit confused about the presented numbers (Table 2):

EfficientNet
lite0 lite1 lite2 lite3 lite4
Params (M) ↓ 2.96 3.72 4.36 6.42 11.15
IN top-1 ↑ 75.48 76.64 77.47 79.82 81.54
FID ↓ 2.53 1.65 1.69 1.79

I believe the origin of the lite variants comes from here. I noticed that the number of params (M) and also reported IN top-1 acc do not match (perhaps I just missed something?). I would be thankful if you could give me a short feedback.

For my own implementation, I believe using the models uploaded to https://tfhub.dev/s?q=EfficientNet-Lite (e.g. efficientnet/lite1/feature-vector) should be the way to go.

Thanks,
Nikolai