Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how to decide the value of λ #60

Open
silentsaber opened this issue Mar 5, 2021 · 2 comments
Open

how to decide the value of λ #60

silentsaber opened this issue Mar 5, 2021 · 2 comments

Comments

@silentsaber
Copy link

Since the d_loss = fake-real+gp, how to decide the value of LAMBDA to get a reasonable gradient penalty.
I mean, if fake=-10, real=10, is gp=10 appropriate?or the gp should be smaller(e.g. gp=5)?

@hangexuexi
Copy link

i have the same question about it, did you solve this problem? at the start of my train, the wass loss is very small, about 0.01, so how should i set the lambda?

@cjblocker
Copy link

cjblocker commented Aug 7, 2023

The original paper suggests sticking with 10

Penalty coefficient All experiments in this paper use λ = 10, which we found to work well across a variety of architectures and datasets ranging from toy tasks to large ImageNet CNNs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants