Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fail to train of GAIL in Ant-v2 environment #28

Open
seolhokim opened this issue Apr 16, 2021 · 3 comments
Open

Fail to train of GAIL in Ant-v2 environment #28

seolhokim opened this issue Apr 16, 2021 · 3 comments

Comments

@seolhokim
Copy link

seolhokim commented Apr 16, 2021

I trained your ppo first.

python examples/ppo_gym.py --env-name Ant-v2 --save-model-interval 100

After 500 episodes, I made trajectories.

python gail/save_expert_traj.py --model-path assets/learned_models/Ant-v2_ppo.p

Last, I ran gail.

python gail/gail_gym.py --env-name Ant-v2 --expert-traj-path assets/expert_traj/Ant-v2_expert_traj.p

I implemented Gail and Vail, but I failed to train it too.(but hopper worked well)

Any Ideas?

@dibbla
Copy link

dibbla commented Feb 3, 2022

Hi! Have you work it out?
It seems to be the problem of zfilter.

@seolhokim
Copy link
Author

No. I guess you doubt the training has failed because of standardization by zfilter, right? I checked but it was not the key to solving problem in my implementation.

@lviano
Copy link

lviano commented May 13, 2022

Any solution to this ? I am running in the same problem. The code works well for all the other MuJoCo I have tried but not for HalfCheetah

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants