Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Recorder for gradients of certian modules #653

Open
lanqz7766 opened this issue Sep 23, 2024 · 0 comments
Open

Recorder for gradients of certian modules #653

lanqz7766 opened this issue Sep 23, 2024 · 0 comments

Comments

@lanqz7766
Copy link

Describe the question you meet

I want to achieve a distillation method that may require the teacher and student gradients of certain modules in the current batch. Is it possible to create a recorder to record a backward hook? I just need a general idea if it is possible to modify or create a new recorder.

Also, I am using the mmdetection3.x detectors model, those models are supported in MMrazor 1.0, right?

Any thoughts will be helpful!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant