Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Auto-PyTorch Integration #287

Open
shukon opened this issue Jul 1, 2020 · 0 comments
Open

Auto-PyTorch Integration #287

shukon opened this issue Jul 1, 2020 · 0 comments

Comments

@shukon
Copy link
Collaborator

shukon commented Jul 1, 2020

To fully integrate APT in CAVE, APT first needs to settle for a longterm output format. At the time of writing, there is no such format, just a number of json-files that look different for different experiments. However, a uniform format as well as tensorboard logging for individual incumbents will yield a great way to compare the incumbents within tensorboard.
CAVE reads APT in general from 1.4.0, assuming APT builds on HpBandSter for the basic results (configs.json and results.json). Users will have to manually write out the configspace.json as well, since that is not done within APT. If there are tensorboard-files present, they will be consumed and made available in a jupyter-notebook, see the APT-example notebook.
Further integration can happen in a few places... if there are additional files in APT's output, the conversion to SMAC3 needs to be adapted. APT-specific analyzers can live in analyzer/apt/. Check out the Contribution guide for more info on adding new analyzer's.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant