Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Graceful reload with streaming bouncer causes admin api to hang, error=shutting down admin server: context deadline exceeded #61

Open
sholdee opened this issue Dec 1, 2024 · 3 comments

Comments

@sholdee
Copy link

sholdee commented Dec 1, 2024

I am using caddy-docker-proxy with the bouncer in this image, which generates a config from Docker labels and loads it via the admin api on localhost:2019. Everything works well until Docker metadata changes and triggers a graceful reload, which causes the admin api to go unresponsive and generate these errors:

ERR | ts=1732909868.6840918 logger=admin msg=stopping current admin endpoint error=shutting down admin server: context deadline exceeded

This issue is not present when using the live bouncer. Graceful reloads complete successfully and the admin api remains responsive.

@hslatman
Copy link
Owner

hslatman commented Dec 1, 2024

Hey @sholdee,

Do you have more log output to debug indicating the bouncer shutting down (or similar), and are there other modules in your custom Caddy build? I'm not able to reproduce this with a locally running instance of Caddy and then reloading its configuration, basically mimicking what the caddy-docker-proxy would do.

@sholdee
Copy link
Author

sholdee commented Dec 2, 2024

Hey @sholdee,

Do you have more log output to debug indicating the bouncer shutting down (or similar), and are there other modules in your custom Caddy build? I'm not able to reproduce this with a locally running instance of Caddy and then reloading its configuration, basically mimicking what the caddy-docker-proxy would do.

Sure, here is the streaming bouncer log and the live bouncer log. In each example I added/removed label "test: testing" on an upstream container to trigger a reload.

I am using this Dockerfile with caddy-docker-proxy, Cloudflare DNS, and Cloudflare IP modules.

@tenpaiyomi
Copy link

Just adding in, I am experiencing this behavior as well. I am using the caddy-docker-proxy in a slightly different manner from @sholdee, but to the same effect.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants