Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RD_KAFKA_RESP_ERR_REBALANCE_IN_PROGRESS - “Group rebalance in progress“ breaks consumption of a topic #325

Open
sash opened this issue Nov 22, 2024 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@sash
Copy link
Contributor

sash commented Nov 22, 2024

Describe the bug
When consuming from time to time I get RD_KAFKA_RESP_ERR_REBALANCE_IN_PROGRESS from the broker. Those are short lived and look like something that has to be retried.

To Reproduce
I don’t have a way to cause rebalancing on queue to reproduce - this is something I observe in the runtime logs.

Expected behavior
I would think that the RD_KAFKA_RESP_ERR_REBALANCE_IN_PROGRESS should be one of the Retriable Errors in RetryableCommitter to have a retry auto applied when consuming.

Suggested fix (not tested)
See https://github.com/mateusjunges/laravel-kafka/blob/master/src/Commit/RetryableCommitter.php and add RD_KAFKA_RESP_ERR_REBALANCE_IN_PROGRESS to RETRYABLE_ERRORS

@sash sash added the bug Something isn't working label Nov 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants