Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set lower queue.buffering.max.ms #41

Open
dlapets opened this issue Nov 7, 2018 · 3 comments
Open

Set lower queue.buffering.max.ms #41

dlapets opened this issue Nov 7, 2018 · 3 comments

Comments

@dlapets
Copy link

dlapets commented Nov 7, 2018

As a backend developer, in order to see config changes propagate faster between DCs, I would like the schaufel handling backend-invalidations flush faster.

Right now it can take up to a second before data is flushed, which is not great for us. It would be great if this could be reduced to something like 100ms.

Related discussion:
https://adjust.slack.com/archives/C0T3QJQRX/p1541597376096900

cc @adjust/backend

@65278
Copy link
Contributor

65278 commented Feb 10, 2020

A very late heads up, but is this still relevant? With the latest release, this ought to be possible.

@fmstephe
Copy link

Lowering the latency of invalidations will always improve our system. We would really like to have this if it is feasible.

@65278
Copy link
Contributor

65278 commented Feb 10, 2020

We can set kafka options per producer/consumer now, so this doesn't conflict with bagger any more. I'll create a ticket in infra.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants