Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

does kafka logger support multi address? #679

Open
LamberMa opened this issue Apr 15, 2024 · 2 comments
Open

does kafka logger support multi address? #679

LamberMa opened this issue Apr 15, 2024 · 2 comments
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@LamberMa
Copy link

Is your feature request related to a problem? Please describe.
I have a Kafka cluster with three machines, but I haven't found a configuration method for multiple machines in this project. Does this mean that the configuration for multiple hosts is temporarily not supported?

My config as below

    - name: kafka
      kafkaproducer:
        remote-address: kafka1,kafka2,kafka3
        remote-port: 9092

the errors is

Apr 15 18:46:41 office-dns-recursor-vm-172-22-235-188.bj-y-kwai.it go-dnscollector[28107]: INFO: 2024/04/15 18:46:41.153137 logger - [kafka] kafka - retry to connect in 10 seconds
Apr 15 18:46:41 office-dns-recursor-vm-172-22-235-188.bj-y-kwai.it go-dnscollector[28107]: ERROR: 2024/04/15 18:46:41.153156 logger - [kafka] kafka - failed to established connection

The second question is, for my Kafka topic with 30 partitions, I noticed there's a configuration option specifying the partition to write to. If it's not specified, will the data be randomly written to one of these 30 partitions?

thank you ~

@dmachard dmachard added the enhancement New feature or request label Apr 15, 2024
@dmachard dmachard added the help wanted Extra attention is needed label May 26, 2024
@dmachard
Copy link
Owner

dmachard commented Jun 30, 2024

The second question is, for my Kafka topic with 30 partitions, I noticed there's a configuration option specifying the partition to write to. If it's not specified, will the data be randomly written to one of these 30 partitions?

The next release will support writing in round robin way when the partition setting is null.

@dmachard
Copy link
Owner

dmachard commented Jul 1, 2024

I have a Kafka cluster with three machines, but I haven't found a configuration method for multiple machines in this project. Does this mean that the configuration for multiple hosts is temporarily not supported?

Currently, multiple addresses is not supported.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants