Spring MANUAL_IMMEDIATE/MANUAL Acknolwedgement with retry #2078
Replies: 2 comments 4 replies
-
Committing an offset on one partition has no bearing on the offsets in other partitions. You should generally not processes (and acknowledge) records out of order within a partitions, since Kafka only maintains a committed offsets. The 2.8 release optionally supports out of order commits within a partition by deferring the later commits until the gaps are filled. |
Beta Was this translation helpful? Give feedback.
-
So a client needs to maintain the offsets of the message its processing for manual processing. how would messages with a larger offset be processed before a shorter offset ? For ex how can a. consumer process a message with offset 10 before processing offset 5 within a partion ? Kakfa sends 5 before sending 10 , is that right ? |
Beta Was this translation helpful? Give feedback.
-
Hi
our app listens to message from an upstream order provider. With manula acknowledgement we are loosing messages incase of a DB Failure . Manual/Manual_IMMEDIATE will help with this. When we ack on a give message it acks that offset and all the messages till then. Is there a possibility of loosing messages with offset committed till then. Kakfa has ordering in a given partition but no ordering exists across partitions. If a commit happens on partition with offset 10 and other parition is processing 5th offset. will we loose 5 messages?
Beta Was this translation helpful? Give feedback.
All reactions