Skip to content
This repository has been archived by the owner on Oct 23, 2023. It is now read-only.

Investigate & implement 2 Phase checkpoints to reduce duplication on failover #43

Open
markglh opened this issue Dec 28, 2017 · 0 comments

Comments

@markglh
Copy link
Contributor

markglh commented Dec 28, 2017

Applications can now set a pending checkpoint, before completing the checkpoint operation. Once the application has completed its checkpoint steps, the final checkpoint will clear the pending checkpoint.
Should the checkpoint fail the attempted sequence number is provided in the InitializationInput#getPendingCheckpointSequenceNumber otherwise the value will be null.

See: awslabs/amazon-kinesis-client#188

This passes the pendingCheckpoint to the new RecordProcessor upon failover, allowing it to continue at that record if the actual checkpoint failed.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Development

No branches or pull requests

1 participant