Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Adds visibility into the L1 client. In retrospect these are the metrics we would have needed to automate monitoring for the issue we observed recently with stuck L1 clients on decaf. We can add alerts on
consensus_l1_head
increasing to catch issues like this faster in the future.This PR:
Adds the following metrics to give visibility into the L1 client:
consensus_l1_head
: the block number that the node thinks is the current L1 headconsensus_l1_finalized
: the block number that the node thinks is the most recently finalized L1 blockconsensus_l1_ws_reconnects
: the number of times the node has had to reestablish a WebSockets connectionconsensus_l1_stream_reconnects
: the number of times the node has had to reestablish a blocks filter or subscriptionLogs L1 RPC errors at RPC client layer. This ensures all errors get logged straight from the RPC, even if they are ultimately swallowed at a higher level (as in the Ethers
FilterWatcher
stream). This will give us much better insight into future problems with the L1.