Skip to content

Comments

Validator client head monitor timeout fix#8846

Merged
mergify[bot] merged 5 commits intosigp:release-v8.1from
michaelsproul:timeout-fix
Feb 18, 2026
Merged

Validator client head monitor timeout fix#8846
mergify[bot] merged 5 commits intosigp:release-v8.1from
michaelsproul:timeout-fix

Conversation

@michaelsproul
Copy link
Member

@michaelsproul michaelsproul commented Feb 18, 2026

Issue Addressed

Fix a bug in v8.1.0 whereby the VC times out continuously with:

Feb 18 02:03:48.030 WARN Head service failed retrying starting next slot error: "Head monitoring stream error, node: 0, error: SseClient(Transport(reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } }))"

Proposed Changes

  • Remove the existing timeout for the events API by using Duration::MAX. This is necessary as the client is configured with a default timeout. This is the only way to override/remove it.
  • DO NOT add a read_timeout (yet), as this would need to be configured on a per-client basis. We do not want to create a new Client for every call as the early commits on this branch were doing, as this would bypass the TLS cert config, and is also wasteful.

Additional Info

Awaiting confirmation that this fix works after manual testing. Will update.

@michaelsproul michaelsproul added bug Something isn't working val-client Relates to the validator client binary v8.1.1 Hotfix for v8.1.0 labels Feb 18, 2026
@michaelsproul michaelsproul added the ready-for-review The code is ready for review label Feb 18, 2026
@michaelsproul
Copy link
Member Author

Can confirm that manual testing on a VC shows that the timeout is gone (tested commit cc1d64d).

Copy link
Member

@jimmygchen jimmygchen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

@jimmygchen jimmygchen added ready-for-merge This PR is ready to merge. and removed ready-for-review The code is ready for review labels Feb 18, 2026
@mergify mergify bot added the queued label Feb 18, 2026
@michaelsproul
Copy link
Member Author

Can also confirm that stopping one of the attached VCs results in:

Feb 18 04:22:09.149 WARN Head service failed retrying starting next slot error: "Head monitoring stream error, node: 0, error: SseClient(StreamEnded)"

@mergify
Copy link

mergify bot commented Feb 18, 2026

Merge Queue Status

Rule: default


This pull request spent 32 minutes 39 seconds in the queue, including 31 minutes 2 seconds running CI.

Required conditions to merge
  • check-success=local-testnet-success
  • check-success=test-suite-success

mergify bot added a commit that referenced this pull request Feb 18, 2026
@mergify mergify bot merged commit be799cb into sigp:release-v8.1 Feb 18, 2026
36 checks passed
@mergify mergify bot removed the queued label Feb 18, 2026
@michaelsproul michaelsproul deleted the timeout-fix branch February 18, 2026 05:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working ready-for-merge This PR is ready to merge. v8.1.1 Hotfix for v8.1.0 val-client Relates to the validator client binary

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants