Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable validator monitor by default #4468

Merged
merged 4 commits into from
Jan 16, 2023
Merged

Enable validator monitor by default #4468

merged 4 commits into from
Jan 16, 2023

Conversation

arnetheduck
Copy link
Member

By enabling the validator monitor, more precise information about the lifecycle of an attestation is logged at the higher NOTICE log level while current sent messages are logged at INF instead, since they are less interesting.

In particular, missed attestations and those that vote for the wrong head are now detected and logged at NOTICE.

In addition to logging, this feature enables rich metrics around attestation and sync committee performance - by default, validators are tracked in aggregate but a detailed mode exists as well.

This feature has been available since early Nimbus days, but it has now been tuned and optimised such that it is safe to enable by default, even for large setups.

  • enable automatic validator monitoring by default
  • replace --validator-monitor-totals flag with --validator-monitor-details - the detailed mode is disabled by default
  • lower "sent" log level to INF for several messages - in particular those that are traced by the validator monitor

This is a retake on #3531 which was later reverted in #3578.

@github-actions
Copy link

github-actions bot commented Jan 6, 2023

Unit Test Results

         9 files  ±0    1 050 suites  ±0   33m 15s ⏱️ -19s
  3 512 tests ±0    3 275 ✔️ ±0  237 💤 ±0  0 ±0 
15 269 runs  ±0  15 004 ✔️ ±0  265 💤 ±0  0 ±0 

Results for commit 12fef9b. ± Comparison against base commit 7ad0d3e.

♻️ This comment has been updated with latest results.

@arnetheduck arnetheduck force-pushed the vmon-de-beta branch 3 times, most recently from a943222 to f0cc0e9 Compare January 15, 2023 08:12
By enabling the validator monitor, more precise information about the
lifecycle of an attestation is logged at the higher `NOTICE` log level
while current `sent` messages are logged at `INF` instead, since they
are less interesting.

In particular, missed attestations and those that vote for the wrong
head are now detected and logged at NOTICE.

In addition to logging, this feature enables rich metrics around
attestation and sync committee performance - by default, validators are
tracked in aggregate but a detailed mode exists as well

This feature has been available since early Nimbus days, but it has now
been tuned and optimised such that it is safe to enable by default, even
for large setups.

* enable automatic validator monitoring by default
* replace `--validator-monitor-totals` flag with
`--validator-monitor-details` - the detailed mode is disabled by default
* lower "sent" log level to `INF` for several messages - in particular
those that are traced by the validator monitor

This is a retake on #3531 which was later reverted in #3578.
@arnetheduck arnetheduck merged commit d8caab5 into unstable Jan 16, 2023
@arnetheduck arnetheduck deleted the vmon-de-beta branch January 16, 2023 10:28
jakubgs added a commit to status-im/infra-role-beacon-node-macos that referenced this pull request Jun 7, 2023
Replaced `--validator-monitor-totals` in:
status-im/nimbus-eth2#4468

Signed-off-by: Jakub Sokołowski <jakub@status.im>
jakubgs added a commit to status-im/infra-role-beacon-node-windows that referenced this pull request Jun 7, 2023
Replaced `--validator-monitor-totals` in:
status-im/nimbus-eth2#4468

Signed-off-by: Jakub Sokołowski <jakub@status.im>
jakubgs added a commit to status-im/infra-role-beacon-node-linux that referenced this pull request Jun 7, 2023
Replaced `--validator-monitor-totals` in:
status-im/nimbus-eth2#4468

Signed-off-by: Jakub Sokołowski <jakub@status.im>
jakubgs added a commit to status-im/infra-nimbus that referenced this pull request Jun 7, 2023
Replaced `--validator-monitor-totals` in:
status-im/nimbus-eth2#4468

Signed-off-by: Jakub Sokołowski <jakub@status.im>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant