Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set up initial infrastructure for Grafana metrics capture with docker monitoring stack #797

Merged
merged 2 commits into from
Sep 13, 2022

Conversation

kylehuntsman
Copy link
Contributor

@kylehuntsman kylehuntsman commented Sep 13, 2022

This sets up the initial infrastructure needed to capture boost and booster-http metrics via the docker monitoring stack.

  • Modified the metrics exporter to work with any boost process outside of boostd, instead of just for boostd
    • Instantiates an exporter for booster-http to capture request counts and durations
  • Dashboard for metrics are saved in /docker/monitoring/dashboards/exported_dashboard.json
    • The dashboard panels can still be modified in browser, but when saving you will be prompted to copy the JSON model of the dashboard to your clipboard. PRs will need to be made to modify the dashboard panels.
  • Prometheus was told to watch the booster-http process via the /docker/monitoring/prometheus.yaml
  • Additionally, adds a trace to booster-http's /piece/<piece-cid> endpoint

When running both the devnet and the monitoring docker stacks, the command docker network connect devnet prometheus must be ran after starting both stacks to ensure prometheus can actually talk to the processes running in the devnet stack.

Updates #772

@kylehuntsman kylehuntsman linked an issue Sep 13, 2022 that may be closed by this pull request
5 tasks
- ./grafana.ini:/etc/grafana/grafana.ini
- ./grafana-datasources.yaml:/etc/grafana/provisioning/datasources/datasources.yaml
#environment:
- ./grafana/config.ini:/etc/grafana/config.ini
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this work? I thought we need to have /etc/grafana/grafana.ini.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm fairly certain this is okay, but let me double check the tracing functionality

Copy link
Contributor Author

@kylehuntsman kylehuntsman Sep 13, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, this is fine. I discovered that the only things that are important are where the file is located and what file extension it has. As long as those two things are right, Grafana will read the file and determine what it is.

metrics/exporter.go Outdated Show resolved Hide resolved
@nonsense nonsense merged commit 847ccc9 into main Sep 13, 2022
@kylehuntsman kylehuntsman deleted the kylehuntsman/metrics-infra branch October 27, 2022 21:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants