Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(obs): Improve builtin grafana setup to have traces and logs linked #2716

Merged
merged 1 commit into from
Sep 2, 2021

Conversation

lahabana
Copy link
Contributor

@lahabana lahabana commented Sep 1, 2021

Summary

Improve our out of the box grafana setup with links between logs and traces.

Full changelog

  • Add datasources for jaeger and loki in metrics install.
    It simplifies life after and doesn't cause any problems if there's no jaeger installed.
  • Add traces to access log format
  • Extract correct timestamp, mesh and add node_id as a key in promtail
  • Add links between traces and access logs in grafana.

Documentation

TODO

Testing

  • Unit tests
  • E2E tests
  • Manual testing on Universal
  • Manual testing on Kubernetes

Backwards compatibility

  • Add backport-to-stable label if the code is backwards compatible. Otherwise, list breaking changes.

@lahabana lahabana requested a review from a team as a code owner September 1, 2021 17:43
@lahabana
Copy link
Contributor Author

lahabana commented Sep 1, 2021

Feels like the next step for this out-of-the-box setup will be to replace kuma install {metrics,logging,tracing} with kuma install observability {grafana,datadog...}.

@lahabana
Copy link
Contributor Author

lahabana commented Sep 1, 2021

Here's a screenshot of what it does:

Screenshot 2021-09-01 at 19 33 38

- Add datasources for jaeger and loki in `metrics install`.
    It simplifies life after and doesn't cause any problems if there's no jaeger installed.
- Add traces to access log format
- Extract correct timestamp, mesh and add node_id as a key in promtail
- Add links between traces and access logs in grafana.

Signed-off-by: Charly Molter <charly.molter@konghq.com>
@lahabana lahabana force-pushed the feat/traceIdLogging branch from 9d00273 to c1bcc6d Compare September 2, 2021 07:52
@lahabana lahabana merged commit dfe1e38 into kumahq:master Sep 2, 2021
mergify bot pushed a commit that referenced this pull request Sep 2, 2021
…ed (#2716)

- Add datasources for jaeger and loki in `metrics install`.
    It simplifies life after and doesn't cause any problems if there's no jaeger installed.
- Add traces to access log format
- Extract correct timestamp, mesh and add node_id as a key in promtail
- Add links between traces and access logs in grafana.

Signed-off-by: Charly Molter <charly.molter@konghq.com>
(cherry picked from commit dfe1e38)
lahabana added a commit that referenced this pull request Sep 2, 2021
…ed (#2716) (#2723)

- Add datasources for jaeger and loki in `metrics install`.
    It simplifies life after and doesn't cause any problems if there's no jaeger installed.
- Add traces to access log format
- Extract correct timestamp, mesh and add node_id as a key in promtail
- Add links between traces and access logs in grafana.

Signed-off-by: Charly Molter <charly.molter@konghq.com>
(cherry picked from commit dfe1e38)

Co-authored-by: Charly Molter <charly.molter@konghq.com>
nikita15p pushed a commit to nikita15p/kuma that referenced this pull request Sep 28, 2021
…ed (kumahq#2716)

- Add datasources for jaeger and loki in `metrics install`.
    It simplifies life after and doesn't cause any problems if there's no jaeger installed.
- Add traces to access log format
- Extract correct timestamp, mesh and add node_id as a key in promtail
- Add links between traces and access logs in grafana.

Signed-off-by: Charly Molter <charly.molter@konghq.com>
nikita15p pushed a commit to nikita15p/kuma that referenced this pull request Sep 28, 2021
…ed (kumahq#2716)

- Add datasources for jaeger and loki in `metrics install`.
    It simplifies life after and doesn't cause any problems if there's no jaeger installed.
- Add traces to access log format
- Extract correct timestamp, mesh and add node_id as a key in promtail
- Add links between traces and access logs in grafana.

Signed-off-by: Charly Molter <charly.molter@konghq.com>
@lahabana lahabana deleted the feat/traceIdLogging branch March 29, 2024 12:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants