Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

B #5

Merged
merged 131 commits into from
Oct 7, 2024
Merged

B #5

merged 131 commits into from
Oct 7, 2024

Conversation

RotemCDos
Copy link

What this PR does / why we need it:

Which issue(s) this PR fixes:
Fixes #

Special notes for your reviewer:

Checklist

  • Reviewed the CONTRIBUTING.md guide (required)
  • Documentation added
  • Tests updated
  • Title matches the required conventional commits format, see here
    • Note that Promtail is considered to be feature complete, and future development for logs collection will be in Grafana Alloy. As such, feat PRs are unlikely to be accepted unless a case can be made for the feature actually being a bug fix to existing behavior.
  • Changes that require user attention or interaction to upgrade are documented in docs/sources/setup/upgrade/_index.md
  • If the change is deprecating or removing a configuration option, update the deprecated-config.yaml and deleted-config.yaml files respectively in the tools/deprecated-config-checker directory. Example PR

jeschkies and others added 30 commits September 18, 2024 14:21
…ets (#13991)

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>
Signed-off-by: Christian Haudum <christian.haudum@gmail.com>
…cy is enabled (#13914)

Co-authored-by: J Stickler <julie.stickler@grafana.com>
Signed-off-by: QuentinBisson <quentin@giantswarm.io>
…e job names (#13719)

Signed-off-by: François Gouteroux <francois.gouteroux@gmail.com>
…scalable deployment (#13023)

Signed-off-by: QuentinBisson <quentin@giantswarm.io>
Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com>
This PR allows hiding the bloom dashboards if they are not used.
Compression tooling has been part of the `chunkenc` (chunk encoding) package in the past for legacy reasons.

Since more components use this now, it's easier to keep it in a separate package. This also eliminates the confusion around "encoding", since this has been incorrectly used synonymously with "compression" in the past.

---
Signed-off-by: Christian Haudum <christian.haudum@gmail.com>
Co-authored-by: Robert Fratto <robertfratto@gmail.com>
Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com>
**What this PR does / why we need it**:
Modify our `validateEntries` code to report a log failure when a PSRL is identified.
…from (#14188)

Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com>
…th (#14181)

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>
This PR tries to eliminate dead code in the bloom package, mainly related to line tokenization.

Signed-off-by: Christian Haudum <christian.haudum@gmail.com>
**What this PR does / why we need it**:
Adds support for `IsRetryableErr`in the `S3ObjectClient`, similar to what is found in the `GCSObjectClient`
Signed-off-by: QuentinBisson <quentin@giantswarm.io>
Co-authored-by: Vladyslav Diachenko <82767850+vlad-diachenko@users.noreply.github.com>
Co-authored-by: Callum Styan <callumstyan@gmail.com>
Signed-off-by: Christian Haudum <christian.haudum@gmail.com>
Co-authored-by: J Stickler <julie.stickler@grafana.com>
This PR fixes the disk read and writes dashboards to support node-exporter pod name changes when node changes often (tools like karpenter for instance, autoscaling, etc.) as this causes duplicate entries when checking metrics over 1h
#14201)

Modify the `tokengen` and `provisioner` to check for `rbac.namespaced` before creating the role, as we do with the backend component. This is a fix as we were expected to do this check.
)

Decompression is a CPU intensive task, especially un-gzipping. The gain of compressing a tar archive of storage optimized binary blocks is neglectable (question: is it?).

In this example, the block of ~170MiB is ~3.3MiB bigger when not compressed, which is a ratio of ~2%

```bash
$ ls -las 2bc017f79711e12a-2bffc5dcc0e8e964_1726004114913-1726106283939-bc42f529.tar   
177048 -rw-rw-r-- 1 christian christian 181293056 Sep 18 13:49 2bc017f79711e12a-2bffc5dcc0e8e964_1726004114913-1726106283939-bc42f529.tar

$ ls -las 2bc017f79711e12a-2bffc5dcc0e8e964_1726004114913-1726106283939-bc42f529.tar.gz
173732 -rw-rw-r-- 1 christian christian 177897689 Sep 18 13:49 2bc017f79711e12a-2bffc5dcc0e8e964_1726004114913-1726106283939-bc42f529.tar.gz

$ qalc '(181293056 - 177897689) / 1024/ 1024'
((181293056 − 177897689) / 1024) / 1024 ≈ 3.238074303

$ qalc '181293056 / 177897689'
181293056 / 177897689 ≈ 1.019086066
```

After some consideration, we decided to store the encoding of the bloom block in the `BlockRef`. This means, that the changes in this PR do not break compatibility with existing blocks compressed with gzip, although new blocks will not be compressed any more.
However, the PR adds support for different compression algorithms, such as gzip, snappy, lz4, flate, and zstd. Compression is not configurable yet.

---

Signed-off-by: Christian Haudum <christian.haudum@gmail.com>
trevorwhitney and others added 26 commits October 2, 2024 09:17
)

Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
…14352)

Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
- Transform our `ObjectExistsWithSize` API into `GetAttributes` to conform with the existing Thanos API.
- Fix we not returning the size when we should on our s3 implementation of `ObjectSize`
- Fix not returning `false, nil` to `ObjectExists` when the only error seen is a `NotFound`. If someone calls `ObjectExists` it should return `false, nil` to a `NotExist` error, instead of `false, err`
Co-authored-by: Jack Baldry <jack.baldry@grafana.com>
…recording/alert rules (#11495)

Signed-off-by: Alexander Soelberg Heidarsson <89837986+alex5517@users.noreply.github.com>
Previously, the bloom page size was hard-coded to 256KB. However, 256KB
is much smaller than the normal bloom size, leading to nearly every
bloom page to be overfilled with a single, massive bloom.

Binding the bloom page size to the maximum bloom size allows bloom pages
to contain multiple smaller blooms (which are still larger than 256KB)
or one maxed out bloom.

Signed-off-by: Robert Fratto <robertfratto@gmail.com>
The ring client pool has functionality, such as periodic health checking of the servers and removing of stale clients, which is not needed in the JumpHashClientPool.

The removal of stale clients was problematic, because it compared the original server list (which is a list of CNAME records from the DNS lookup) with the client cache, which uses the IP of the server as key. Therefore it removed all cached clients on every check interval.

Signed-off-by: Christian Haudum <christian.haudum@gmail.com>
…4357)

Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
…to Helm chart (#14011)

Co-authored-by: Vladyslav Diachenko <82767850+vlad-diachenko@users.noreply.github.com>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
This change is necessary to allow the binaries built using the Loki build image to run on operating systems with older libc version.

Signed-off-by: Christian Haudum <christian.haudum@gmail.com>
Co-authored-by: J Stickler <julie.stickler@grafana.com>
Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com>
…14393)

This commit fixes a panic that occurs with the following json parser expression:

```
| json keys[""]
```

when the log line is the following:

```json
{"keys": ["a", "b", "c"]}
```

Signed-off-by: Christian Haudum <christian.haudum@gmail.com>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
@RotemCDos RotemCDos merged commit e426802 into Observabiliteam:feat/global-config Oct 7, 2024
38 of 40 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.