Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Introduce shardable probabilistic topk for instant queries. #14243

Open
wants to merge 35 commits into
base: main
Choose a base branch
from
Open

feat: Introduce shardable probabilistic topk for instant queries. #14243

wants to merge 35 commits into from

Commits on Oct 2, 2024

  1. feat: shard instant topk queries with count min sketch.

    @jeschkies
    jeschkies committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    c917201 View commit details
    Browse the repository at this point in the history

  2. Make it compile

    @jeschkies
    jeschkies committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    66dc3f0 View commit details
    Browse the repository at this point in the history

  3. Update range

    @jeschkies
    jeschkies committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    215754c View commit details
    Browse the repository at this point in the history

  4. Fix a few testing bugs

    @jeschkies
    jeschkies committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    436302f View commit details
    Browse the repository at this point in the history

  5. Calculate width and depth

    @jeschkies
    jeschkies committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    6e53380 View commit details
    Browse the repository at this point in the history

  6. Format code

    @jeschkies
    jeschkies committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    91133e7 View commit details
    Browse the repository at this point in the history

  7. Remove redundant return

    @jeschkies
    jeschkies committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    9a07276 View commit details
    Browse the repository at this point in the history

  8. Keep a limited number of labels

    @jeschkies
    jeschkies committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    6dab358 View commit details
    Browse the repository at this point in the history

  9. Save one metric to string

    @jeschkies
    jeschkies committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    7849984 View commit details
    Browse the repository at this point in the history

  10. Convert limited label vector

    @jeschkies
    jeschkies committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    c9726cc View commit details
    Browse the repository at this point in the history

  11. Rename vector

    @jeschkies
    jeschkies committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    947a924 View commit details
    Browse the repository at this point in the history

  12. Remove todo

    @jeschkies
    jeschkies committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    33acd3b View commit details
    Browse the repository at this point in the history

  13. Checkin heap test

    @jeschkies
    jeschkies committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    9ac2030 View commit details
    Browse the repository at this point in the history

  14. Fix vector name

    @jeschkies
    jeschkies committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    acb7754 View commit details
    Browse the repository at this point in the history

  15. Fix marshalling

    @jeschkies
    jeschkies committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    ad742f1 View commit details
    Browse the repository at this point in the history

  16. Remove commented code from shard_resolver.

    @jeschkies
    jeschkies committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    6762512 View commit details
    Browse the repository at this point in the history

  17. Actually merge metrics

    @jeschkies
    jeschkies committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    c7c9ad4 View commit details
    Browse the repository at this point in the history

  18. Validate that approx_topk is not using groups

    @jeschkies
    jeschkies committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    3c3024e View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2024

  1. support unsharded approx_topk

    @jeschkies
    jeschkies committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    a6f9053 View commit details
    Browse the repository at this point in the history

  2. Support per tenant activation

    @jeschkies
    jeschkies committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    09f7ee1 View commit details
    Browse the repository at this point in the history

  3. Make the max heap size configurable

    @jeschkies
    jeschkies committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    71c02fa View commit details
    Browse the repository at this point in the history

  4. Test shard mapper

    @jeschkies
    jeschkies committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    7d71609 View commit details
    Browse the repository at this point in the history

  5. Test protobuf serialization

    @jeschkies
    jeschkies committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    ba2ecec View commit details
    Browse the repository at this point in the history

  6. Remove nil group

    @jeschkies
    jeschkies committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    5ae7998 View commit details
    Browse the repository at this point in the history

  7. Test approx_topk integration

    @jeschkies
    jeschkies committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    385e161 View commit details
    Browse the repository at this point in the history

  8. Merge remote-tracking branch 'grafana/main' into karsten/ptopk

    @jeschkies
    jeschkies committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    4ccead2 View commit details
    Browse the repository at this point in the history

  9. Satisfy linter

    @jeschkies
    jeschkies committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    ac494bd View commit details
    Browse the repository at this point in the history

  10. Define separate approx topk equivalence test

    @jeschkies
    jeschkies committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    43cf741 View commit details
    Browse the repository at this point in the history

  11. Correct error string

    @jeschkies
    jeschkies committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    ecc9050 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2024

  1. Add more test cases to show how accurate the result for each item in the 

    topk actually is.

Signed-off-by: Callum Styan <callumstyan@gmail.com>
    @cstyan
    cstyan committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    24edc7b View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. Add another test case

    @jeschkies
    jeschkies committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    681cd2e View commit details
    Browse the repository at this point in the history

  2. Remove deadline

    @jeschkies
    jeschkies committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    de7d83c View commit details
    Browse the repository at this point in the history

  3. No timeout limit

    @jeschkies
    jeschkies committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    2da4270 View commit details
    Browse the repository at this point in the history

  4. Test intersectiion

    @jeschkies
    jeschkies committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    00a7e1f View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. Remove test

    @jeschkies
    jeschkies committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    524a10f View commit details
    Browse the repository at this point in the history