Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Initial query limit overriding #3090

Merged
merged 89 commits into from
Jan 21, 2021
Merged
Show file tree
Hide file tree
Changes from 4 commits
Commits
Show all changes
89 commits
Select commit Hold shift + click to select a range
9e3b280
Initial query limit overriding
rallen090 Jan 14, 2021
d5ef8b4
Initial query limit overriding 2
rallen090 Jan 14, 2021
5ecdb41
Initial query limit overriding 3
rallen090 Jan 14, 2021
ab8384b
Initial query limit overriding 4
rallen090 Jan 14, 2021
06ad766
PR feedback
rallen090 Jan 14, 2021
6390dcf
Build fix
rallen090 Jan 14, 2021
c9b0ad0
Fix error wording
rallen090 Jan 14, 2021
0bba45e
Build fix 2
rallen090 Jan 14, 2021
b90cc5c
Fix limit test
rallen090 Jan 14, 2021
7916470
Fix limit test 2
rallen090 Jan 14, 2021
5c6ae76
Add Override test
rallen090 Jan 14, 2021
3285a62
Add Override test 2
rallen090 Jan 15, 2021
49b6513
Merge remote-tracking branch 'origin/master' into ra/dynamic-limits
rallen090 Jan 15, 2021
6df725b
Back query limits by etcd
rallen090 Jan 16, 2021
e7e23aa
Back query limits by etcd 2
rallen090 Jan 16, 2021
6c4bca4
Back query limits by etcd 3
rallen090 Jan 16, 2021
8f281b9
Build fix
rallen090 Jan 18, 2021
7b0d797
Build fix 2
rallen090 Jan 18, 2021
520f2de
Merge remote-tracking branch 'origin/master' into ra/dynamic-limits
rallen090 Jan 18, 2021
2ad8c09
Build fix 3
rallen090 Jan 18, 2021
bc50860
Build fix 4
rallen090 Jan 18, 2021
f2476c5
Lint
rallen090 Jan 18, 2021
9f4d9b1
Removing endpoint to instead use etcd directly
rallen090 Jan 18, 2021
33a7bf4
Removing endpoint to instead use etcd directly 2
rallen090 Jan 18, 2021
32f148f
Add back rpc mock
rallen090 Jan 18, 2021
66a0a42
Fix test
rallen090 Jan 18, 2021
a39700f
Fix test 2
rallen090 Jan 18, 2021
0e56187
Add back m3em_mock
rallen090 Jan 18, 2021
2dbef2c
Fix gen
rallen090 Jan 18, 2021
fb29267
Gen
rallen090 Jan 18, 2021
90bef8a
Lint
rallen090 Jan 18, 2021
d3747ec
Fix tests
rallen090 Jan 18, 2021
03f987f
Merge remote-tracking branch 'origin/master' into ra/dynamic-limits
rallen090 Jan 18, 2021
053739b
Rebased
rallen090 Jan 18, 2021
2272d5e
Rebased 2
rallen090 Jan 18, 2021
dddecfb
Test fix
rallen090 Jan 18, 2021
0bc4306
Lint
rallen090 Jan 18, 2021
8e249e6
Test fix 2
rallen090 Jan 18, 2021
c8507c0
Fix logs
rallen090 Jan 18, 2021
027aaae
Add limit logs and metrics
rallen090 Jan 19, 2021
40948e0
Merge remote-tracking branch 'origin/master' into ra/dynamic-limits
rallen090 Jan 19, 2021
8b9b602
Test reset
rallen090 Jan 19, 2021
98efb93
Add etcd kv update endpoint 1
rallen090 Jan 19, 2021
6be4a30
Add etcd kv update endpoint 2
rallen090 Jan 19, 2021
db34398
Add etcd kv update endpoint 3
rallen090 Jan 19, 2021
02fcd56
Add etcd kv update endpoint 4
rallen090 Jan 19, 2021
8351c89
Add etcd kv update endpoint 5
rallen090 Jan 19, 2021
731ec5f
Remove reset
rallen090 Jan 19, 2021
ffcea5e
Add back mock
rallen090 Jan 19, 2021
6c42ae2
Fixing tests
rallen090 Jan 19, 2021
a86d55f
More build fixes
rallen090 Jan 19, 2021
b86fdcf
Merge remote-tracking branch 'origin/master' into ra/dynamic-limits
rallen090 Jan 19, 2021
7dc8689
Integration test fix
rallen090 Jan 19, 2021
3ec7673
Add back mock
rallen090 Jan 20, 2021
6a8f9ed
PR feedback 1
rallen090 Jan 20, 2021
c05b6c9
Comment
rallen090 Jan 20, 2021
79cd2e4
Test fix
rallen090 Jan 20, 2021
0a31c53
Cleanup
rallen090 Jan 20, 2021
38cabbd
Lint
rallen090 Jan 20, 2021
5f81a75
Merge remote-tracking branch 'origin/master' into ra/dynamic-limits
rallen090 Jan 20, 2021
a9621f7
Lint 2
rallen090 Jan 20, 2021
f488d68
Lint 3
rallen090 Jan 20, 2021
c5e0683
Cleanup 2
rallen090 Jan 20, 2021
316a7d3
Dep order
rallen090 Jan 20, 2021
e3480a8
Fix stop race
rallen090 Jan 20, 2021
6e15b82
Merge remote-tracking branch 'origin/master' into ra/dynamic-limits
rallen090 Jan 20, 2021
450acce
Fix integration test
rallen090 Jan 20, 2021
5208b2c
PR feedback
rallen090 Jan 20, 2021
f880627
PR feedback 2
rallen090 Jan 20, 2021
4cdea4c
Add kvstore test
rallen090 Jan 20, 2021
9fc90b8
More tests
rallen090 Jan 20, 2021
9b422ad
More tests 2
rallen090 Jan 20, 2021
a3c0857
More tests 3
rallen090 Jan 20, 2021
34a5e3e
Lint
rallen090 Jan 20, 2021
bdd3ad4
Fallback to config-based limits if unset in dynamic
rallen090 Jan 20, 2021
aa89830
Fixes from feedback
rallen090 Jan 20, 2021
314e43f
Add docs around dynamic limits
rallen090 Jan 20, 2021
24b7e87
More docs
rallen090 Jan 20, 2021
8596169
More doc updates
rallen090 Jan 21, 2021
bbc474e
Merge remote-tracking branch 'origin/master' into ra/dynamic-limits
rallen090 Jan 21, 2021
0967ae6
Reorganize limit setting code
rallen090 Jan 21, 2021
6f540d6
Reorganize limit setting code 2
rallen090 Jan 21, 2021
21732ef
Add more comprehensive locking
rallen090 Jan 21, 2021
4a4d5cd
Update wording
rallen090 Jan 21, 2021
5e00b23
Update docs more
rallen090 Jan 21, 2021
a943da0
Update docs more 2
rallen090 Jan 21, 2021
b659237
PR feedback
rallen090 Jan 21, 2021
7fc778a
Merge remote-tracking branch 'origin/master' into ra/dynamic-limits
rallen090 Jan 21, 2021
e07440d
PR feedback 2
rallen090 Jan 21, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 11 additions & 0 deletions src/dbnode/generated/thrift/rpc.thrift
Original file line number Diff line number Diff line change
Expand Up @@ -85,6 +85,7 @@ service Node {
NodeWriteNewSeriesBackoffDurationResult setWriteNewSeriesBackoffDuration(1: NodeSetWriteNewSeriesBackoffDurationRequest req) throws (1: Error err)
NodeWriteNewSeriesLimitPerShardPerSecondResult getWriteNewSeriesLimitPerShardPerSecond() throws (1: Error err)
NodeWriteNewSeriesLimitPerShardPerSecondResult setWriteNewSeriesLimitPerShardPerSecond(1: NodeSetWriteNewSeriesLimitPerShardPerSecondRequest req) throws (1: Error err)
NodeQueryLimitOverridesResult setQueryLimitOverrides(1: NodeSetQueryLimitOverridesRequest req) throws (1: Error err)

// Debug endpoints
DebugProfileStartResult debugProfileStart(1: DebugProfileStartRequest req) throws (1: Error err)
Expand Down Expand Up @@ -367,6 +368,16 @@ struct NodeSetWriteNewSeriesLimitPerShardPerSecondRequest {
1: required i64 writeNewSeriesLimitPerShardPerSecond
}

struct NodeQueryLimitOverridesResult {
1: optional i64 docsLimitOverride
2: optional i64 bytesReadLimitOverride
}

struct NodeSetQueryLimitOverridesRequest {
1: optional i64 docsLimitOverride
2: optional i64 bytesReadLimitOverride
}

service Cluster {
HealthResult health() throws (1: Error err)
void write(1: WriteRequest req) throws (1: Error err)
Expand Down
Loading