Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Develop a soak test for the Vrl Bytecode VM #9832

Closed
StephenWakely opened this issue Oct 29, 2021 · 2 comments · Fixed by #9849
Closed

Develop a soak test for the Vrl Bytecode VM #9832

StephenWakely opened this issue Oct 29, 2021 · 2 comments · Fixed by #9849
Assignees
Labels
type: task Generic non-code related tasks

Comments

@StephenWakely
Copy link
Contributor

Ref #9515

It would be highly useful to have some accurate benchmarks for the work in #9829 so we can ascertain how much of a benefit moving Vrl to compile and run with a Bytecode VM.

A useful config to test with would be:

[sources.in]
type = "http"
address = "0.0.0.0:8080"
encoding = "text"

[transforms.remap]
type = "remap"
inputs = ["in"]
source = '''
.hostname = "vector"

if .status == "warning" {
  .thing = upcase(.hostname)
} else if .status == "notice" {
  .thung = downcase(.hostname)
} else {
  .nong = upcase(.hostname)
}

.matches = { "name": .message, "num": "2" }
.origin, .err = .hostname + "/" + .matches.name + "/" + .matches.num
'''

[sinks.blackhole]
type = "blackhole"
inputs = ["remap"]

SHA to test against: 9d6108d

@StephenWakely StephenWakely added the type: task Generic non-code related tasks label Oct 29, 2021
@blt blt self-assigned this Nov 1, 2021
@blt
Copy link
Contributor

blt commented Nov 1, 2021

Blocked pending #9818.

@StephenWakely
Copy link
Contributor Author

Lading config:

worker_threads = 10
prometheus_addr = "0.0.0.0:9001"

[targets.simple]
target_uri = "http://localhost:8080/"
bytes_per_second = "5000 Mb"
parallel_connections = 100
method.type = "Post"
method.variant = "Json"
method.maximum_prebuild_cache_size_bytes = "500 Mb"

[targets.simple.headers]
dd-api-key = "deadbeef"

blt added a commit that referenced this issue Nov 1, 2021
This commit introduces a new soak that does not output, intending to test only
VRL performance. This is in service to the VRL performance work being done by
@StephenWakely.

Closes #9831
Closes #9832
REF #9515

Signed-off-by: Brian L. Troutwine <brian@troutwine.us>
blt added a commit that referenced this issue Nov 2, 2021
This commit introduces a new soak that does not output, intending to test only
VRL performance. This is in service to the VRL performance work being done by
@StephenWakely.

Closes #9831
Closes #9832
REF #9515

Signed-off-by: Brian L. Troutwine <brian@troutwine.us>
@blt blt closed this as completed in #9849 Nov 2, 2021
blt added a commit that referenced this issue Nov 2, 2021
* Introduce new datadog-agent -> vrl -> blackhole soak

This commit introduces a new soak that does not output, intending to test only
VRL performance. This is in service to the VRL performance work being done by
@StephenWakely.

Closes #9831
Closes #9832
REF #9515

Signed-off-by: Brian L. Troutwine <brian@troutwine.us>

* add soak to workflow

Signed-off-by: Brian L. Troutwine <brian@troutwine.us>

* adjust naming scheme

Signed-off-by: Brian L. Troutwine <brian@troutwine.us>

* update with master

Signed-off-by: Brian L. Troutwine <brian@troutwine.us>

* removing del because it's not well supported

Signed-off-by: Brian L. Troutwine <brian@troutwine.us>
lucperkins pushed a commit that referenced this issue Nov 2, 2021
* Introduce new datadog-agent -> vrl -> blackhole soak

This commit introduces a new soak that does not output, intending to test only
VRL performance. This is in service to the VRL performance work being done by
@StephenWakely.

Closes #9831
Closes #9832
REF #9515

Signed-off-by: Brian L. Troutwine <brian@troutwine.us>

* add soak to workflow

Signed-off-by: Brian L. Troutwine <brian@troutwine.us>

* adjust naming scheme

Signed-off-by: Brian L. Troutwine <brian@troutwine.us>

* update with master

Signed-off-by: Brian L. Troutwine <brian@troutwine.us>

* removing del because it's not well supported

Signed-off-by: Brian L. Troutwine <brian@troutwine.us>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: task Generic non-code related tasks
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants