Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(azure_blob sink): migrate to new sink style #11644

Merged
merged 3 commits into from
Mar 10, 2022
Merged

Conversation

jdrouet
Copy link
Contributor

@jdrouet jdrouet commented Mar 2, 2022

The azure_blob sink is already following the new sink style, this PR just splits the module in separate files

closes OP-143
linked to #9261

Signed-off-by: Jérémie Drouet jeremie.drouet@datadoghq.com

@jdrouet jdrouet self-assigned this Mar 2, 2022
@netlify
Copy link

netlify bot commented Mar 2, 2022

✔️ Deploy Preview for vector-project canceled.

🔨 Explore the source changes: 85d00cb

🔍 Inspect the deploy log: https://app.netlify.com/sites/vector-project/deploys/6228c11c3e41bf0008c3ea80

@github-actions github-actions bot added the domain: sinks Anything related to the Vector's sinks label Mar 2, 2022
@github-actions
Copy link

github-actions bot commented Mar 2, 2022

Soak Test Results

Baseline: 7c21733
Comparison: 211fc9e
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±5%:

Fine details of change detection per experiment.
experiment Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
http_pipelines_blackhole_acks 58.3KiB 4.4 85.88% 1.29MiB 680.39KiB 27.11KiB 0 0.513339 1.35MiB 710.51KiB 28.86KiB 0 0.513443 True True
datadog_agent_remap_datadog_logs 1.09MiB 2.46 100.00% 44.16MiB 847.57KiB 34.6KiB 0 0.0187267 45.25MiB 855.79KiB 34.94KiB 0 0.018454 False False
datadog_agent_remap_blackhole 581.02KiB 1.6 100.00% 35.48MiB 757.82KiB 30.78KiB 0 0.0208395 36.05MiB 575.21KiB 23.42KiB 0 0.0155687 False False
syslog_log2metric_humio_metrics 133.09KiB 1.07 100.00% 12.12MiB 264.87KiB 10.76KiB 0 0.0213214 12.25MiB 107.15KiB 4.37KiB 0 0.00853363 False False
socket_to_socket_blackhole 94.75KiB 0.75 100.00% 12.32MiB 152.61KiB 6.2KiB 0 0.0120867 12.41MiB 70.93KiB 2.88KiB 0 0.00557546 False False
splunk_hec_route_s3 69.77KiB 0.62 40.00% 10.96MiB 2.28MiB 94.47KiB 0 0.208028 11.03MiB 2.26MiB 93.64KiB 0 0.204924 False False
http_pipelines_blackhole 1.89KiB 0.42 6.86% 448.52KiB 355.61KiB 15.51KiB 0 0.792087 450.41KiB 356.96KiB 15.51KiB 0 0.791777 True True
syslog_loki 25.65KiB 0.35 99.98% 7.26MiB 113.64KiB 4.51KiB 0 0.0152844 7.28MiB 126.01KiB 5.14KiB 0 0.0168893 False False
syslog_log2metric_splunk_hec_metrics 45.29KiB 0.34 99.94% 12.98MiB 247.7KiB 9.97KiB 0 0.0186279 13.02MiB 214.32KiB 8.61KiB 0 0.0160628 False False
splunk_hec_to_splunk_hec_logs_noack 77.7KiB 0.32 99.85% 23.84MiB 389.94KiB 15.92KiB 0 0.0159607 23.91MiB 478.17KiB 18.53KiB 0 0.0195115 False False
syslog_splunk_hec_logs 24.25KiB 0.19 97.86% 12.53MiB 199.0KiB 8.04KiB 0 0.0154973 12.55MiB 166.12KiB 6.78KiB 0 0.0129118 False False
fluent_remap_aws_firehose 117.08KiB 0.14 99.77% 79.47MiB 56.07KiB 2.27KiB 0 0.000688444 79.59MiB 983.27KiB 38.13KiB 0 0.012056 False False
splunk_hec_to_splunk_hec_logs_acks 30.72KiB 0.13 30.19% 23.45MiB 1.44MiB 60.35KiB 0 0.0614989 23.48MiB 1.26MiB 51.26KiB 0 0.0537112 False False
splunk_hec_indexer_ack_blackhole 6.44KiB 0.03 20.96% 23.84MiB 424.74KiB 17.34KiB 0 0.0173869 23.84MiB 415.92KiB 16.91KiB 0 0.0170214 False False
splunk_transforms_splunk3 1.52KiB 0.02 1.22% 6.39MiB 1.67MiB 69.27KiB 0 0.261141 6.39MiB 1.7MiB 70.51KiB 0 0.265325 False False
fluent_elasticsearch -508.71B -0 12.74% 79.47MiB 54.19KiB 2.19KiB 0 0.00066531 79.47MiB 54.14KiB 2.19KiB 0 0.000664713 False False
http_to_http_json -28.79KiB -0.17 43.85% 16.28MiB 856.01KiB 34.89KiB 0 0.0513032 16.25MiB 871.41KiB 35.22KiB 0 0.0523173 False False
datadog_agent_remap_datadog_logs_acks -327.66KiB -0.68 100.00% 46.73MiB 581.09KiB 23.55KiB 0 0.0121325 46.41MiB 981.53KiB 39.87KiB 0 0.0206346 False False
syslog_regex_logs2metric_ddmetrics -77.9KiB -0.83 87.13% 9.12MiB 261.28KiB 10.67KiB 0 0.0279493 9.05MiB 1.07MiB 50.07KiB 0 0.118308 False False
datadog_agent_remap_blackhole_acks -364.83KiB -0.97 100.00% 36.65MiB 477.33KiB 19.49KiB 0 0.0127074 36.3MiB 483.8KiB 19.75KiB 0 0.0130061 False False
http_to_http_noack -368.11KiB -1.8 100.00% 19.95MiB 783.26KiB 31.66KiB 0 0.0383024 19.59MiB 877.35KiB 34.79KiB 0 0.0436916 False False
http_datadog_filter_blackhole -84.9KiB -1.86 95.78% 4.45MiB 670.93KiB 32.32KiB 0 0.146996 4.37MiB 648.89KiB 26.4KiB 0 0.144914 False True
http_pipelines_no_grok_blackhole -104.2KiB -2.52 98.81% 4.03MiB 718.51KiB 29.21KiB 0 0.173871 3.93MiB 736.45KiB 29.27KiB 0 0.182831 False False
syslog_humio_logs -458.57KiB -3.47 100.00% 12.92MiB 140.7KiB 5.72KiB 0 0.0106298 12.47MiB 272.83KiB 11.03KiB 0 0.0213528 False False
http_to_http_acks -1019.16KiB -10.13 99.99% 9.82MiB 4.91MiB 205.36KiB 0 0.499735 8.83MiB 4.1MiB 169.77KiB 0 0.46428 True True
Fine details of each soak run.
(experiment, variant, run_id) total samples mean std min median p90 p95 p99 max skewness
('fluent_remap_aws_firehose', 'comparison', 'dee692cf-9b96-4f06-ad9f-de4730e65dde') 231 79.67MiB 1.15MiB 79.26MiB 79.47MiB 79.56MiB 79.58MiB 86.49MiB 86.81MiB 5.75289
('fluent_remap_aws_firehose', 'comparison', '6c8d1401-7f49-43da-a7a6-75a07c0558b3') 231 79.6MiB 1.15MiB 79.35MiB 79.47MiB 79.55MiB 79.56MiB 84.27MiB 91.04MiB 9.23669
('fluent_elasticsearch', 'baseline', '131645b8-a7e4-4cca-8211-0b1b3f41c12f') 204 79.47MiB 54.04KiB 79.34MiB 79.47MiB 79.54MiB 79.56MiB 79.59MiB 79.61MiB 0.0209915
('fluent_remap_aws_firehose', 'baseline', '20379132-3e1a-444e-807a-e2f0325419cd') 203 79.47MiB 55.32KiB 79.35MiB 79.47MiB 79.54MiB 79.56MiB 79.57MiB 79.6MiB -0.142048
('fluent_remap_aws_firehose', 'baseline', '6caea393-87e6-4130-a78d-8953df0bea83') 203 79.47MiB 52.89KiB 79.34MiB 79.47MiB 79.54MiB 79.56MiB 79.58MiB 79.61MiB -0.036892
('fluent_remap_aws_firehose', 'baseline', '1274eb91-675e-42ce-8528-b728897dc39f') 203 79.47MiB 60.05KiB 79.33MiB 79.47MiB 79.56MiB 79.57MiB 79.59MiB 79.66MiB 0.0691537
('fluent_elasticsearch', 'comparison', 'e7204d41-586a-4a1a-8429-50f4fe500dcf') 204 79.47MiB 55.73KiB 79.35MiB 79.47MiB 79.55MiB 79.57MiB 79.59MiB 79.63MiB 0.187451
('fluent_remap_aws_firehose', 'comparison', '63ce3ec7-1f1f-4699-8916-3bb6bc0a661c') 203 79.47MiB 55.34KiB 79.33MiB 79.47MiB 79.55MiB 79.56MiB 79.59MiB 79.61MiB 0.0619983
('fluent_elasticsearch', 'baseline', 'd70f4e07-d3f0-4f58-a3b6-47d8b4c39d3e') 204 79.47MiB 54.95KiB 79.33MiB 79.47MiB 79.55MiB 79.56MiB 79.59MiB 79.6MiB -0.00849883
('fluent_elasticsearch', 'comparison', '6dc17e04-d1b1-4841-9a92-6fe0374a37e4') 204 79.47MiB 50.88KiB 79.36MiB 79.47MiB 79.54MiB 79.56MiB 79.59MiB 79.6MiB 0.161182
('fluent_elasticsearch', 'baseline', 'e5380b36-dcee-4910-8f6c-270d20c50f0b') 204 79.47MiB 53.81KiB 79.34MiB 79.47MiB 79.54MiB 79.56MiB 79.6MiB 79.61MiB 0.173668
('fluent_elasticsearch', 'comparison', '9f8b5541-98f3-4f79-8394-4eac12ac5ebe') 204 79.47MiB 55.91KiB 79.26MiB 79.47MiB 79.54MiB 79.56MiB 79.59MiB 79.61MiB -0.110822
('datadog_agent_remap_datadog_logs_acks', 'comparison', '034b59f3-aacd-46cc-95fa-65f578745b11') 202 47.5MiB 238.74KiB 46.95MiB 47.5MiB 47.8MiB 47.84MiB 47.97MiB 48.04MiB -0.0680188
('datadog_agent_remap_datadog_logs_acks', 'baseline', '670150b3-c0be-42f2-9723-c8721d5e4f47') 203 47.32MiB 273.1KiB 46.42MiB 47.32MiB 47.68MiB 47.74MiB 47.84MiB 47.92MiB -0.230397
('datadog_agent_remap_datadog_logs_acks', 'baseline', 'bfcee164-d247-4e8a-a48e-cf77113dcf3c') 203 46.74MiB 405.4KiB 45.69MiB 46.72MiB 47.3MiB 47.42MiB 47.6MiB 47.64MiB -0.00376708
('datadog_agent_remap_datadog_logs_acks', 'comparison', '0453ee76-5360-46e9-8b8c-dbe262a9b358') 202 46.47MiB 372.74KiB 45.94MiB 46.42MiB 46.75MiB 46.84MiB 48.01MiB 48.16MiB 2.26494
('datadog_agent_remap_datadog_logs', 'comparison', '653e9784-2cb3-47d3-932e-ec23d4a82967') 200 46.2MiB 417.78KiB 45.36MiB 46.16MiB 46.74MiB 46.86MiB 47.06MiB 47.13MiB 0.183417
('datadog_agent_remap_datadog_logs_acks', 'baseline', '9c95a8ad-6478-43ef-b490-8f3eca60e4c0') 203 46.14MiB 219.08KiB 45.6MiB 46.14MiB 46.42MiB 46.46MiB 46.61MiB 46.77MiB 0.0235847
('datadog_agent_remap_datadog_logs_acks', 'comparison', '7e2ec48f-29e5-4786-af5f-18bf5fe3f1d6') 202 45.27MiB 255.8KiB 44.52MiB 45.28MiB 45.57MiB 45.69MiB 45.83MiB 46.06MiB -0.119532
('datadog_agent_remap_datadog_logs', 'comparison', '035f7725-26b0-4621-8ed3-c7c6e5dbfaef') 200 45.2MiB 202.5KiB 44.72MiB 45.2MiB 45.44MiB 45.53MiB 45.62MiB 45.78MiB -0.0650893
('datadog_agent_remap_datadog_logs', 'baseline', '62fdf62a-943e-4418-82f2-33d63c231f6b') 200 44.89MiB 211.11KiB 44.38MiB 44.91MiB 45.12MiB 45.18MiB 45.24MiB 45.46MiB -0.345023
('datadog_agent_remap_datadog_logs', 'baseline', 'c0dc6786-e327-4d0e-8be0-1c6d32ddbdab') 200 44.55MiB 228.79KiB 44.04MiB 44.54MiB 44.86MiB 44.94MiB 45.03MiB 45.1MiB 0.124707
('datadog_agent_remap_datadog_logs', 'comparison', 'd48f9ede-8dcd-4523-b211-91a4fda7ac9c') 200 44.35MiB 437.6KiB 43.44MiB 44.26MiB 44.96MiB 45.05MiB 45.25MiB 45.3MiB 0.232973
('datadog_agent_remap_datadog_logs', 'baseline', '2beb750e-9eda-45ad-8cc8-cb177ff30b24') 200 43.05MiB 228.21KiB 42.45MiB 43.02MiB 43.34MiB 43.41MiB 43.72MiB 43.76MiB 0.43817
('datadog_agent_remap_blackhole_acks', 'baseline', '4e8e6a16-4ff4-4098-8ce8-fe5d10d1882f') 200 37.1MiB 378.05KiB 36.05MiB 37.16MiB 37.47MiB 37.61MiB 37.81MiB 37.99MiB -0.722383
('datadog_agent_remap_blackhole_acks', 'comparison', '1e839cc7-b3f8-4bd4-bf5d-aa2336a470c5') 200 36.74MiB 470.29KiB 35.42MiB 36.76MiB 37.32MiB 37.44MiB 37.74MiB 37.77MiB -0.108446
('datadog_agent_remap_blackhole_acks', 'baseline', '441f1ed0-019e-4888-8420-bbca23c265eb') 200 36.56MiB 337.45KiB 35.72MiB 36.57MiB 37.01MiB 37.1MiB 37.21MiB 37.37MiB -0.103758
('datadog_agent_remap_blackhole', 'comparison', '54a025eb-d232-45e5-b36c-5aabec4ee92d') 201 36.55MiB 231.75KiB 35.96MiB 36.55MiB 36.86MiB 36.91MiB 37.06MiB 37.11MiB 0.0781665
('datadog_agent_remap_blackhole_acks', 'baseline', 'b64f158f-7057-4a9a-94d4-4fe262cd6fe9') 200 36.29MiB 263.72KiB 35.57MiB 36.28MiB 36.65MiB 36.77MiB 36.87MiB 36.93MiB 0.127553
('datadog_agent_remap_blackhole', 'comparison', 'be72a776-b7a3-4dd9-b465-6691fbfc0525') 201 36.22MiB 229.7KiB 35.62MiB 36.2MiB 36.53MiB 36.6MiB 36.76MiB 36.85MiB 0.131346
('datadog_agent_remap_blackhole_acks', 'comparison', 'dd6e6d56-03b2-453c-8a6f-eafac2740a4a') 200 36.21MiB 251.28KiB 35.63MiB 36.2MiB 36.52MiB 36.69MiB 36.81MiB 36.9MiB 0.266773
('datadog_agent_remap_blackhole', 'baseline', '6ab9a8dd-909d-4b23-8509-e457d7d18613') 202 36.08MiB 208.21KiB 35.35MiB 36.08MiB 36.34MiB 36.37MiB 36.54MiB 36.59MiB -0.222913
('datadog_agent_remap_blackhole_acks', 'comparison', 'f469fc51-b267-4da8-b958-c736c4587bd7') 200 35.93MiB 258.38KiB 35.31MiB 35.91MiB 36.26MiB 36.36MiB 36.51MiB 37.08MiB 0.599529
('datadog_agent_remap_blackhole', 'baseline', '3e59b0fe-ca7b-408c-a2d9-c8e7f31443d0') 202 35.87MiB 214.74KiB 35.28MiB 35.87MiB 36.13MiB 36.22MiB 36.33MiB 36.41MiB -0.139414
('datadog_agent_remap_blackhole', 'comparison', '4f2f5efa-a085-49c7-8195-e31897a74aff') 201 35.38MiB 354.83KiB 34.51MiB 35.36MiB 35.84MiB 35.96MiB 36.14MiB 36.31MiB 0.0446051
('datadog_agent_remap_blackhole', 'baseline', '8f0b425e-1eb2-4a29-bf39-ef493db8a2ea') 202 34.5MiB 285.76KiB 33.92MiB 34.52MiB 34.87MiB 34.95MiB 35.09MiB 35.28MiB 0.090448
('splunk_hec_to_splunk_hec_logs_noack', 'comparison', '276c068f-7799-46d4-94f4-b517e92c4558') 231 23.95MiB 511.23KiB 22.96MiB 23.87MiB 24.55MiB 24.84MiB 25.72MiB 26.24MiB 1.56089
('splunk_hec_to_splunk_hec_logs_noack', 'comparison', 'f99473bb-7646-4d59-924d-bf528cd535be') 231 23.95MiB 526.31KiB 22.93MiB 23.88MiB 24.36MiB 24.78MiB 26.03MiB 26.41MiB 1.95301
('splunk_hec_to_splunk_hec_logs_acks', 'baseline', 'a1fd5876-5b72-4333-a5e7-9c73523f7f2e') 200 23.85MiB 1.68MiB 19.98MiB 23.85MiB 26.48MiB 26.92MiB 27.35MiB 27.67MiB 0.00960729
('splunk_hec_indexer_ack_blackhole', 'comparison', '51aa9f9f-7061-4baf-b035-f468d75a69f7') 200 23.84MiB 424.04KiB 22.72MiB 23.87MiB 24.33MiB 24.53MiB 24.81MiB 24.93MiB 0.063824
('splunk_hec_to_splunk_hec_logs_noack', 'baseline', 'a3d15269-5a05-49a1-a2c1-f38f24d889bf') 200 23.84MiB 378.89KiB 22.93MiB 23.85MiB 24.32MiB 24.41MiB 24.69MiB 24.93MiB 0.0507274
('splunk_hec_indexer_ack_blackhole', 'comparison', 'b289df95-db0c-458f-906b-332cf3dfcc72') 200 23.84MiB 410.48KiB 22.72MiB 23.87MiB 24.31MiB 24.51MiB 24.75MiB 24.81MiB -0.133511
('splunk_hec_indexer_ack_blackhole', 'comparison', '06a3e5ea-50dd-42a6-9085-28e9a6b11a9f') 205 23.84MiB 415.23KiB 22.93MiB 23.87MiB 24.34MiB 24.51MiB 24.74MiB 24.93MiB -0.0258185
('splunk_hec_indexer_ack_blackhole', 'baseline', 'b87b0778-382d-4006-93f8-76f81a656fe7') 200 23.84MiB 420.63KiB 22.72MiB 23.87MiB 24.36MiB 24.45MiB 24.75MiB 24.81MiB -0.171171
('splunk_hec_to_splunk_hec_logs_noack', 'comparison', '0a3b9b80-1ebf-4775-aaf1-f12a663b9262') 204 23.84MiB 361.3KiB 23.09MiB 23.82MiB 24.31MiB 24.42MiB 24.66MiB 24.7MiB 0.103391
('splunk_hec_to_splunk_hec_logs_noack', 'baseline', 'dc5b2268-ca83-44c4-b1af-9000f1cf796e') 200 23.84MiB 401.64KiB 22.78MiB 23.87MiB 24.3MiB 24.41MiB 24.66MiB 24.81MiB -0.0942439
('splunk_hec_indexer_ack_blackhole', 'baseline', '528cda60-238f-47b8-8aed-28b5c1c5578a') 200 23.84MiB 437.47KiB 22.44MiB 23.87MiB 24.33MiB 24.58MiB 24.75MiB 24.93MiB -0.203279
('splunk_hec_to_splunk_hec_logs_noack', 'baseline', '69d95690-b759-4874-96ec-b8db541540bb') 200 23.83MiB 390.84KiB 22.17MiB 23.83MiB 24.31MiB 24.41MiB 24.64MiB 24.93MiB -0.205206
('splunk_hec_indexer_ack_blackhole', 'baseline', 'b809eb1c-217e-4a8a-8220-5e9ff3b38598') 200 23.83MiB 417.93KiB 22.67MiB 23.87MiB 24.31MiB 24.51MiB 24.7MiB 24.81MiB -0.0959891
('splunk_hec_to_splunk_hec_logs_acks', 'comparison', '8d6ea431-ce7a-4319-96a6-eb71948ce43c') 203 23.83MiB 1.18MiB 20.71MiB 24.14MiB 25.03MiB 25.37MiB 25.53MiB 25.66MiB -0.911449
('splunk_hec_to_splunk_hec_logs_acks', 'comparison', '2f6253f1-2aa7-460d-b018-2c4c00968092') 203 23.57MiB 1.21MiB 20.26MiB 23.97MiB 24.76MiB 24.88MiB 25.19MiB 25.39MiB -1.10541
('splunk_hec_to_splunk_hec_logs_acks', 'baseline', 'a5349028-73cb-4017-9392-7a789b399c54') 200 23.27MiB 1.3MiB 20.13MiB 23.65MiB 24.73MiB 24.91MiB 25.28MiB 25.42MiB -0.703279
('splunk_hec_to_splunk_hec_logs_acks', 'baseline', 'f5ccba9a-642d-484c-8bf0-7d85185003b5') 200 23.25MiB 1.23MiB 20.25MiB 23.53MiB 24.44MiB 24.7MiB 25.02MiB 25.34MiB -0.925171
('splunk_hec_to_splunk_hec_logs_acks', 'comparison', '102fba60-85bd-4bb3-9e67-523e40b0a5e6') 230 23.11MiB 1.28MiB 19.87MiB 23.35MiB 24.52MiB 24.72MiB 25.0MiB 25.34MiB -0.742045
('http_to_http_noack', 'baseline', '92153352-e949-4db2-b89c-cb607ff2e925') 204 20.1MiB 710.05KiB 18.14MiB 20.12MiB 20.98MiB 21.23MiB 21.77MiB 21.98MiB 0.151719
('http_to_http_noack', 'baseline', '8165bb86-bafe-4921-bbfa-2e25290e1ff2') 204 19.9MiB 791.09KiB 17.41MiB 19.96MiB 20.9MiB 21.22MiB 21.77MiB 21.79MiB -0.0707915
('http_to_http_noack', 'baseline', 'f5b86f9c-9e12-4469-9b60-e54f31603a53') 204 19.87MiB 826.59KiB 17.02MiB 19.85MiB 20.88MiB 21.23MiB 21.77MiB 21.82MiB -0.0728856
('http_to_http_noack', 'comparison', 'df0ea5c1-df5b-446b-ba67-ee4949dab248') 204 19.61MiB 890.19KiB 17.02MiB 19.61MiB 20.76MiB 21.16MiB 21.31MiB 21.43MiB -0.284051
('http_to_http_noack', 'comparison', 'b9594ecd-7c9a-47c8-8ab7-3c1a0fe23937') 228 19.6MiB 849.81KiB 16.84MiB 19.62MiB 20.63MiB 21.07MiB 21.35MiB 21.73MiB -0.34447
('http_to_http_noack', 'comparison', '7c1265ff-7998-467e-87c7-e51910340e13') 204 19.57MiB 898.14KiB 16.46MiB 19.54MiB 20.68MiB 21.1MiB 21.66MiB 21.98MiB -0.217779
('http_to_http_json', 'comparison', 'e4dfbc1c-b2d2-4084-b798-87ebb59b82a3') 204 16.46MiB 847.09KiB 13.61MiB 16.41MiB 17.52MiB 17.82MiB 18.53MiB 18.89MiB 0.195667
('http_to_http_json', 'baseline', '04a3d7be-99db-42f5-8dec-6e2fbeb1ed0e') 200 16.46MiB 876.31KiB 14.16MiB 16.41MiB 17.73MiB 17.88MiB 18.23MiB 18.52MiB 0.174674
('http_to_http_json', 'comparison', '81048bf8-7c26-450f-95bf-e6828cce36fe') 204 16.28MiB 851.12KiB 14.1MiB 16.28MiB 17.34MiB 17.75MiB 18.28MiB 18.4MiB 0.115761
('http_to_http_json', 'baseline', '6e4213f4-7421-4452-8875-b8b39bc701e8') 201 16.2MiB 802.67KiB 14.17MiB 16.19MiB 17.22MiB 17.54MiB 18.1MiB 18.46MiB 0.133719
('http_to_http_json', 'baseline', '49ad1aed-1712-4baa-8b30-587457ca33f4') 201 16.19MiB 863.36KiB 14.16MiB 16.15MiB 17.3MiB 17.64MiB 18.35MiB 18.82MiB 0.183438
('http_to_http_json', 'comparison', '471a5bea-15ab-4503-9389-c94c3c7faf9b') 204 16.01MiB 855.52KiB 13.33MiB 16.0MiB 16.94MiB 17.13MiB 18.14MiB 18.59MiB -0.13223
('syslog_log2metric_splunk_hec_metrics', 'baseline', 'e34f7bf1-f221-4783-9be6-2187f4f875ca') 200 13.28MiB 47.17KiB 13.17MiB 13.29MiB 13.35MiB 13.36MiB 13.37MiB 13.37MiB -0.183325
('syslog_log2metric_splunk_hec_metrics', 'comparison', '346068c4-bb15-4e11-a043-ee0315ad9026') 200 13.21MiB 55.04KiB 13.08MiB 13.21MiB 13.28MiB 13.29MiB 13.33MiB 13.37MiB -0.0262089
('syslog_log2metric_splunk_hec_metrics', 'comparison', 'd698c5f4-0214-4286-8215-3603e5a99a30') 200 13.11MiB 100.65KiB 12.94MiB 13.09MiB 13.23MiB 13.35MiB 13.42MiB 13.42MiB 1.39316
('syslog_humio_logs', 'baseline', 'd0e4c621-8a18-4537-9091-d5fcbf7d5d59') 202 13.04MiB 65.9KiB 12.82MiB 13.04MiB 13.11MiB 13.13MiB 13.18MiB 13.19MiB -0.500701
('syslog_log2metric_splunk_hec_metrics', 'baseline', 'daca46d4-527f-49fa-a710-30b1a274073e') 200 12.96MiB 44.03KiB 12.84MiB 12.96MiB 13.0MiB 13.02MiB 13.04MiB 13.21MiB 1.34361
('syslog_humio_logs', 'baseline', '5283dcb2-b553-476d-87f5-023e904f8164') 202 12.94MiB 103.81KiB 12.74MiB 12.97MiB 13.07MiB 13.08MiB 13.13MiB 13.17MiB -0.137904
('syslog_humio_logs', 'baseline', '6aa31da2-7aa4-4970-a457-9041cdf8c1e6') 202 12.77MiB 77.0KiB 12.57MiB 12.78MiB 12.85MiB 12.87MiB 12.91MiB 12.94MiB -0.517756
('syslog_log2metric_splunk_hec_metrics', 'comparison', '1c80b6b0-b888-4247-a3af-b21fa27acfaa') 220 12.76MiB 53.82KiB 12.63MiB 12.76MiB 12.83MiB 12.85MiB 12.87MiB 12.91MiB 0.0324167
('syslog_humio_logs', 'comparison', '0598b34d-d65f-4df0-b43c-5b4b103445c1') 204 12.75MiB 49.49KiB 12.59MiB 12.76MiB 12.81MiB 12.83MiB 12.86MiB 12.87MiB -0.313049
('syslog_log2metric_splunk_hec_metrics', 'baseline', '89c0904e-4a72-40a3-bede-6f3d7b4ed542') 217 12.71MiB 63.66KiB 12.59MiB 12.7MiB 12.77MiB 12.85MiB 12.92MiB 12.96MiB 1.37058
('syslog_splunk_hec_logs', 'baseline', '5ffc45be-c6ef-460c-bc1b-2d166e878830') 204 12.71MiB 60.06KiB 12.54MiB 12.7MiB 12.78MiB 12.8MiB 12.86MiB 12.9MiB 0.176884
('syslog_splunk_hec_logs', 'comparison', '9dc10248-f3bc-4e09-9976-9f0d0bf622db') 200 12.63MiB 154.48KiB 12.26MiB 12.69MiB 12.77MiB 12.79MiB 12.8MiB 12.84MiB -1.14505
('syslog_splunk_hec_logs', 'comparison', 'a967e347-7123-4418-8944-58ccbe48ffd4') 200 12.6MiB 169.75KiB 12.25MiB 12.63MiB 12.81MiB 12.86MiB 12.91MiB 12.96MiB -0.0447908
('syslog_splunk_hec_logs', 'baseline', '5e827bf0-285d-4d7d-9d84-e6dbce050e19') 204 12.6MiB 63.18KiB 12.39MiB 12.6MiB 12.68MiB 12.69MiB 12.71MiB 12.75MiB -0.542466
('syslog_humio_logs', 'comparison', 'cd7579bd-9564-4c85-99f2-a83a46704465') 204 12.52MiB 49.26KiB 12.39MiB 12.52MiB 12.58MiB 12.6MiB 12.63MiB 12.67MiB 0.0378756
('socket_to_socket_blackhole', 'baseline', 'f91cf9e3-a8bb-45c6-8e09-d09a761f51d2') 202 12.5MiB 44.77KiB 12.4MiB 12.5MiB 12.56MiB 12.57MiB 12.64MiB 12.66MiB 0.489598
('socket_to_socket_blackhole', 'comparison', '0d580c73-fab6-40c2-9b80-0ab730c20cb3') 202 12.49MiB 35.8KiB 12.4MiB 12.48MiB 12.53MiB 12.55MiB 12.57MiB 12.59MiB 0.193076
('syslog_splunk_hec_logs', 'comparison', 'a5b909a8-448f-4d18-91db-b9ffd30087b6') 200 12.42MiB 48.77KiB 12.25MiB 12.42MiB 12.48MiB 12.5MiB 12.53MiB 12.56MiB -0.00567832
('socket_to_socket_blackhole', 'comparison', '5dd074bc-a5f9-43b1-bb30-2554c958326a') 202 12.41MiB 30.27KiB 12.34MiB 12.42MiB 12.46MiB 12.46MiB 12.47MiB 12.49MiB -0.1421
('syslog_log2metric_humio_metrics', 'baseline', '87a78f52-5fda-4e8c-a132-7a8780821cbd') 202 12.4MiB 48.82KiB 12.26MiB 12.4MiB 12.46MiB 12.47MiB 12.5MiB 12.51MiB -0.104229
('syslog_log2metric_humio_metrics', 'comparison', '23212942-4443-4fcc-bfcb-dcba342b5429') 200 12.34MiB 132.09KiB 12.12MiB 12.32MiB 12.51MiB 12.53MiB 12.56MiB 12.61MiB 0.162338
('socket_to_socket_blackhole', 'comparison', 'c2b40387-6cfa-4a8e-ab15-b220076ef11e') 202 12.34MiB 31.81KiB 12.24MiB 12.34MiB 12.37MiB 12.39MiB 12.4MiB 12.42MiB -0.348761
('syslog_splunk_hec_logs', 'baseline', 'de458fc2-4329-401c-8399-0f1b50c814c8') 204 12.29MiB 110.16KiB 12.11MiB 12.26MiB 12.46MiB 12.51MiB 12.59MiB 12.61MiB 1.09005
('socket_to_socket_blackhole', 'baseline', 'a10c560e-ade5-4d96-a757-79dacba80552') 202 12.28MiB 67.1KiB 12.09MiB 12.28MiB 12.36MiB 12.39MiB 12.42MiB 12.43MiB -0.18458
('syslog_log2metric_humio_metrics', 'comparison', '44b6369b-9bf3-4c47-b98b-5190b4ba09ff') 200 12.21MiB 61.39KiB 12.08MiB 12.21MiB 12.28MiB 12.29MiB 12.44MiB 12.47MiB 1.15511
('syslog_log2metric_humio_metrics', 'comparison', '098a2313-4530-426f-ae21-0cdf1dca34c5') 200 12.2MiB 39.06KiB 12.11MiB 12.2MiB 12.25MiB 12.26MiB 12.29MiB 12.31MiB 0.0785139
('socket_to_socket_blackhole', 'baseline', '199e2ca0-9b81-432d-81c3-14950f760dd8') 202 12.18MiB 82.96KiB 11.95MiB 12.18MiB 12.27MiB 12.31MiB 12.37MiB 12.4MiB -0.0203748
('syslog_humio_logs', 'comparison', 'e9324094-bb78-410a-b685-5dbc6f2a8cf9') 204 12.13MiB 108.76KiB 11.9MiB 12.14MiB 12.26MiB 12.3MiB 12.33MiB 12.39MiB -0.14215
('syslog_log2metric_humio_metrics', 'baseline', 'ab763c7b-eb84-45b3-ae22-1165f280342b') 202 12.06MiB 46.76KiB 11.93MiB 12.08MiB 12.13MiB 12.13MiB 12.16MiB 12.18MiB -0.234313
('syslog_log2metric_humio_metrics', 'baseline', 'a3c22853-81bf-4c70-8b2f-fd931e8c6da6') 202 11.9MiB 271.58KiB 11.4MiB 11.9MiB 12.29MiB 12.34MiB 12.43MiB 12.47MiB 0.12299
('splunk_hec_route_s3', 'comparison', '498ee0cd-a4d3-420b-af0e-ed2a17840cf5') 204 11.13MiB 2.25MiB 7.36MiB 11.16MiB 14.27MiB 14.78MiB 15.4MiB 15.46MiB 0.187641
('splunk_hec_route_s3', 'comparison', 'd3ac5e69-c730-4d5b-a42a-e3c3f0ebd23a') 204 11.11MiB 2.31MiB 7.76MiB 10.68MiB 14.47MiB 14.99MiB 15.52MiB 15.93MiB 0.309988
('splunk_hec_route_s3', 'baseline', '61bdb185-f49d-4425-a260-27c5a1f39d7d') 204 11.11MiB 2.28MiB 7.29MiB 11.14MiB 14.33MiB 14.88MiB 15.7MiB 16.18MiB 0.228452
('splunk_hec_route_s3', 'baseline', '521f0eb5-8230-481c-997e-b078b06a7749') 204 10.91MiB 2.3MiB 7.42MiB 10.76MiB 14.34MiB 14.92MiB 15.6MiB 15.75MiB 0.358981
('splunk_hec_route_s3', 'baseline', '927a4566-1a28-41a7-8a18-595160f75d36') 204 10.86MiB 2.27MiB 7.52MiB 10.97MiB 14.2MiB 14.67MiB 15.02MiB 15.27MiB 0.258029
('splunk_hec_route_s3', 'comparison', '89e8644a-2dbb-459c-8c10-030e6b1e71c6') 204 10.85MiB 2.23MiB 7.51MiB 10.71MiB 14.15MiB 14.7MiB 15.12MiB 15.63MiB 0.260084
('http_to_http_acks', 'baseline', 'e341a539-0c2f-43c8-ba6d-58b7e9523829') 200 10.21MiB 5.03MiB 1.34MiB 9.23MiB 18.52MiB 19.02MiB 19.63MiB 20.43MiB 0.384406
('http_to_http_acks', 'baseline', 'acb4aa77-1d56-4747-9dc8-9b8c526804da') 200 9.72MiB 5.02MiB 1.55MiB 9.5MiB 17.76MiB 19.02MiB 19.65MiB 20.61MiB 0.46849
('http_to_http_acks', 'baseline', '4d4c4673-2006-48cd-8fa6-d253c88ee972') 200 9.54MiB 4.68MiB 1.73MiB 9.51MiB 17.74MiB 18.81MiB 19.66MiB 20.21MiB 0.510875
('syslog_regex_logs2metric_ddmetrics', 'baseline', 'c6f6e39f-b0ae-47ab-8c7b-27883fae7cdd') 200 9.27MiB 268.82KiB 8.64MiB 9.4MiB 9.5MiB 9.51MiB 9.54MiB 9.57MiB -0.955688
('syslog_regex_logs2metric_ddmetrics', 'baseline', '306cc38a-25a5-44e8-a160-b15e71816c64') 200 9.16MiB 232.34KiB 8.13MiB 9.26MiB 9.36MiB 9.39MiB 9.41MiB 9.43MiB -1.1687
('syslog_regex_logs2metric_ddmetrics', 'comparison', '3d73b8fc-3f93-4cb1-9a39-492b997bd1f8') 200 9.16MiB 218.25KiB 8.72MiB 9.24MiB 9.34MiB 9.35MiB 9.4MiB 10.16MiB -0.341718
('syslog_regex_logs2metric_ddmetrics', 'comparison', '4e3dbe14-8f8e-40e5-9951-a0e28bc33804') 200 9.07MiB 181.87KiB 8.71MiB 9.13MiB 9.23MiB 9.25MiB 9.3MiB 9.84MiB -0.442483
('http_to_http_acks', 'comparison', 'a6630c18-37a4-40b6-8aa1-967ff7cd7d32') 204 8.98MiB 4.36MiB 2.17MiB 9.13MiB 15.39MiB 17.5MiB 19.5MiB 20.08MiB 0.558093
('syslog_regex_logs2metric_ddmetrics', 'baseline', '9761a67b-170a-43a9-9f9c-669d6902b22a') 200 8.94MiB 140.06KiB 7.86MiB 8.98MiB 9.06MiB 9.1MiB 9.17MiB 9.18MiB -2.6175
('http_to_http_acks', 'comparison', 'a5f46750-1d75-440b-b7d2-8aad16cb6fe3') 204 8.75MiB 3.97MiB 2.05MiB 9.14MiB 14.44MiB 16.36MiB 19.11MiB 19.42MiB 0.565108
('http_to_http_acks', 'comparison', 'd953fea3-3e03-4599-b3d7-3d57d2e72e44') 204 8.75MiB 3.99MiB 1.73MiB 9.03MiB 14.55MiB 16.19MiB 18.87MiB 19.18MiB 0.542458
('syslog_regex_logs2metric_ddmetrics', 'comparison', 'bf825059-843e-40c3-8386-33d0dcd942ba') 80 8.69MiB 2.57MiB 25.34KiB 9.6MiB 9.77MiB 9.78MiB 9.83MiB 9.84MiB -3.00496
('syslog_loki', 'comparison', '7ec309df-773f-4ad7-8c5f-393c35d0ee5e') 200 7.43MiB 26.47KiB 7.37MiB 7.43MiB 7.46MiB 7.47MiB 7.49MiB 7.5MiB 0.317788
('syslog_loki', 'baseline', 'ef7f0ffb-2336-46f8-80e2-072c90f45a46') 202 7.39MiB 25.68KiB 7.33MiB 7.39MiB 7.43MiB 7.43MiB 7.46MiB 7.46MiB 0.0187482
('syslog_loki', 'comparison', 'cefe5838-b739-4888-bfef-d5c6186ffa45') 200 7.26MiB 29.12KiB 7.19MiB 7.26MiB 7.3MiB 7.31MiB 7.33MiB 7.33MiB 0.0419577
('syslog_loki', 'baseline', '41ed8599-b66e-440a-b1b7-8dda2a2dd731') 232 7.23MiB 32.1KiB 7.17MiB 7.23MiB 7.26MiB 7.27MiB 7.33MiB 7.42MiB 1.8119
('syslog_loki', 'comparison', '9953a576-352d-4156-8bbc-f7eb16340c9e') 200 7.15MiB 70.92KiB 6.97MiB 7.14MiB 7.24MiB 7.27MiB 7.29MiB 7.34MiB 0.048044
('syslog_loki', 'baseline', '3b30fcf1-28a0-4db3-b65e-15186f72fa3e') 202 7.15MiB 71.63KiB 6.94MiB 7.15MiB 7.23MiB 7.26MiB 7.3MiB 7.33MiB -0.183446
('splunk_transforms_splunk3', 'baseline', 'ab49123b-6fcb-4f10-b681-7a68e6d2d1f8') 203 6.5MiB 1.67MiB 3.9MiB 5.99MiB 8.88MiB 9.03MiB 9.45MiB 9.86MiB 0.274769
('splunk_transforms_splunk3', 'comparison', 'a80ac997-0fb4-4f14-ac63-df2608caf1f7') 203 6.45MiB 1.7MiB 2.44MiB 5.97MiB 8.78MiB 9.03MiB 9.34MiB 9.8MiB 0.192101
('splunk_transforms_splunk3', 'comparison', '9c833b03-4028-4825-a330-3eb99925a995') 202 6.36MiB 1.69MiB 3.46MiB 5.72MiB 8.75MiB 9.11MiB 9.33MiB 9.43MiB 0.306564
('splunk_transforms_splunk3', 'comparison', '138c72ca-08a7-4ded-99b3-9858dda2d983') 202 6.35MiB 1.7MiB 3.84MiB 5.68MiB 8.74MiB 9.0MiB 9.56MiB 9.67MiB 0.35511
('splunk_transforms_splunk3', 'baseline', '38e204ab-d64d-45db-8b10-9c6178a2dbbd') 203 6.33MiB 1.69MiB 3.46MiB 5.71MiB 8.73MiB 9.0MiB 9.34MiB 9.57MiB 0.305788
('splunk_transforms_splunk3', 'baseline', '3afd2155-4a89-4486-a4bb-82435bb02cc2') 203 6.33MiB 1.65MiB 3.84MiB 5.69MiB 8.59MiB 9.0MiB 9.31MiB 9.55MiB 0.327326
('http_datadog_filter_blackhole', 'comparison', 'e305df36-d1b7-48d6-873a-0eda920bb52c') 201 4.49MiB 635.31KiB 2.63MiB 4.5MiB 5.35MiB 5.41MiB 5.72MiB 5.87MiB -0.33356
('http_datadog_filter_blackhole', 'baseline', '08aace4a-8f7e-4b1c-ad14-dea0f7199f42') 202 4.47MiB 666.47KiB 2.48MiB 4.5MiB 5.31MiB 5.47MiB 5.75MiB 6.46MiB -0.179008
('http_datadog_filter_blackhole', 'baseline', 'f33b4fe0-3cd4-41d7-9a33-e34de79c9b28') 202 4.47MiB 643.81KiB 2.57MiB 4.5MiB 5.32MiB 5.41MiB 5.65MiB 5.77MiB -0.332403
('http_datadog_filter_blackhole', 'comparison', '55734d49-d669-4cf2-8a3b-1ac491bca692') 201 4.4MiB 604.94KiB 2.51MiB 4.5MiB 5.17MiB 5.29MiB 5.63MiB 5.65MiB -0.397441
('http_datadog_filter_blackhole', 'comparison', '46f15741-6e82-42ec-8971-83fbbed033e5') 202 4.22MiB 676.07KiB 2.48MiB 4.31MiB 5.0MiB 5.28MiB 5.41MiB 5.65MiB -0.444356
('http_datadog_filter_blackhole', 'baseline', '6bffca95-4fbc-4847-b58b-38cc8d2d2c94') 27 4.16MiB 841.33KiB 1.44MiB 4.25MiB 5.03MiB 5.29MiB 5.58MiB 5.65MiB -1.22347
('http_pipelines_no_grok_blackhole', 'baseline', '6b775373-8c64-41a6-9615-d813e62c6ace') 200 4.06MiB 718.68KiB 2.05MiB 4.19MiB 4.99MiB 5.18MiB 5.41MiB 5.53MiB -0.408486
('http_pipelines_no_grok_blackhole', 'baseline', '76c959c3-8e1e-48e6-a043-d278c260c0a6') 205 4.05MiB 672.33KiB 2.35MiB 4.14MiB 4.82MiB 5.06MiB 5.29MiB 5.41MiB -0.403131
('http_pipelines_no_grok_blackhole', 'comparison', 'ac5ec63e-2044-4a78-9cf9-c7dbed84c475') 205 4.0MiB 683.73KiB 2.24MiB 4.12MiB 4.74MiB 5.06MiB 5.29MiB 5.41MiB -0.29742
('http_pipelines_no_grok_blackhole', 'baseline', 'adcba762-4900-40cc-8717-670061212972') 200 3.99MiB 764.1KiB 2.08MiB 4.07MiB 4.94MiB 5.27MiB 5.41MiB 6.19MiB -0.261271
('http_pipelines_no_grok_blackhole', 'comparison', 'fa5b4f60-3bc4-478d-b9da-048a773a3d4c') 228 3.96MiB 696.59KiB 2.05MiB 4.08MiB 4.8MiB 4.97MiB 5.29MiB 5.41MiB -0.413208
('http_pipelines_no_grok_blackhole', 'comparison', '4f4c4561-eb9c-4047-9d86-f5ea64340ded') 200 3.83MiB 820.25KiB 1.38MiB 3.96MiB 4.79MiB 5.05MiB 5.29MiB 5.29MiB -0.439145
('http_pipelines_blackhole_acks', 'comparison', 'c0a1a24f-b5c0-48ea-9a3a-5f9d218ad306') 202 1.36MiB 733.3KiB 123.02KiB 1.37MiB 2.33MiB 2.66MiB 3.11MiB 3.56MiB 0.457066
('http_pipelines_blackhole_acks', 'comparison', '02ea0421-209d-4f47-bd99-b18b3d0bac7b') 202 1.36MiB 701.23KiB 245.0KiB 1.34MiB 2.26MiB 2.59MiB 3.08MiB 3.6MiB 0.60831
('http_pipelines_blackhole_acks', 'comparison', '1a135b41-7d9b-4272-a224-5eb3adb59442') 202 1.33MiB 699.54KiB 185.37KiB 1.3MiB 2.19MiB 2.55MiB 3.07MiB 3.62MiB 0.532846
('http_pipelines_blackhole_acks', 'baseline', '1e98f00a-b0de-4a29-b45a-6f7f6b0b084b') 202 1.32MiB 701.02KiB 124.71KiB 1.27MiB 2.24MiB 2.58MiB 3.07MiB 3.59MiB 0.472267
('http_pipelines_blackhole_acks', 'baseline', '95abf57c-26ab-4618-ad40-32259269cf77') 202 1.31MiB 656.86KiB 109.76KiB 1.31MiB 2.19MiB 2.54MiB 3.02MiB 3.17MiB 0.452598
('http_pipelines_blackhole_acks', 'baseline', '5312de4e-12c1-41bd-94d3-8c309d602904') 226 1.26MiB 683.58KiB 62.87KiB 1.21MiB 2.13MiB 2.48MiB 2.96MiB 3.11MiB 0.518649
('http_pipelines_blackhole', 'baseline', '7ef6803c-ff11-47a5-a9c4-4613bb8c5135') 173 451.76KiB 339.0KiB 15.99KiB 370.23KiB 976.65KiB 1.06MiB 1.43MiB 1.57MiB 0.919719
('http_pipelines_blackhole', 'comparison', '6afa10aa-bbc8-4975-93d1-5c9213be0562') 180 451.65KiB 337.33KiB 15.99KiB 368.02KiB 979.85KiB 1.07MiB 1.37MiB 1.49MiB 0.995538
('http_pipelines_blackhole', 'baseline', '4b263b52-e057-4234-b704-e06cb8747e8e') 176 451.54KiB 364.42KiB 15.99KiB 368.02KiB 994.84KiB 1.1MiB 1.55MiB 1.57MiB 1.17892
('http_pipelines_blackhole', 'comparison', '5161755e-f098-46c8-8d9a-d2a323f59439') 176 450.3KiB 367.23KiB 15.99KiB 322.8KiB 1008.63KiB 1.09MiB 1.42MiB 1.52MiB 0.999675
('http_pipelines_blackhole', 'comparison', 'cd36a4b8-6ac4-47f6-afc4-9d1c0af83fb8') 174 449.24KiB 368.07KiB 15.99KiB 368.02KiB 1.04MiB 1.14MiB 1.47MiB 1.63MiB 1.14238
('http_pipelines_blackhole', 'baseline', '6b2795a8-607f-43bd-821e-aa67bd9d235d') 177 442.37KiB 364.41KiB 15.99KiB 339.28KiB 993.31KiB 1.08MiB 1.43MiB 1.58MiB 1.02333

@jdrouet jdrouet requested a review from leebenson March 3, 2022 08:04
@jdrouet jdrouet marked this pull request as ready for review March 3, 2022 08:05
@jszwedko jszwedko requested a review from fuchsnj March 4, 2022 22:30
Signed-off-by: Jérémie Drouet <jeremie.drouet@datadoghq.com>
@@ -0,0 +1,91 @@
use bytes::Bytes;
Copy link
Member

@fuchsnj fuchsnj Mar 8, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems like this file should be request_builder?, it doesn't contain a service.

@jdrouet jdrouet requested a review from fuchsnj March 9, 2022 09:56
@github-actions
Copy link

github-actions bot commented Mar 9, 2022

Soak Test Results

Baseline: d06ee2a
Comparison: beb184e
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±5%:

Fine details of change detection per experiment.
experiment Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
http_to_http_acks 1.58MiB 10.36 91.32% 15.24MiB 7.96MiB 750.01KiB 0 0.519987 16.82MiB 7.77MiB 567.17KiB 0 0.461152 True True
http_pipelines_no_grok_blackhole 136.59KiB 2.22 99.68% 6.01MiB 623.47KiB 25.45KiB 0 0.101195 6.15MiB 709.09KiB 38.46KiB 0 0.112521 False False
http_to_http_json 412.83KiB 1.99 99.99% 20.28MiB 1.68MiB 100.71KiB 0 0.0825786 20.68MiB 742.73KiB 30.02KiB 0 0.0350383 False False
http_pipelines_blackhole 7.63KiB 1.19 22.70% 641.43KiB 438.94KiB 18.24KiB 0 0.683727 649.06KiB 472.66KiB 19.15KiB 0 0.727629 True True
datadog_agent_remap_datadog_logs_acks 777.19KiB 1.19 58.69% 63.75MiB 11.85MiB 941.75KiB 0 0.185316 64.51MiB 2.32MiB 101.96KiB 0 0.0360018 False False
socket_to_socket_blackhole 279.91KiB 1.11 93.27% 24.6MiB 3.28MiB 152.44KiB 0 0.133284 24.87MiB 183.08KiB 7.44KiB 0 0.00718273 False False
syslog_log2metric_humio_metrics 92.67KiB 0.7 88.48% 13.0MiB 1.25MiB 58.17KiB 0 0.0958638 13.09MiB 196.76KiB 8.03KiB 0 0.0146694 False False
syslog_loki 59.4KiB 0.47 84.40% 12.47MiB 900.78KiB 41.07KiB 0 0.0704829 12.53MiB 191.25KiB 7.81KiB 0 0.0148984 False False
http_pipelines_blackhole_acks 896.28B 0.14 2.58% 623.9KiB 466.98KiB 19.19KiB 0 0.747864 624.77KiB 462.36KiB 19.05KiB 0 0.73941 True True
splunk_hec_to_splunk_hec_logs_acks 6.95KiB 0.03 26.30% 23.84MiB 392.1KiB 15.94KiB 0 0.0160513 23.84MiB 332.6KiB 13.19KiB 0 0.0136123 False False
splunk_hec_to_splunk_hec_logs_noack 4.21KiB 0.02 17.82% 23.84MiB 321.01KiB 13.06KiB 0 0.0131387 23.84MiB 330.82KiB 13.37KiB 0 0.013538 False False
splunk_hec_indexer_ack_blackhole 3.0KiB 0.01 12.99% 23.84MiB 321.29KiB 13.12KiB 0 0.0131496 23.84MiB 314.34KiB 12.83KiB 0 0.0128637 False False
fluent_elasticsearch -627.42B -0 15.86% 79.47MiB 52.64KiB 2.13KiB 0 0.000646373 79.47MiB 54.41KiB 2.2KiB 0 0.000668048 False False
fluent_remap_aws_firehose -140.63KiB -0.17 81.84% 79.47MiB 54.96KiB 2.23KiB 0 0.00067479 79.34MiB 2.5MiB 105.12KiB 0 0.0314285 False False
syslog_splunk_hec_logs -59.22KiB -0.36 100.00% 16.09MiB 307.17KiB 12.42KiB 0 0.018628 16.03MiB 101.85KiB 4.16KiB 0 0.00619874 False False
datadog_agent_remap_datadog_logs -330.96KiB -0.49 99.98% 66.3MiB 2.0MiB 84.03KiB 0 0.0301623 65.98MiB 818.21KiB 31.95KiB 0 0.0121007 False False
http_datadog_filter_blackhole -50.85KiB -0.79 82.85% 6.31MiB 636.41KiB 25.85KiB 0 0.0983359 6.27MiB 656.33KiB 26.71KiB 0 0.102218 False True
splunk_hec_route_s3 -146.17KiB -1 62.69% 14.27MiB 2.33MiB 130.99KiB 0 0.163039 14.13MiB 2.14MiB 98.71KiB 0 0.151608 False False
syslog_regex_logs2metric_ddmetrics -134.26KiB -1.12 100.00% 11.71MiB 94.41KiB 3.85KiB 0 0.00786785 11.58MiB 149.39KiB 6.1KiB 0 0.0125908 False False
datadog_agent_remap_blackhole_acks -553.99KiB -1.36 100.00% 39.67MiB 2.63MiB 110.7KiB 0 0.0663627 39.13MiB 630.22KiB 25.73KiB 0 0.0157162 False False
splunk_transforms_splunk3 -148.02KiB -1.52 76.14% 9.48MiB 1.74MiB 88.24KiB 0 0.182852 9.34MiB 1.81MiB 89.26KiB 0 0.193986 False False
syslog_humio_logs -456.4KiB -2.76 100.00% 16.13MiB 96.43KiB 3.92KiB 0 0.00583273 15.69MiB 1.69MiB 78.31KiB 0 0.107803 False False
syslog_log2metric_splunk_hec_metrics -472.04KiB -2.8 100.00% 16.44MiB 208.26KiB 8.5KiB 0 0.0123626 15.98MiB 1.6MiB 74.47KiB 0 0.0998329 False False
datadog_agent_remap_blackhole -1.29MiB -3.23 100.00% 39.92MiB 2.0MiB 83.38KiB 0 0.0500916 38.63MiB 489.14KiB 19.92KiB 0 0.0123555 False False
Fine details of each soak run.
(experiment, variant, run_id) total samples mean std min median p90 p95 p99 max skewness
('fluent_remap_aws_firehose', 'baseline', 'deaca20e-594f-4711-869d-4b8b02873c6a') 203 79.47MiB 55.22KiB 79.35MiB 79.47MiB 79.55MiB 79.57MiB 79.58MiB 79.61MiB 0.0733112
('fluent_remap_aws_firehose', 'comparison', '6e0dfdfc-b89f-4f73-9dab-145aa6f3b5be') 202 79.47MiB 49.73KiB 79.34MiB 79.47MiB 79.54MiB 79.56MiB 79.58MiB 79.59MiB 0.0881152
('fluent_elasticsearch', 'baseline', '3ce342ee-9d23-467f-983f-d6fb72afccf6') 204 79.47MiB 50.96KiB 79.32MiB 79.47MiB 79.54MiB 79.55MiB 79.58MiB 79.62MiB 0.0191198
('fluent_remap_aws_firehose', 'baseline', 'a9d27e8a-33be-4cdd-b0ae-cef7ac1c0830') 202 79.47MiB 56.69KiB 79.33MiB 79.47MiB 79.54MiB 79.57MiB 79.6MiB 79.61MiB -0.0250234
('fluent_elasticsearch', 'comparison', '4077c093-8305-4f3b-94a9-011398384cc3') 204 79.47MiB 51.34KiB 79.36MiB 79.47MiB 79.54MiB 79.56MiB 79.59MiB 79.62MiB 0.195058
('fluent_remap_aws_firehose', 'baseline', '163f14ed-6bc7-46ed-9135-5c70ae83dcc9') 202 79.47MiB 53.19KiB 79.33MiB 79.47MiB 79.55MiB 79.57MiB 79.59MiB 79.61MiB 0.183496
('fluent_elasticsearch', 'baseline', '010b2bf2-0b22-4044-82e8-9bd55791ae71') 204 79.47MiB 55.13KiB 79.35MiB 79.47MiB 79.55MiB 79.56MiB 79.58MiB 79.6MiB 0.00973128
('fluent_elasticsearch', 'baseline', 'd19c0713-dbeb-4efd-b38c-7a4ef635d260') 204 79.47MiB 52.01KiB 79.33MiB 79.47MiB 79.55MiB 79.56MiB 79.58MiB 79.6MiB 0.0974438
('fluent_elasticsearch', 'comparison', 'a192d297-beab-42b6-a76e-91a9aa7adf45') 204 79.47MiB 53.28KiB 79.22MiB 79.47MiB 79.53MiB 79.55MiB 79.57MiB 79.61MiB -0.645981
('fluent_elasticsearch', 'comparison', 'ba1a9d94-380f-42d5-9e38-98d50c2faae7') 204 79.47MiB 58.6KiB 79.25MiB 79.47MiB 79.55MiB 79.56MiB 79.58MiB 79.61MiB -0.196999
('fluent_remap_aws_firehose', 'comparison', '2b5293aa-69b5-444f-9681-dc23b5654b53') 203 79.45MiB 389.2KiB 74.11MiB 79.47MiB 79.54MiB 79.56MiB 79.6MiB 79.6MiB -13.8422
('fluent_remap_aws_firehose', 'comparison', 'ee8d7848-d22c-429d-9bfa-430c2c02d34b') 186 79.07MiB 4.43MiB 21.74MiB 79.47MiB 79.54MiB 79.55MiB 79.57MiB 79.57MiB -12.2081
('datadog_agent_remap_datadog_logs', 'baseline', '9c86c906-e9ba-433f-b35e-0a8b71a5e43b') 195 67.24MiB 3.28MiB 24.07MiB 67.55MiB 67.91MiB 67.98MiB 68.11MiB 68.21MiB -12.1198
('datadog_agent_remap_datadog_logs', 'comparison', '1178fa89-c087-4b73-91f6-64719782941a') 228 66.16MiB 876.68KiB 64.85MiB 65.98MiB 67.24MiB 68.48MiB 68.85MiB 69.26MiB 1.90115
('datadog_agent_remap_datadog_logs', 'comparison', 'd53996c1-31a3-4bae-a2f6-387c8a9a61ee') 200 65.96MiB 234.17KiB 65.3MiB 65.98MiB 66.26MiB 66.32MiB 66.4MiB 66.43MiB -0.244507
('datadog_agent_remap_datadog_logs', 'baseline', '6269b364-3e5b-469a-bdca-94db757c45d2') 200 65.89MiB 303.57KiB 65.42MiB 65.89MiB 66.1MiB 66.19MiB 67.16MiB 68.2MiB 4.10265
('datadog_agent_remap_datadog_logs', 'comparison', 'bc0ce4ae-4d02-4477-8912-376a2ad286c4') 228 65.81MiB 1.0MiB 64.97MiB 65.49MiB 66.85MiB 68.72MiB 69.28MiB 69.5MiB 2.60283
('datadog_agent_remap_datadog_logs', 'baseline', '0df76ebf-a2c5-4036-ab3a-f29594fb9a21') 200 65.8MiB 259.49KiB 65.24MiB 65.79MiB 66.15MiB 66.19MiB 66.42MiB 66.46MiB 0.147534
('datadog_agent_remap_datadog_logs_acks', 'comparison', 'ed01e96c-f2d3-4f2a-9232-854f38e1f8d4') 141 64.99MiB 4.5MiB 15.0MiB 65.49MiB 65.74MiB 65.78MiB 65.95MiB 65.98MiB -10.3297
('datadog_agent_remap_datadog_logs_acks', 'baseline', 'b1db9993-2cf3-4fe3-bd8a-9eb22a062015') 145 64.8MiB 9.01MiB 34.5KiB 66.2MiB 66.55MiB 66.6MiB 66.69MiB 66.75MiB -6.61349
('datadog_agent_remap_datadog_logs_acks', 'comparison', '65cda3c3-42cc-444e-a28a-cc8d0d03f20e') 202 64.63MiB 236.32KiB 63.88MiB 64.63MiB 64.94MiB 65.02MiB 65.16MiB 65.23MiB -0.00209926
('datadog_agent_remap_datadog_logs_acks', 'comparison', 'ce784054-fdc9-4e86-bc2c-74711703d316') 202 64.05MiB 255.62KiB 63.1MiB 64.07MiB 64.3MiB 64.36MiB 64.76MiB 65.01MiB 0.00885294
('datadog_agent_remap_datadog_logs_acks', 'baseline', '9f7a0e89-e6f2-4058-9acc-e95ae0de5188') 21 56.49MiB 22.6MiB 34.76KiB 66.41MiB 66.77MiB 66.86MiB 66.89MiB 66.9MiB -2.08122
('datadog_agent_remap_blackhole', 'baseline', '85c0f8ab-7730-46da-8eab-73ef795c3ffa') 200 40.37MiB 3.11MiB 8.98MiB 40.76MiB 41.31MiB 41.45MiB 41.74MiB 41.91MiB -8.74421
('datadog_agent_remap_blackhole_acks', 'baseline', '6065d5be-1805-43d8-abaa-487a6d5b0207') 196 40.06MiB 2.34MiB 17.28MiB 40.23MiB 40.98MiB 41.72MiB 42.46MiB 42.7MiB -7.56353
('datadog_agent_remap_blackhole', 'baseline', '7ef2f407-eb1b-4bfc-b3d8-5ee49aa51867') 202 40.04MiB 1.3MiB 28.95MiB 40.0MiB 40.97MiB 41.86MiB 42.65MiB 42.9MiB -5.34801
('datadog_agent_remap_blackhole_acks', 'baseline', '57d8319a-652c-4152-8a37-d4dbd3a0e4c9') 198 39.7MiB 3.8MiB 4.86MiB 40.22MiB 41.01MiB 41.3MiB 41.91MiB 42.22MiB -6.72659
('datadog_agent_remap_blackhole_acks', 'comparison', '8b0a03e1-58ad-4a99-8277-c9a997b15c81') 200 39.53MiB 702.01KiB 37.8MiB 39.4MiB 40.51MiB 40.75MiB 41.01MiB 41.48MiB 0.377461
('datadog_agent_remap_blackhole', 'baseline', '992fb8de-2a7b-43a7-af91-0c95a42b2da0') 202 39.35MiB 472.35KiB 38.0MiB 39.32MiB 39.96MiB 40.17MiB 40.46MiB 40.54MiB 0.0501007
('datadog_agent_remap_blackhole_acks', 'baseline', 'c9a91e1f-2bf5-403a-bc59-c6e1049391bd') 200 39.25MiB 859.04KiB 37.96MiB 39.09MiB 40.06MiB 41.39MiB 41.97MiB 42.17MiB 1.85123
('datadog_agent_remap_blackhole_acks', 'comparison', 'cb4e067b-45dd-4239-b262-77cac6684185') 200 39.1MiB 409.43KiB 38.07MiB 39.13MiB 39.62MiB 39.72MiB 39.81MiB 40.14MiB -0.105238
('datadog_agent_remap_blackhole', 'comparison', '1bbc6d31-088a-4811-b5ef-73ad6a011df8') 201 38.94MiB 437.01KiB 37.75MiB 38.98MiB 39.46MiB 39.57MiB 39.78MiB 40.02MiB -0.354707
('datadog_agent_remap_blackhole_acks', 'comparison', '96381840-7bb3-426c-8233-50e0415599ec') 200 38.75MiB 459.38KiB 37.53MiB 38.77MiB 39.33MiB 39.46MiB 39.65MiB 39.9MiB -0.153491
('datadog_agent_remap_blackhole', 'comparison', '178b01c9-a1ba-483a-9f12-2f2a0098194f') 201 38.55MiB 434.38KiB 37.39MiB 38.59MiB 39.07MiB 39.21MiB 39.48MiB 39.8MiB 0.0341012
('datadog_agent_remap_blackhole', 'comparison', '40126327-62e6-44f1-8587-6bbecfa460c6') 201 38.4MiB 423.93KiB 37.38MiB 38.37MiB 38.96MiB 39.08MiB 39.32MiB 39.48MiB 0.0988876
('socket_to_socket_blackhole', 'baseline', 'e4ab80ea-ae68-483a-848c-4c8205f36f97') 202 25.2MiB 87.91KiB 24.94MiB 25.21MiB 25.3MiB 25.32MiB 25.36MiB 25.37MiB -0.552409
('socket_to_socket_blackhole', 'comparison', '2c503e08-b7fa-4733-90da-5c1b9b2e8f26') 202 24.99MiB 142.46KiB 24.73MiB 24.95MiB 25.21MiB 25.24MiB 25.27MiB 25.3MiB 0.532803
('socket_to_socket_blackhole', 'comparison', 'd525d5ff-9be3-49fa-9222-c736c6e04f69') 202 24.95MiB 114.56KiB 24.71MiB 24.96MiB 25.09MiB 25.14MiB 25.18MiB 25.21MiB -0.0799393
('socket_to_socket_blackhole', 'baseline', '8c4c5e05-2823-45b2-b79a-82d32b795951') 202 24.91MiB 114.1KiB 24.47MiB 24.94MiB 25.02MiB 25.05MiB 25.09MiB 25.1MiB -1.40632
('socket_to_socket_blackhole', 'comparison', 'ca36db7b-cd25-4974-8989-0af395e265f6') 202 24.67MiB 62.88KiB 24.48MiB 24.67MiB 24.74MiB 24.76MiB 24.79MiB 24.87MiB -0.338142
('splunk_hec_indexer_ack_blackhole', 'comparison', 'dddbdc42-5bfa-49c2-b5d7-d8724fb87a72') 200 23.85MiB 317.48KiB 23.17MiB 23.84MiB 24.23MiB 24.38MiB 24.52MiB 24.88MiB 0.232879
('splunk_hec_to_splunk_hec_logs_acks', 'comparison', 'cf984c92-7001-43ab-92d8-a4f00c114863') 203 23.85MiB 368.71KiB 22.54MiB 23.85MiB 24.33MiB 24.43MiB 24.55MiB 24.75MiB -0.345258
('splunk_hec_indexer_ack_blackhole', 'baseline', '7e4e016b-2237-4b53-8afb-db449703ca2c') 200 23.85MiB 329.59KiB 23.06MiB 23.86MiB 24.26MiB 24.33MiB 24.48MiB 24.82MiB -0.0307119
('splunk_hec_to_splunk_hec_logs_noack', 'comparison', '5c3833f7-e628-410e-8c48-4a7512d013d2') 204 23.85MiB 337.67KiB 23.06MiB 23.85MiB 24.22MiB 24.34MiB 24.6MiB 25.06MiB 0.122496
('splunk_hec_to_splunk_hec_logs_acks', 'baseline', 'b4ffad99-84ce-44e5-b016-cb8d885adeaa') 200 23.85MiB 418.99KiB 21.6MiB 23.85MiB 24.34MiB 24.43MiB 24.6MiB 25.71MiB -0.474783
('splunk_hec_indexer_ack_blackhole', 'comparison', '37fffb22-7286-472c-b23a-d5d2d37b45a1') 200 23.85MiB 311.66KiB 23.06MiB 23.87MiB 24.23MiB 24.31MiB 24.45MiB 24.48MiB -0.146145
('splunk_hec_to_splunk_hec_logs_noack', 'comparison', '7d2bd757-fae2-45fb-a816-21bd4e624467') 204 23.84MiB 334.95KiB 23.06MiB 23.85MiB 24.26MiB 24.37MiB 24.58MiB 24.6MiB -0.0969631
('splunk_hec_to_splunk_hec_logs_noack', 'comparison', '3f702e27-087c-4c46-82e6-dc3d4ca54125') 204 23.84MiB 321.21KiB 23.06MiB 23.84MiB 24.23MiB 24.31MiB 24.48MiB 24.6MiB -0.0718937
('splunk_hec_to_splunk_hec_logs_acks', 'comparison', '31396067-f3bc-4a99-a833-11855bee3e56') 230 23.84MiB 321.31KiB 23.06MiB 23.85MiB 24.22MiB 24.34MiB 24.59MiB 24.61MiB -0.132811
('splunk_hec_to_splunk_hec_logs_noack', 'baseline', '0ef64b2d-a0a3-43ae-ab7f-a008b23a3b7d') 200 23.84MiB 308.22KiB 23.06MiB 23.85MiB 24.21MiB 24.34MiB 24.48MiB 24.6MiB -0.151733
('splunk_hec_to_splunk_hec_logs_noack', 'baseline', 'b62e41de-5a45-4bb2-9725-dabc8985d3a9') 200 23.84MiB 328.32KiB 22.94MiB 23.84MiB 24.24MiB 24.37MiB 24.48MiB 24.6MiB -0.116307
('splunk_hec_to_splunk_hec_logs_acks', 'baseline', '005dacc7-7595-43bf-9cfa-a872c72812dc') 200 23.84MiB 326.81KiB 23.06MiB 23.84MiB 24.2MiB 24.36MiB 24.57MiB 24.64MiB -0.107771
('splunk_hec_indexer_ack_blackhole', 'baseline', '79df6b54-2a60-479c-805d-8ff350f89db3') 200 23.84MiB 313.8KiB 22.94MiB 23.84MiB 24.22MiB 24.3MiB 24.45MiB 24.6MiB -0.229629
('splunk_hec_to_splunk_hec_logs_acks', 'comparison', 'f1198646-f7fb-4da0-abd3-efe867f62539') 203 23.84MiB 307.76KiB 23.2MiB 23.84MiB 24.21MiB 24.33MiB 24.48MiB 24.6MiB 0.0057439
('splunk_hec_indexer_ack_blackhole', 'comparison', '654041f9-38f7-4970-9186-ea61dbccc6b9') 200 23.84MiB 315.34KiB 22.97MiB 23.84MiB 24.23MiB 24.29MiB 24.49MiB 24.57MiB -0.0926229
('splunk_hec_to_splunk_hec_logs_noack', 'baseline', 'cfee7d30-eb2a-45ad-a842-4174f9d0adcd') 204 23.84MiB 327.55KiB 22.79MiB 23.87MiB 24.22MiB 24.31MiB 24.46MiB 24.64MiB -0.23472
('splunk_hec_indexer_ack_blackhole', 'baseline', 'fbd42dfd-ab5c-4a65-8b81-c7c0dabc865d') 200 23.84MiB 321.84KiB 22.79MiB 23.85MiB 24.24MiB 24.31MiB 24.45MiB 24.6MiB -0.218348
('splunk_hec_to_splunk_hec_logs_acks', 'baseline', 'aa82ea07-fbd0-40cb-bdaa-544332a1586d') 205 23.82MiB 423.63KiB 20.17MiB 23.84MiB 24.26MiB 24.33MiB 24.52MiB 24.6MiB -3.39179
('socket_to_socket_blackhole', 'baseline', 'd2073d2a-5340-4c64-aeea-a4920dde5d4f') 82 22.34MiB 7.62MiB 24.84KiB 25.02MiB 25.11MiB 25.21MiB 25.31MiB 25.36MiB -2.57349
('http_to_http_json', 'comparison', '6dcef8f1-4acf-4f59-a14d-e5297c0c45a2') 204 20.84MiB 666.94KiB 19.25MiB 20.9MiB 21.63MiB 21.77MiB 22.37MiB 22.59MiB -0.0698299
('http_to_http_json', 'comparison', '451410e4-1479-4fb8-93fd-453105d1ce20') 204 20.72MiB 797.29KiB 18.86MiB 20.65MiB 21.75MiB 22.02MiB 22.31MiB 22.62MiB -0.0223558
('http_to_http_json', 'comparison', '6a97c604-0917-4b33-9083-05e9f8c4f858') 204 20.49MiB 714.09KiB 18.8MiB 20.47MiB 21.32MiB 21.59MiB 22.44MiB 22.83MiB 0.230651
('http_to_http_json', 'baseline', '8d5105cb-5357-41ca-88db-041bcb6b9226') 201 20.36MiB 727.7KiB 18.43MiB 20.33MiB 21.25MiB 21.52MiB 21.82MiB 22.5MiB 0.0949631
('http_to_http_json', 'baseline', 'e43e1398-c18e-431d-a3f3-22aba279e29e') 65 20.21MiB 2.71MiB 1.76MiB 20.67MiB 21.54MiB 21.74MiB 22.34MiB 22.52MiB -5.62368
('http_to_http_json', 'baseline', '23f2d293-e247-4924-a869-1870f4ae92da') 25 19.84MiB 3.14MiB 6.1MiB 20.41MiB 21.87MiB 22.03MiB 22.31MiB 22.4MiB -3.80624
('http_to_http_acks', 'comparison', 'd7f34fef-73af-4c67-b745-941061c46a2d') 86 17.17MiB 8.3MiB 869.11KiB 19.18MiB 27.98MiB 30.31MiB 30.74MiB 30.75MiB -0.219911
('syslog_log2metric_splunk_hec_metrics', 'baseline', 'f6197cde-c25e-4ffc-b9d1-1fce3043ed39') 200 16.62MiB 256.4KiB 16.24MiB 16.79MiB 16.87MiB 16.88MiB 16.92MiB 16.93MiB -0.290766
('http_to_http_acks', 'comparison', '29f3124f-a365-40c1-8be5-2194631e81e9') 111 16.54MiB 7.36MiB 655.12KiB 17.4MiB 26.94MiB 29.51MiB 30.74MiB 30.74MiB 0.0956363
('syslog_splunk_hec_logs', 'baseline', '25564420-cb24-492d-a9bf-fd186001620a') 204 16.41MiB 64.03KiB 16.3MiB 16.41MiB 16.48MiB 16.5MiB 16.56MiB 16.83MiB 2.82884
('syslog_log2metric_splunk_hec_metrics', 'baseline', '25b2c782-e92b-4e4b-bc5c-62c11df13a0f') 200 16.38MiB 82.89KiB 16.27MiB 16.37MiB 16.42MiB 16.52MiB 16.73MiB 16.78MiB 2.93512
('syslog_log2metric_splunk_hec_metrics', 'baseline', '09bdf6ff-e502-44b3-91fb-fefee87ec753') 200 16.31MiB 54.0KiB 16.2MiB 16.31MiB 16.36MiB 16.38MiB 16.57MiB 16.63MiB 2.69777
('syslog_log2metric_splunk_hec_metrics', 'comparison', '4b6d14ce-9d00-4c90-a5af-2642dd36f1dd') 200 16.23MiB 75.27KiB 16.1MiB 16.21MiB 16.33MiB 16.34MiB 16.37MiB 16.57MiB 0.725456
('syslog_humio_logs', 'baseline', '11a84660-d577-42ad-9c84-cd33cfa62c3a') 202 16.21MiB 73.79KiB 15.78MiB 16.21MiB 16.25MiB 16.28MiB 16.48MiB 16.54MiB -0.17337
('syslog_splunk_hec_logs', 'comparison', 'fd585369-5687-43ab-8eeb-cdf9075e75a5') 200 16.15MiB 64.36KiB 16.01MiB 16.14MiB 16.2MiB 16.21MiB 16.47MiB 16.56MiB 3.07369
('syslog_splunk_hec_logs', 'baseline', 'af99da90-880e-4c42-88fd-a3a85dbc7b4a') 204 16.14MiB 67.32KiB 15.99MiB 16.13MiB 16.19MiB 16.3MiB 16.38MiB 16.41MiB 1.93276
('syslog_humio_logs', 'baseline', '96b46c43-ebe8-4663-9150-9432ce622697') 202 16.12MiB 99.38KiB 15.69MiB 16.11MiB 16.16MiB 16.2MiB 16.65MiB 16.67MiB 2.6898
('syslog_humio_logs', 'baseline', 'b09d7740-cdd4-42f0-9403-334bef682443') 202 16.06MiB 37.83KiB 15.94MiB 16.06MiB 16.11MiB 16.13MiB 16.15MiB 16.18MiB 0.0367597
('syslog_splunk_hec_logs', 'comparison', '2aa9a6a6-46f9-4352-b65a-d1e13c1f670b') 200 16.01MiB 57.89KiB 15.88MiB 16.0MiB 16.06MiB 16.09MiB 16.22MiB 16.26MiB 1.4451
('syslog_splunk_hec_logs', 'comparison', 'd2c19524-7d42-4424-9cd6-1dcebdf8cb07') 200 15.94MiB 37.99KiB 15.83MiB 15.94MiB 15.99MiB 16.0MiB 16.03MiB 16.04MiB -0.0104546
('syslog_humio_logs', 'comparison', 'f0d72d62-00bb-44e4-a46a-0500892adde2') 204 15.93MiB 43.64KiB 15.81MiB 15.93MiB 15.98MiB 16.0MiB 16.02MiB 16.04MiB -0.157039
('syslog_log2metric_splunk_hec_metrics', 'comparison', 'a21bac11-ba54-49c9-ab00-af2bb8a23afb') 200 15.86MiB 65.37KiB 15.73MiB 15.85MiB 15.96MiB 15.99MiB 16.03MiB 16.04MiB 0.767425
('syslog_humio_logs', 'comparison', '0367e6f3-c0ec-4261-998e-c7011dab3ee5') 204 15.72MiB 48.06KiB 15.61MiB 15.72MiB 15.77MiB 15.79MiB 15.9MiB 15.96MiB 1.24449
('syslog_splunk_hec_logs', 'baseline', 'a924b413-0e25-4d91-a785-675edc6d2c23') 204 15.72MiB 124.81KiB 15.56MiB 15.68MiB 15.89MiB 16.05MiB 16.15MiB 16.19MiB 2.26566
('syslog_log2metric_splunk_hec_metrics', 'comparison', '5895687a-ba57-49d2-b20a-ba4f81526349') 82 15.64MiB 3.85MiB 24.76KiB 16.63MiB 16.7MiB 17.0MiB 17.02MiB 17.05MiB -3.71212
('http_to_http_acks', 'baseline', '2ce988f9-3a0e-4d57-8045-63258c5ce220') 118 15.24MiB 7.96MiB 975.76KiB 16.61MiB 25.82MiB 30.5MiB 30.75MiB 30.75MiB 0.202707
('syslog_humio_logs', 'comparison', 'dab216e8-d438-48eb-8585-1bfee9a5d849') 82 14.99MiB 4.08MiB 13.73KiB 16.16MiB 16.21MiB 16.22MiB 16.25MiB 16.27MiB -3.33609
('splunk_hec_route_s3', 'baseline', 'a3a95fc4-7755-41ed-b461-3bd4c1b823a7') 204 14.52MiB 2.17MiB 9.79MiB 14.58MiB 17.27MiB 18.02MiB 19.19MiB 19.92MiB 0.0303239
('splunk_hec_route_s3', 'comparison', '03f3118f-fb2e-444e-9dbe-6d8cf3f0fcff') 204 14.29MiB 2.08MiB 8.6MiB 14.35MiB 17.02MiB 17.61MiB 18.26MiB 19.77MiB -0.051886
('splunk_hec_route_s3', 'baseline', 'be330053-ac11-42c3-ae9a-55612bf8756a') 71 14.17MiB 2.35MiB 8.42MiB 13.71MiB 16.98MiB 17.51MiB 18.6MiB 19.7MiB -0.0882731
('splunk_hec_route_s3', 'comparison', '1c0e33a3-5864-4a8c-9061-6efbfc7d64ae') 204 14.05MiB 2.06MiB 9.34MiB 14.15MiB 16.68MiB 17.15MiB 18.27MiB 18.8MiB -0.0641493
('splunk_hec_route_s3', 'comparison', 'a708c615-9db3-4195-9a73-42d481a4cd14') 87 13.95MiB 2.46MiB 2.19MiB 13.87MiB 16.97MiB 17.24MiB 18.01MiB 19.19MiB -1.18769
('splunk_hec_route_s3', 'baseline', '0ab6787a-a56d-41ac-8e6a-f41b63df2ac6') 57 13.54MiB 2.72MiB 1.98MiB 13.56MiB 16.64MiB 16.94MiB 17.55MiB 17.73MiB -1.2777
('syslog_log2metric_humio_metrics', 'comparison', '0dfad3c2-db54-4c5a-8857-b8659ce7a6d7') 200 13.32MiB 114.16KiB 13.1MiB 13.31MiB 13.45MiB 13.54MiB 13.67MiB 13.74MiB 0.960491
('syslog_log2metric_humio_metrics', 'baseline', '3eaf15e2-2a6c-40bc-a863-6e94e994f34f') 202 13.17MiB 213.48KiB 12.71MiB 13.2MiB 13.42MiB 13.46MiB 13.52MiB 13.58MiB -0.134089
('syslog_log2metric_humio_metrics', 'baseline', '71f696be-ef24-4ac1-a55d-d592179475f5') 202 13.08MiB 113.26KiB 12.85MiB 13.08MiB 13.2MiB 13.24MiB 13.37MiB 13.67MiB 0.885422
('syslog_log2metric_humio_metrics', 'comparison', '22949218-ba1f-46dc-80b3-65381d65f00e') 200 12.98MiB 82.12KiB 12.75MiB 12.98MiB 13.09MiB 13.12MiB 13.16MiB 13.17MiB -0.110007
('syslog_log2metric_humio_metrics', 'comparison', 'd2c620e7-f4b5-4ec2-a284-152461c5753c') 200 12.96MiB 95.16KiB 12.75MiB 12.96MiB 13.08MiB 13.12MiB 13.22MiB 13.24MiB 0.374809
('syslog_loki', 'baseline', 'be3a45b3-adf6-4af2-96c7-0e36c8c2b51f') 202 12.62MiB 105.99KiB 12.08MiB 12.64MiB 12.69MiB 12.71MiB 12.73MiB 12.75MiB -3.28794
('syslog_loki', 'comparison', 'ae27dbb0-a348-4cc7-9610-57d5d8384d3b') 200 12.6MiB 152.99KiB 11.84MiB 12.63MiB 12.69MiB 12.7MiB 12.72MiB 12.76MiB -3.87115
('syslog_loki', 'comparison', '077c57bf-ce41-4a98-bce8-04351224d2c7') 200 12.53MiB 210.97KiB 12.18MiB 12.65MiB 12.73MiB 12.75MiB 12.76MiB 12.77MiB -0.47053
('syslog_loki', 'comparison', 'd0b6d068-0eef-4dd5-abca-d157ea77b130') 200 12.45MiB 173.21KiB 12.25MiB 12.37MiB 12.76MiB 12.8MiB 12.84MiB 12.85MiB 1.24207
('syslog_loki', 'baseline', 'e845ec84-1528-4964-971f-9ef8ba7e0baa') 202 12.44MiB 181.76KiB 11.87MiB 12.5MiB 12.59MiB 12.63MiB 12.67MiB 12.67MiB -1.68081
('syslog_log2metric_humio_metrics', 'baseline', 'e8d423b2-1400-47a9-b0b2-7ff38e4591f1') 78 12.33MiB 3.0MiB 37.16KiB 13.09MiB 13.22MiB 13.28MiB 13.34MiB 13.43MiB -3.78548
('syslog_loki', 'baseline', 'b86a2501-3f4f-4f27-b2e9-c5ffb2c4e356') 77 12.14MiB 2.15MiB 49.53KiB 12.6MiB 12.68MiB 12.71MiB 12.77MiB 12.78MiB -5.2019
('syslog_regex_logs2metric_ddmetrics', 'baseline', '606cc7bf-d221-48b3-839d-27c2923007c5') 200 11.75MiB 127.72KiB 11.63MiB 11.73MiB 11.84MiB 11.86MiB 12.36MiB 12.42MiB 3.44855
('syslog_regex_logs2metric_ddmetrics', 'comparison', '9d0da8e1-b5f4-4a3a-bdae-202959bdc0ef') 200 11.73MiB 63.26KiB 11.63MiB 11.72MiB 11.79MiB 11.81MiB 11.97MiB 12.15MiB 2.4113
('syslog_regex_logs2metric_ddmetrics', 'baseline', '1ec785d7-b278-4482-9a3e-b07796825a4b') 200 11.72MiB 48.38KiB 11.56MiB 11.72MiB 11.78MiB 11.8MiB 11.83MiB 11.84MiB 0.0764125
('syslog_regex_logs2metric_ddmetrics', 'baseline', 'c303ffee-a87c-4117-b051-a9345bceaf0b') 200 11.66MiB 57.17KiB 11.49MiB 11.66MiB 11.72MiB 11.74MiB 11.8MiB 11.91MiB 0.260702
('syslog_regex_logs2metric_ddmetrics', 'comparison', '4d2c7479-677e-4257-b65d-7f94f73533d7') 200 11.51MiB 110.52KiB 11.32MiB 11.47MiB 11.69MiB 11.7MiB 11.73MiB 11.74MiB 0.705311
('syslog_regex_logs2metric_ddmetrics', 'comparison', 'c8dd2de5-a4a3-483a-a698-ef9a1a8e5198') 200 11.49MiB 113.55KiB 11.35MiB 11.45MiB 11.68MiB 11.69MiB 11.72MiB 11.75MiB 0.925201
('splunk_transforms_splunk3', 'baseline', '84678df6-77a1-42ff-9b85-219df538375c') 203 9.52MiB 1.68MiB 5.17MiB 9.46MiB 11.71MiB 12.01MiB 13.05MiB 13.69MiB 0.068311
('splunk_transforms_splunk3', 'baseline', 'f3fc55a4-e9ca-43bd-a8ba-fed664de62e3') 203 9.45MiB 1.79MiB 4.69MiB 9.61MiB 11.65MiB 12.08MiB 13.15MiB 13.69MiB -0.153087
('splunk_transforms_splunk3', 'comparison', '4cb013d2-20b6-4491-8bc5-693c63ade1be') 231 9.36MiB 1.8MiB 5.18MiB 9.28MiB 11.55MiB 12.19MiB 13.03MiB 13.9MiB 0.00294166
('splunk_transforms_splunk3', 'comparison', 'd693dc7d-2c15-4aa3-bcce-7b8c17da1956') 202 9.32MiB 1.83MiB 5.38MiB 9.27MiB 11.74MiB 12.33MiB 13.11MiB 14.71MiB 0.121597
('http_datadog_filter_blackhole', 'comparison', 'e8c28227-c376-467a-8e5e-c4cfe8e8d179') 201 6.44MiB 710.21KiB 4.92MiB 6.4MiB 7.34MiB 7.52MiB 8.43MiB 8.87MiB 0.367959
('http_datadog_filter_blackhole', 'baseline', 'acc62dc4-1f69-4404-95f2-4ced038fb73b') 202 6.43MiB 631.86KiB 5.22MiB 6.32MiB 7.25MiB 7.42MiB 8.0MiB 8.18MiB 0.443081
('http_datadog_filter_blackhole', 'baseline', 'ea603a44-e05f-4d7c-ac50-9f44a52dfdd8') 202 6.36MiB 650.55KiB 4.98MiB 6.21MiB 7.19MiB 7.52MiB 7.85MiB 8.06MiB 0.393259
('http_datadog_filter_blackhole', 'comparison', '304f55bd-4922-4181-b7cc-0fd3749f69d5') 202 6.22MiB 663.59KiB 4.75MiB 6.11MiB 7.14MiB 7.35MiB 7.84MiB 8.08MiB 0.375482
('http_pipelines_no_grok_blackhole', 'comparison', 'fbe59245-3f3e-4f25-b3b9-132b7459ed71') 200 6.21MiB 655.22KiB 4.62MiB 6.1MiB 7.15MiB 7.39MiB 7.6MiB 8.06MiB 0.296421
('http_datadog_filter_blackhole', 'baseline', '9490fc8d-b0a4-4281-8e30-38029612c7c9') 202 6.16MiB 595.24KiB 5.08MiB 6.05MiB 7.0MiB 7.29MiB 7.73MiB 8.41MiB 0.826745
('http_datadog_filter_blackhole', 'comparison', '6f668bdb-5630-4ce9-9e73-c5e96c8ba92a') 201 6.14MiB 549.09KiB 4.77MiB 6.13MiB 6.9MiB 6.96MiB 7.28MiB 7.36MiB -0.191934
('http_pipelines_no_grok_blackhole', 'baseline', '70f25136-2834-40b6-83c9-e8cf303b1ce4') 200 6.08MiB 662.35KiB 4.36MiB 5.98MiB 6.98MiB 7.14MiB 7.58MiB 8.18MiB 0.394228
('http_pipelines_no_grok_blackhole', 'comparison', '162a1eeb-9a5e-4e75-a293-7e893a563bf7') 140 6.05MiB 772.42KiB 1.74MiB 6.03MiB 7.02MiB 7.07MiB 7.46MiB 7.7MiB -1.20028
('http_pipelines_no_grok_blackhole', 'baseline', 'ecb2cfad-12a1-48eb-966f-ced16367103d') 200 6.02MiB 587.73KiB 4.83MiB 5.96MiB 6.86MiB 7.14MiB 7.38MiB 7.49MiB 0.450137
('http_pipelines_no_grok_blackhole', 'baseline', '85636aee-b7ff-4e02-a640-78b82d2f138b') 200 5.94MiB 612.27KiB 4.61MiB 5.91MiB 6.76MiB 7.02MiB 7.51MiB 7.8MiB 0.423105
('http_pipelines_blackhole', 'baseline', '883ac985-ff9e-4a20-b18e-4e58130adaef') 191 659.64KiB 426.81KiB 15.99KiB 597.56KiB 1.29MiB 1.45MiB 1.7MiB 1.94MiB 0.771325
('http_pipelines_blackhole', 'comparison', 'c340fe25-0624-4e9c-a0ba-b98b424085bd') 193 659.36KiB 500.22KiB 15.99KiB 566.67KiB 1.28MiB 1.51MiB 2.26MiB 2.64MiB 1.42059
('http_pipelines_blackhole', 'comparison', '2a394ae3-5f9c-4600-bdcb-0f9a72b53b22') 192 651.12KiB 425.82KiB 31.98KiB 583.77KiB 1.21MiB 1.39MiB 1.75MiB 1.85MiB 0.759441
('http_pipelines_blackhole', 'comparison', '6750f259-0dc2-41b5-bbf4-65829564aedd') 224 638.42KiB 488.02KiB 15.99KiB 544.33KiB 1.25MiB 1.54MiB 2.14MiB 2.86MiB 1.4122
('http_pipelines_blackhole', 'baseline', '0de75d15-4c43-4bcf-a9d3-4336f361c1ee') 195 634.13KiB 454.49KiB 15.99KiB 550.68KiB 1.35MiB 1.55MiB 1.78MiB 2.07MiB 0.988721
('http_pipelines_blackhole_acks', 'comparison', '64af697d-16ba-40bd-a849-9a8e226a2fc3') 197 631.07KiB 436.39KiB 30.89KiB 581.57KiB 1.23MiB 1.4MiB 1.78MiB 2.02MiB 0.698447
('http_pipelines_blackhole', 'baseline', '8f698dc5-6d64-4ea2-b5f3-b4bdf4dfa996') 193 630.77KiB 436.49KiB 15.99KiB 597.56KiB 1.21MiB 1.51MiB 1.67MiB 1.81MiB 0.718529
('http_pipelines_blackhole_acks', 'baseline', '57219ca8-7a25-4665-8a89-418e8a1088a4') 197 629.55KiB 473.37KiB 15.99KiB 520.3KiB 1.36MiB 1.52MiB 1.72MiB 1.9MiB 0.763638
('http_pipelines_blackhole_acks', 'baseline', '74983b9b-9450-4f03-ad73-e2db86ba9c4f') 197 626.88KiB 484.65KiB 15.99KiB 550.11KiB 1.32MiB 1.56MiB 1.78MiB 2.39MiB 0.868942
('http_pipelines_blackhole_acks', 'comparison', '2cf3a8d0-8ed8-4bc4-8511-6977890773b6') 194 622.27KiB 471.16KiB 15.99KiB 536.56KiB 1.19MiB 1.35MiB 2.09MiB 2.73MiB 1.25051
('http_pipelines_blackhole_acks', 'comparison', 'ae85d82c-bfb8-4ec6-81d2-54ad4ae017e6') 198 620.95KiB 480.67KiB 15.99KiB 521.93KiB 1.31MiB 1.5MiB 1.94MiB 2.02MiB 0.930427
('http_pipelines_blackhole_acks', 'baseline', 'f05c8f4b-a907-4854-8cda-b5c3f50b2724') 198 615.3KiB 444.38KiB 15.99KiB 537.41KiB 1.19MiB 1.48MiB 1.69MiB 2.2MiB 0.899034

Signed-off-by: Jérémie Drouet <jeremie.drouet@datadoghq.com>
@github-actions
Copy link

github-actions bot commented Mar 9, 2022

Soak Test Results

Baseline: 6448a29
Comparison: 85d00cb
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±5%:

Fine details of change detection per experiment.
experiment Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
http_pipelines_no_grok_blackhole 197.89KiB 3.26 100.00% 5.93MiB 588.76KiB 24.04KiB 0 0.0968709 6.12MiB 664.05KiB 27.11KiB 0 0.10581 False False
http_datadog_filter_blackhole 125.04KiB 1.97 99.82% 6.19MiB 647.14KiB 26.29KiB 0 0.10199 6.31MiB 674.32KiB 30.07KiB 0 0.104201 False True
splunk_hec_route_s3 230.6KiB 1.6 89.78% 14.1MiB 2.16MiB 89.45KiB 0 0.153144 14.33MiB 2.15MiB 108.94KiB 0 0.149821 False False
datadog_agent_remap_datadog_logs_acks 773.86KiB 1.15 100.00% 65.43MiB 932.72KiB 37.8KiB 0 0.0139088 66.19MiB 699.61KiB 34.76KiB 0 0.0103092 False False
syslog_loki 118.48KiB 0.93 100.00% 12.49MiB 122.69KiB 4.98KiB 0 0.0095818 12.61MiB 252.4KiB 10.02KiB 0 0.0195319 False False
datadog_agent_remap_blackhole 237.32KiB 0.59 99.36% 39.58MiB 1.04MiB 43.25KiB 0 0.0262429 39.81MiB 1.8MiB 75.31KiB 0 0.0452468 False False
datadog_agent_remap_datadog_logs 382.06KiB 0.57 100.00% 65.4MiB 891.73KiB 36.4KiB 0 0.0133037 65.78MiB 837.18KiB 34.18KiB 0 0.0124189 False False
syslog_humio_logs 34.7KiB 0.21 32.89% 16.13MiB 1.73MiB 80.54KiB 0 0.107044 16.17MiB 333.51KiB 13.48KiB 0 0.0201305 False False
splunk_hec_to_splunk_hec_logs_noack -264.38B -0 1.11% 23.84MiB 320.18KiB 13.07KiB 0 0.0131022 23.84MiB 325.94KiB 13.18KiB 0 0.0133384 False False
fluent_elasticsearch -240.58B -0 6.21% 79.47MiB 51.12KiB 2.07KiB 0 0.000627612 79.47MiB 55.32KiB 2.19KiB 0 0.000679257 False False
fluent_remap_aws_firehose -50.47B -0 1.23% 79.47MiB 56.94KiB 2.31KiB 0 0.000699105 79.47MiB 54.1KiB 2.2KiB 0 0.000664285 False False
splunk_hec_indexer_ack_blackhole -5.21KiB -0.02 22.08% 23.84MiB 315.67KiB 12.89KiB 0 0.0129186 23.84MiB 328.3KiB 13.4KiB 0 0.0134382 False False
http_pipelines_blackhole_acks -923.63B -0.14 2.60% 628.44KiB 467.53KiB 19.28KiB 0 0.743321 627.54KiB 483.18KiB 19.86KiB 0 0.76931 True True
splunk_hec_to_splunk_hec_logs_acks -70.2KiB -0.29 79.81% 23.84MiB 417.57KiB 17.05KiB 0 0.0170874 23.78MiB 1.14MiB 52.24KiB 0 0.0480749 False False
http_to_http_json -117.12KiB -0.55 99.31% 20.69MiB 787.92KiB 32.09KiB 0 0.037153 20.58MiB 718.99KiB 29.06KiB 0 0.0340914 False False
syslog_log2metric_splunk_hec_metrics -128.33KiB -0.76 100.00% 16.48MiB 316.72KiB 12.93KiB 0 0.0187531 16.35MiB 332.35KiB 13.57KiB 0 0.0198296 False False
http_to_http_acks -155.06KiB -0.86 15.49% 17.54MiB 7.63MiB 319.07KiB 0 0.434858 17.39MiB 7.92MiB 725.12KiB 0 0.453568 True True
http_pipelines_blackhole -5.77KiB -0.9 17.71% 640.06KiB 444.32KiB 18.5KiB 0 0.693583 634.29KiB 435.69KiB 17.98KiB 0 0.686312 True True
syslog_regex_logs2metric_ddmetrics -118.66KiB -0.99 95.62% 11.75MiB 1.25MiB 58.55KiB 0 0.106409 11.63MiB 104.03KiB 4.25KiB 0 0.00872663 False False
datadog_agent_remap_blackhole_acks -476.19KiB -1.17 99.99% 39.77MiB 854.9KiB 34.61KiB 0 0.0209745 39.31MiB 2.84MiB 115.86KiB 0 0.0722512 False False
syslog_splunk_hec_logs -193.47KiB -1.18 100.00% 15.98MiB 249.98KiB 10.1KiB 0 0.0152643 15.79MiB 271.31KiB 11.08KiB 0 0.0167649 False False
socket_to_socket_blackhole -390.15KiB -1.53 98.84% 24.92MiB 2.64MiB 123.17KiB 0 0.10584 24.54MiB 1.99MiB 92.78KiB 0 0.0810445 False False
splunk_transforms_splunk3 -217.62KiB -2.22 93.41% 9.59MiB 1.83MiB 76.04KiB 0 0.191002 9.37MiB 1.78MiB 90.49KiB 0 0.189245 False False
syslog_log2metric_humio_metrics -348.44KiB -2.56 100.00% 13.28MiB 265.92KiB 10.31KiB 0 0.0195361 12.94MiB 198.2KiB 8.09KiB 0 0.0149426 False False
Fine details of each soak run.
(experiment, variant, run_id) total samples mean std min median p90 p95 p99 max skewness
('fluent_remap_aws_firehose', 'baseline', '903c1db8-5e3b-434d-bbc2-9f85906c8cc6') 202 79.47MiB 59.53KiB 79.34MiB 79.47MiB 79.55MiB 79.57MiB 79.59MiB 79.76MiB 0.624172
('fluent_elasticsearch', 'comparison', 'de15fad3-4851-4586-bcbe-bf5ee5515820') 228 79.47MiB 56.4KiB 79.33MiB 79.47MiB 79.55MiB 79.56MiB 79.58MiB 79.62MiB -0.0266232
('fluent_remap_aws_firehose', 'comparison', '0bd52a9e-5a99-4c3b-ad71-99a3668c1286') 202 79.47MiB 55.74KiB 79.33MiB 79.47MiB 79.54MiB 79.56MiB 79.6MiB 79.62MiB 0.0549219
('fluent_elasticsearch', 'baseline', '125eca1d-bac5-444d-aa60-f5608c9745c2') 204 79.47MiB 51.68KiB 79.34MiB 79.47MiB 79.54MiB 79.56MiB 79.6MiB 79.62MiB 0.180314
('fluent_elasticsearch', 'baseline', 'fd8a7ad2-503b-4403-8b28-b63093e51933') 204 79.47MiB 53.23KiB 79.33MiB 79.47MiB 79.55MiB 79.56MiB 79.58MiB 79.6MiB 0.0486689
('fluent_remap_aws_firehose', 'comparison', '85a5034c-384d-469a-9c1b-cbc13dae181b') 202 79.47MiB 56.74KiB 79.33MiB 79.47MiB 79.55MiB 79.57MiB 79.58MiB 79.61MiB 0.0205754
('fluent_elasticsearch', 'baseline', '13bf8ecc-f7d9-4fd5-b7e5-1f0cb42ffdf1') 204 79.47MiB 48.59KiB 79.37MiB 79.47MiB 79.54MiB 79.55MiB 79.59MiB 79.6MiB 0.239305
('fluent_remap_aws_firehose', 'baseline', '353964c3-1399-4180-9466-aa51cde3620f') 203 79.47MiB 56.98KiB 79.36MiB 79.47MiB 79.56MiB 79.57MiB 79.58MiB 79.59MiB 0.0729462
('fluent_elasticsearch', 'comparison', 'd3c366da-3d1b-4623-b998-4646afd3bc9c') 204 79.47MiB 52.09KiB 79.36MiB 79.47MiB 79.54MiB 79.56MiB 79.58MiB 79.6MiB 0.12073
('fluent_elasticsearch', 'comparison', 'b3b67a55-7d30-4972-94b6-617bac9b0753') 204 79.47MiB 57.47KiB 79.36MiB 79.47MiB 79.55MiB 79.57MiB 79.59MiB 79.61MiB 0.062563
('fluent_remap_aws_firehose', 'comparison', 'bf35bb28-73ea-455f-8347-71af3730f507') 202 79.47MiB 49.84KiB 79.35MiB 79.47MiB 79.54MiB 79.56MiB 79.59MiB 79.6MiB 0.10625
('fluent_remap_aws_firehose', 'baseline', '30ab6135-0de6-4620-be20-b32f25b9b850') 203 79.47MiB 54.48KiB 79.34MiB 79.47MiB 79.54MiB 79.56MiB 79.59MiB 79.63MiB 0.0890484
('datadog_agent_remap_datadog_logs_acks', 'baseline', '5e90006f-f102-4e7c-b817-3856ba876a24') 203 66.41MiB 381.51KiB 65.65MiB 66.37MiB 66.78MiB 67.23MiB 67.72MiB 67.86MiB 1.38031
('datadog_agent_remap_datadog_logs', 'baseline', '9d87c4ff-4d22-4e1f-b23a-0b26217da0a7') 200 66.35MiB 616.24KiB 65.63MiB 66.21MiB 66.61MiB 67.51MiB 68.93MiB 69.11MiB 3.12367
('datadog_agent_remap_datadog_logs_acks', 'comparison', '3a9b39b7-7382-481e-b65b-8d0b6143e5df') 202 66.23MiB 787.2KiB 65.2MiB 65.99MiB 67.79MiB 68.01MiB 68.54MiB 68.69MiB 1.73629
('datadog_agent_remap_datadog_logs_acks', 'comparison', 'fa287e5d-2813-496f-aaee-1713ddabdd11') 203 66.15MiB 598.83KiB 65.13MiB 66.0MiB 67.23MiB 67.47MiB 67.92MiB 68.04MiB 1.54823
('datadog_agent_remap_datadog_logs', 'comparison', '7ed6a187-80b9-4ffe-b092-d45cd936c0f1') 200 66.08MiB 532.49KiB 65.51MiB 65.98MiB 66.42MiB 66.95MiB 68.53MiB 68.92MiB 3.22173
('datadog_agent_remap_datadog_logs', 'comparison', 'f43f2bc7-2b9d-460c-8509-b2ac70e06ca2') 200 65.82MiB 1.04MiB 64.89MiB 65.47MiB 68.3MiB 68.56MiB 68.9MiB 69.13MiB 2.13114
('datadog_agent_remap_datadog_logs', 'comparison', '7fac3b1c-c0e6-483f-9307-e14d8d1cb1b3') 200 65.43MiB 674.65KiB 63.77MiB 65.35MiB 65.82MiB 66.71MiB 68.14MiB 68.69MiB 2.07058
('datadog_agent_remap_datadog_logs', 'baseline', 'd2d5bbc9-2ce2-41f8-a27d-a86e3e84d627') 200 65.31MiB 405.11KiB 64.71MiB 65.26MiB 65.64MiB 66.0MiB 67.01MiB 67.18MiB 2.20061
('datadog_agent_remap_datadog_logs_acks', 'baseline', '02a289f9-802d-4aaa-aa55-3bb510c9e6ee') 203 65.17MiB 830.22KiB 57.88MiB 65.09MiB 65.49MiB 66.43MiB 68.04MiB 68.06MiB -2.24135
('datadog_agent_remap_datadog_logs_acks', 'baseline', '5c07571a-1fc4-4cc1-b0c7-1f62b7d73b4c') 203 64.72MiB 407.75KiB 63.85MiB 64.68MiB 64.98MiB 65.12MiB 67.11MiB 67.28MiB 3.72262
('datadog_agent_remap_datadog_logs', 'baseline', 'a76e273c-c7fa-45de-ba79-0355b9efa81a') 200 64.55MiB 349.56KiB 63.94MiB 64.5MiB 64.93MiB 65.3MiB 65.57MiB 65.62MiB 1.13677
('datadog_agent_remap_blackhole', 'baseline', 'fc0515b1-fd25-45f7-b04d-9d7f923e6450') 202 40.52MiB 472.21KiB 39.51MiB 40.52MiB 41.03MiB 41.1MiB 41.71MiB 43.24MiB 1.08439
('datadog_agent_remap_blackhole', 'comparison', 'ef217de8-b18d-4869-aa58-14e355b8c201') 199 40.4MiB 2.91MiB 8.62MiB 40.7MiB 41.34MiB 41.56MiB 41.74MiB 42.33MiB -9.01612
('datadog_agent_remap_blackhole_acks', 'baseline', '5f871500-95cb-49d4-b5c6-6e1ff4731316') 200 40.37MiB 447.18KiB 39.27MiB 40.33MiB 40.92MiB 41.08MiB 41.41MiB 42.2MiB 0.589409
('datadog_agent_remap_blackhole_acks', 'baseline', '8fa5a711-dad8-411f-ad45-53d22d32a011') 205 40.12MiB 535.79KiB 36.41MiB 40.11MiB 40.65MiB 40.82MiB 41.87MiB 42.19MiB -0.922163
('datadog_agent_remap_blackhole_acks', 'comparison', '9ac6619f-c021-4057-a493-0471aa784364') 233 40.02MiB 2.15MiB 18.19MiB 40.13MiB 41.35MiB 41.67MiB 42.0MiB 42.47MiB -8.95967
('datadog_agent_remap_blackhole', 'baseline', 'f4739092-06a8-4dd7-a567-212bda629fac') 202 39.94MiB 390.93KiB 38.93MiB 39.94MiB 40.43MiB 40.53MiB 40.74MiB 40.78MiB -0.0846837
('datadog_agent_remap_blackhole', 'comparison', '1dad811d-4094-4108-8027-8c329294878d') 201 39.88MiB 615.67KiB 37.79MiB 39.94MiB 40.58MiB 40.76MiB 41.08MiB 41.39MiB -0.441782
('datadog_agent_remap_blackhole_acks', 'comparison', '5b20db1e-5f69-4637-9528-763b1af78ef9') 200 39.55MiB 475.84KiB 38.41MiB 39.52MiB 40.12MiB 40.24MiB 40.83MiB 41.76MiB 0.742177
('datadog_agent_remap_blackhole', 'comparison', '701c8913-fbd3-4a65-beb7-4292374e62c1') 201 39.17MiB 483.94KiB 38.01MiB 39.14MiB 39.81MiB 39.93MiB 40.48MiB 40.62MiB 0.365577
('datadog_agent_remap_blackhole_acks', 'baseline', '03f06e8b-6867-48fa-81e3-49f44fc03148') 205 38.83MiB 515.49KiB 37.35MiB 38.85MiB 39.39MiB 39.52MiB 40.06MiB 40.6MiB -0.00792363
('datadog_agent_remap_blackhole', 'baseline', '65e75ad2-c653-4c04-b9af-381b9cc5867c') 202 38.29MiB 448.33KiB 37.28MiB 38.24MiB 38.86MiB 39.06MiB 39.37MiB 39.51MiB 0.304118
('datadog_agent_remap_blackhole_acks', 'comparison', '6c657b39-4759-4338-ab3a-174c72bd5777') 198 38.23MiB 4.28MiB 172.05KiB 38.8MiB 39.46MiB 39.63MiB 39.92MiB 40.25MiB -7.62603
('socket_to_socket_blackhole', 'baseline', '1cd6dd9b-bd12-4e5d-bee7-543d721cd5ac') 202 25.52MiB 115.8KiB 25.17MiB 25.53MiB 25.65MiB 25.68MiB 25.82MiB 25.87MiB -0.147156
('socket_to_socket_blackhole', 'baseline', '455e9176-58bb-404a-8b27-c783d1ec8062') 202 24.76MiB 92.98KiB 24.57MiB 24.76MiB 24.88MiB 24.97MiB 25.02MiB 25.14MiB 1.05849
('socket_to_socket_blackhole', 'comparison', '23a16d9a-fdd0-4791-8055-d85f249cc767') 202 24.73MiB 117.25KiB 24.5MiB 24.7MiB 24.89MiB 24.93MiB 24.98MiB 24.99MiB 0.443335
('socket_to_socket_blackhole', 'comparison', '0e9e32e7-7d63-448e-ab53-ba71fc64e81a') 202 24.58MiB 76.46KiB 24.3MiB 24.58MiB 24.66MiB 24.68MiB 24.77MiB 24.83MiB -0.191108
('socket_to_socket_blackhole', 'comparison', 'a083a57b-cdb7-475d-93ab-cc87db763913') 79 23.98MiB 4.9MiB 50.08KiB 25.05MiB 25.15MiB 25.2MiB 25.26MiB 25.36MiB -4.53621
('splunk_hec_to_splunk_hec_logs_noack', 'baseline', 'db9423b2-38b0-4618-9621-15dbba661237') 200 23.85MiB 319.33KiB 23.06MiB 23.85MiB 24.21MiB 24.36MiB 24.46MiB 24.6MiB -0.158321
('splunk_hec_to_splunk_hec_logs_acks', 'baseline', 'f7c0490b-3c9e-4a21-b127-ccbc7699ea88') 200 23.85MiB 551.61KiB 21.8MiB 23.85MiB 24.34MiB 24.6MiB 25.58MiB 25.95MiB -0.114762
('splunk_hec_to_splunk_hec_logs_noack', 'baseline', '271ad08d-7a0b-4605-a23d-eeed41d49f6f') 200 23.85MiB 330.89KiB 23.06MiB 23.85MiB 24.24MiB 24.35MiB 24.51MiB 24.6MiB -0.181135
('splunk_hec_to_splunk_hec_logs_noack', 'comparison', '1d743454-e1a7-4c2e-b85b-07d827ef3e1f') 204 23.85MiB 326.4KiB 23.06MiB 23.87MiB 24.27MiB 24.37MiB 24.49MiB 24.6MiB -0.0886106
('splunk_hec_to_splunk_hec_logs_acks', 'baseline', '23c61d6d-d4ac-4a72-b693-b024b0dbc450') 200 23.85MiB 311.9KiB 22.94MiB 23.84MiB 24.22MiB 24.35MiB 24.48MiB 24.61MiB -0.176059
('splunk_hec_indexer_ack_blackhole', 'baseline', 'ed066b76-8ee0-4c15-95db-abfeeaeee1d3') 200 23.84MiB 310.37KiB 23.24MiB 23.87MiB 24.24MiB 24.31MiB 24.48MiB 24.64MiB -0.0635816
('splunk_hec_to_splunk_hec_logs_acks', 'comparison', 'a9080d8c-5e29-4223-8fb0-f3a48ba353a9') 203 23.84MiB 323.15KiB 23.02MiB 23.84MiB 24.27MiB 24.34MiB 24.51MiB 24.58MiB -0.125426
('splunk_hec_to_splunk_hec_logs_noack', 'comparison', '94f26d41-9cef-4a2a-a526-9974894cc7f5') 204 23.84MiB 322.47KiB 23.06MiB 23.86MiB 24.24MiB 24.35MiB 24.48MiB 24.6MiB -0.0746609
('splunk_hec_indexer_ack_blackhole', 'baseline', '6e070075-db95-417b-a196-f35e5eab508e') 200 23.84MiB 319.59KiB 23.06MiB 23.85MiB 24.24MiB 24.33MiB 24.45MiB 24.64MiB -0.0802497
('splunk_hec_to_splunk_hec_logs_noack', 'comparison', '031b7852-f66f-4b91-86e4-4e348d3e999a') 204 23.84MiB 330.49KiB 23.06MiB 23.86MiB 24.24MiB 24.37MiB 24.51MiB 24.6MiB -0.135921
('splunk_hec_indexer_ack_blackhole', 'baseline', '49001cda-abc2-42ae-a1c6-f9bed3bb2d5b') 200 23.84MiB 318.56KiB 23.14MiB 23.86MiB 24.22MiB 24.31MiB 24.48MiB 24.6MiB -0.15534
('splunk_hec_to_splunk_hec_logs_acks', 'baseline', 'fb910ef7-d96b-47cd-b974-5a829cc73db4') 200 23.84MiB 351.1KiB 22.66MiB 23.84MiB 24.27MiB 24.42MiB 24.58MiB 24.93MiB 0.00801239
('splunk_hec_indexer_ack_blackhole', 'comparison', '35dd30ec-0f1c-48bb-87bd-25852f9cd7d5') 200 23.84MiB 318.89KiB 22.97MiB 23.86MiB 24.23MiB 24.31MiB 24.45MiB 24.51MiB -0.25098
('splunk_hec_indexer_ack_blackhole', 'comparison', '792ba642-fa67-4b97-acbb-ed530fd0b840') 200 23.84MiB 340.63KiB 22.97MiB 23.87MiB 24.23MiB 24.31MiB 24.48MiB 24.64MiB -0.238433
('splunk_hec_indexer_ack_blackhole', 'comparison', '33da44d0-1b5a-46fd-82ae-4a426d3ece7c') 200 23.84MiB 326.66KiB 22.79MiB 23.85MiB 24.23MiB 24.28MiB 24.49MiB 24.6MiB -0.313863
('splunk_hec_to_splunk_hec_logs_noack', 'baseline', '9621b498-6f4a-444f-8d6c-b1b3c956ccfc') 200 23.84MiB 311.49KiB 23.06MiB 23.84MiB 24.23MiB 24.32MiB 24.52MiB 24.6MiB -0.065097
('splunk_hec_to_splunk_hec_logs_acks', 'comparison', '38df4b42-6586-4e0c-9368-dc93f7080bd0') 203 23.84MiB 330.81KiB 23.06MiB 23.84MiB 24.27MiB 24.39MiB 24.45MiB 24.6MiB 0.018881
('socket_to_socket_blackhole', 'baseline', 'd9a5b0ae-a8f3-43be-ab4d-2b2dbf2c1339') 78 23.79MiB 6.42MiB 12.37KiB 25.57MiB 25.68MiB 25.7MiB 25.84MiB 25.97MiB -3.41888
('splunk_hec_to_splunk_hec_logs_acks', 'comparison', '85258041-65dd-42aa-b7d4-2c211822b4de') 97 23.51MiB 2.52MiB 1.61MiB 23.84MiB 24.29MiB 24.37MiB 24.62MiB 24.81MiB -7.73809
('http_to_http_json', 'baseline', '4e4e0200-cb45-44bf-a479-d7df6df32be8') 201 20.95MiB 745.77KiB 18.68MiB 20.94MiB 21.81MiB 22.04MiB 22.82MiB 22.83MiB -0.127269
('http_to_http_json', 'comparison', '20a31a1a-a084-406e-9ce1-4c13e61d1387') 204 20.82MiB 645.4KiB 19.05MiB 20.8MiB 21.6MiB 21.85MiB 22.27MiB 22.35MiB -0.0196459
('http_to_http_json', 'comparison', 'b7e411f2-3fcf-4605-a8d7-9f8de2d32a88') 204 20.67MiB 717.23KiB 18.32MiB 20.68MiB 21.7MiB 21.89MiB 22.03MiB 22.09MiB -0.100481
('http_to_http_json', 'baseline', '916a3260-0e94-4615-be82-51092c59dcdb') 201 20.63MiB 833.24KiB 18.99MiB 20.55MiB 21.61MiB 21.89MiB 22.67MiB 23.92MiB 0.477611
('http_to_http_json', 'baseline', '7bd64110-8786-4ef4-8252-c2ba621a07ec') 201 20.5MiB 710.69KiB 18.93MiB 20.49MiB 21.46MiB 21.73MiB 22.22MiB 22.7MiB 0.327667
('http_to_http_json', 'comparison', '83c9a136-93c9-4473-b40b-f0d974efc1b6') 204 20.25MiB 662.2KiB 18.48MiB 20.18MiB 21.08MiB 21.31MiB 21.99MiB 22.31MiB 0.362872
('http_to_http_acks', 'comparison', '056e8fde-7c00-4ea1-8eaf-945c77a8dee4') 6 19.95MiB 10.38MiB 655.74KiB 21.32MiB 28.71MiB 29.6MiB 30.31MiB 30.49MiB -1.52142
('http_to_http_acks', 'baseline', 'bd36898a-1c32-4235-a893-e4a526c27e8a') 200 18.07MiB 7.46MiB 2.31MiB 18.79MiB 29.35MiB 30.49MiB 30.74MiB 30.75MiB -0.034012
('http_to_http_acks', 'baseline', 'e08f4ad4-97e8-4c5c-a683-c2436d7156cb') 200 17.39MiB 8.11MiB 2.31MiB 18.76MiB 26.96MiB 29.69MiB 30.72MiB 30.81MiB -0.228259
('http_to_http_acks', 'comparison', 'ff61ca35-f791-4205-a5b8-2c91c4c485e1') 113 17.26MiB 7.64MiB 869.11KiB 17.86MiB 28.37MiB 30.49MiB 30.75MiB 31.68MiB 0.0670153
('http_to_http_acks', 'comparison', '756ae4b7-efc8-4f09-91ac-3677d4392445') 6 17.19MiB 11.5MiB 944.99KiB 20.52MiB 27.81MiB 28.73MiB 29.45MiB 29.64MiB -0.620098
('http_to_http_acks', 'baseline', '4e1aeb6a-f714-4cec-8ff5-cee2faa0eec2') 200 17.15MiB 7.31MiB 2.41MiB 17.63MiB 27.15MiB 30.51MiB 30.75MiB 30.81MiB 0.024506
('syslog_log2metric_splunk_hec_metrics', 'baseline', '434a0c40-2e42-4dfb-9a50-90d352fe7b9a') 200 16.9MiB 82.54KiB 16.78MiB 16.88MiB 16.98MiB 17.11MiB 17.15MiB 17.2MiB 1.67591
('syslog_log2metric_splunk_hec_metrics', 'comparison', 'a6c69c97-0905-4bdd-8810-b2d670271cf7') 200 16.79MiB 39.12KiB 16.69MiB 16.79MiB 16.84MiB 16.85MiB 16.89MiB 16.92MiB 0.367999
('syslog_humio_logs', 'comparison', '4340bb79-4cb0-48d3-9116-a24b2b160762') 204 16.36MiB 365.88KiB 14.65MiB 16.44MiB 16.48MiB 16.5MiB 16.52MiB 16.54MiB -4.20718
('syslog_humio_logs', 'baseline', 'dea7b7fe-3041-4e81-9f6a-729f504db00f') 202 16.33MiB 204.16KiB 16.14MiB 16.24MiB 16.69MiB 16.74MiB 16.81MiB 16.86MiB 1.3211
('syslog_humio_logs', 'comparison', '544a9f4a-9130-4a12-8602-67f848413bd7') 204 16.32MiB 88.69KiB 16.09MiB 16.31MiB 16.37MiB 16.5MiB 16.69MiB 16.73MiB 2.39944
('syslog_humio_logs', 'baseline', 'b4e203bf-3e3a-462a-8db3-8e539f094284') 202 16.28MiB 252.51KiB 16.03MiB 16.14MiB 16.68MiB 16.76MiB 16.85MiB 16.86MiB 0.990913
('syslog_log2metric_splunk_hec_metrics', 'baseline', '0b4e3988-1ce3-4a4c-beb1-8e48c0418314') 200 16.27MiB 105.23KiB 16.11MiB 16.25MiB 16.33MiB 16.54MiB 16.67MiB 16.71MiB 2.69854
('syslog_log2metric_splunk_hec_metrics', 'baseline', '8d56cb5c-5d94-42ec-8976-3fa4e020eeb5') 200 16.26MiB 46.98KiB 16.11MiB 16.26MiB 16.32MiB 16.34MiB 16.36MiB 16.37MiB -0.186873
('syslog_splunk_hec_logs', 'baseline', '4eed1ab4-3cfa-4973-bc3d-aa4957894ba2') 204 16.22MiB 49.3KiB 16.03MiB 16.22MiB 16.27MiB 16.31MiB 16.34MiB 16.4MiB 0.151217
('syslog_log2metric_splunk_hec_metrics', 'comparison', 'f38afd3b-20cb-4988-8768-bc508fced1e0') 200 16.15MiB 41.7KiB 16.02MiB 16.15MiB 16.2MiB 16.21MiB 16.23MiB 16.24MiB -0.268263
('syslog_splunk_hec_logs', 'comparison', 'a3e1fd56-fb02-4ae6-906e-b27765278be3') 200 16.14MiB 51.81KiB 16.0MiB 16.14MiB 16.21MiB 16.22MiB 16.25MiB 16.28MiB -0.0818475
('syslog_log2metric_splunk_hec_metrics', 'comparison', 'b90a1ccb-de0d-43cf-ac9b-fee289cf7822') 200 16.12MiB 167.76KiB 15.92MiB 16.08MiB 16.15MiB 16.69MiB 16.73MiB 16.76MiB 3.13551
('syslog_splunk_hec_logs', 'baseline', 'ba226c9a-300f-4d3e-889c-d18cf34cc2c6') 204 16.06MiB 37.67KiB 15.96MiB 16.06MiB 16.11MiB 16.12MiB 16.13MiB 16.16MiB -0.192951
('syslog_humio_logs', 'comparison', '2b453db2-de64-4e65-8da0-ca3c528e2c18') 204 15.82MiB 42.08KiB 15.71MiB 15.82MiB 15.87MiB 15.89MiB 15.91MiB 15.93MiB -0.0341927
('syslog_splunk_hec_logs', 'comparison', 'd3cfc6b1-f386-4005-ac9d-f26e2cdfe9a2') 200 15.71MiB 50.04KiB 15.59MiB 15.7MiB 15.75MiB 15.77MiB 15.87MiB 16.0MiB 2.23402
('syslog_splunk_hec_logs', 'baseline', '57225bde-4817-428d-af9f-bebdfb70ea3b') 204 15.65MiB 45.42KiB 15.57MiB 15.65MiB 15.7MiB 15.72MiB 15.79MiB 15.87MiB 1.07139
('syslog_splunk_hec_logs', 'comparison', '9a72447e-5ffc-42f7-a8e2-f099516b6553') 200 15.52MiB 64.12KiB 15.39MiB 15.51MiB 15.61MiB 15.64MiB 15.69MiB 15.78MiB 0.977044
('syslog_humio_logs', 'baseline', 'b4bb287f-8bbe-4038-87d1-2a1c1fb6fc81') 79 15.25MiB 4.15MiB 13.83KiB 16.47MiB 16.68MiB 16.73MiB 16.81MiB 16.83MiB -3.34172
('splunk_hec_route_s3', 'comparison', '9413afac-5289-41c5-97c3-a4dad7ca9c85') 204 14.36MiB 2.07MiB 9.76MiB 14.34MiB 17.0MiB 17.82MiB 18.72MiB 19.89MiB -0.00609415
('splunk_hec_route_s3', 'comparison', 'ae9356b7-8d18-48f4-9914-1242736973af') 204 14.29MiB 2.23MiB 8.95MiB 14.31MiB 17.33MiB 17.68MiB 18.49MiB 19.28MiB -0.0397099
('splunk_hec_route_s3', 'baseline', '20a4c19c-5346-44c9-8993-223645bf25aa') 204 14.18MiB 2.18MiB 9.62MiB 14.18MiB 16.87MiB 17.68MiB 18.55MiB 19.46MiB 0.0239075
('splunk_hec_route_s3', 'baseline', 'c921d55f-067b-467e-bf7d-45e787691b9a') 204 14.1MiB 2.1MiB 9.71MiB 14.2MiB 16.95MiB 17.6MiB 18.27MiB 19.17MiB 0.0327649
('splunk_hec_route_s3', 'baseline', '24ee9ebc-64b2-44a3-9625-303fbc2448c8') 204 14.02MiB 2.21MiB 9.61MiB 13.92MiB 17.13MiB 17.38MiB 18.25MiB 18.28MiB -0.0268901
('syslog_log2metric_humio_metrics', 'baseline', '81bc569e-d34c-4079-9d23-d9034bdf8a61') 232 13.41MiB 257.98KiB 13.09MiB 13.32MiB 13.89MiB 14.0MiB 14.12MiB 14.18MiB 1.57645
('syslog_log2metric_humio_metrics', 'baseline', '7f391576-30de-4b90-8bca-75d80a96ca21') 202 13.24MiB 118.82KiB 12.95MiB 13.23MiB 13.36MiB 13.51MiB 13.61MiB 13.7MiB 1.1263
('syslog_log2metric_humio_metrics', 'baseline', 'accd9734-d699-4051-b4ff-e0b5e0c29127') 231 13.19MiB 311.22KiB 12.89MiB 13.07MiB 13.8MiB 13.9MiB 14.01MiB 14.13MiB 1.64093
('syslog_log2metric_humio_metrics', 'comparison', '050317a7-e798-4e4b-9727-722444fcb237') 200 13.16MiB 104.82KiB 12.92MiB 13.15MiB 13.28MiB 13.32MiB 13.47MiB 13.55MiB 0.820637
('syslog_log2metric_humio_metrics', 'comparison', '296cadb9-f018-4f0e-b00f-153c864bd288') 200 12.93MiB 75.62KiB 12.76MiB 12.93MiB 13.03MiB 13.05MiB 13.08MiB 13.12MiB 0.0130275
('syslog_loki', 'comparison', '9baafaca-9170-4c4b-b661-014abf2aa84a') 200 12.76MiB 140.83KiB 12.35MiB 12.81MiB 12.87MiB 12.89MiB 12.91MiB 12.94MiB -1.6994
('syslog_log2metric_humio_metrics', 'comparison', '6f03a470-0bf5-416e-aade-28f598386380') 200 12.74MiB 87.77KiB 12.49MiB 12.74MiB 12.85MiB 12.89MiB 12.91MiB 12.93MiB -0.0954152
('syslog_loki', 'comparison', 'ab48a664-2434-4093-94be-e4be09ee3e58') 235 12.73MiB 109.83KiB 12.08MiB 12.74MiB 12.8MiB 12.81MiB 12.85MiB 12.91MiB -3.89436
('syslog_loki', 'baseline', 'b8220fc9-4785-4a2a-b63b-a4a16ed224e6') 202 12.61MiB 97.56KiB 12.04MiB 12.62MiB 12.68MiB 12.7MiB 12.74MiB 12.76MiB -3.44713
('syslog_loki', 'baseline', '4e157266-ca6d-4695-8f19-82406db5a958') 202 12.45MiB 107.33KiB 11.59MiB 12.47MiB 12.53MiB 12.54MiB 12.57MiB 12.58MiB -4.67505
('syslog_loki', 'baseline', '0c064c48-203f-4aff-b3ab-1ea436067521') 202 12.42MiB 48.6KiB 12.3MiB 12.41MiB 12.48MiB 12.5MiB 12.52MiB 12.54MiB 0.13959
('syslog_loki', 'comparison', '05de691c-e100-4e08-b5ea-ac7d64c48de3') 200 12.32MiB 193.25KiB 12.08MiB 12.23MiB 12.65MiB 12.7MiB 12.74MiB 12.75MiB 1.11653
('syslog_regex_logs2metric_ddmetrics', 'baseline', 'd6b00ca9-5b8d-4d0f-b07a-6bb62ba406d8') 79 11.76MiB 3.09MiB 37.23KiB 12.72MiB 12.96MiB 13.01MiB 13.17MiB 13.18MiB -3.41659
('syslog_regex_logs2metric_ddmetrics', 'baseline', '502fad2a-a10f-4f54-bd29-ce782237fc9b') 200 11.75MiB 67.08KiB 11.64MiB 11.75MiB 11.83MiB 11.86MiB 11.94MiB 11.97MiB 0.600957
('syslog_regex_logs2metric_ddmetrics', 'baseline', '6eb1dc65-9660-4803-bb07-8c19a99f09a3') 200 11.74MiB 70.14KiB 11.61MiB 11.73MiB 11.8MiB 11.85MiB 12.01MiB 12.08MiB 1.55405
('syslog_regex_logs2metric_ddmetrics', 'comparison', '9382965c-2826-4c52-9e89-450da570bbf3') 200 11.73MiB 51.21KiB 11.64MiB 11.74MiB 11.8MiB 11.81MiB 11.85MiB 11.88MiB 0.164898
('syslog_regex_logs2metric_ddmetrics', 'comparison', '64468b35-ea8a-4102-860f-0f0ad07f1428') 200 11.59MiB 83.25KiB 11.46MiB 11.57MiB 11.69MiB 11.7MiB 11.84MiB 11.98MiB 1.35683
('syslog_regex_logs2metric_ddmetrics', 'comparison', '81f9f997-a44e-4289-87c8-39a6c429ca9e') 200 11.57MiB 80.72KiB 11.41MiB 11.56MiB 11.69MiB 11.7MiB 11.73MiB 11.73MiB 0.257717
('splunk_transforms_splunk3', 'baseline', '788836c5-c361-4a74-b3c3-a8e352948b06') 203 9.63MiB 1.8MiB 5.11MiB 9.77MiB 11.82MiB 12.26MiB 13.22MiB 14.35MiB -0.0983235
('splunk_transforms_splunk3', 'baseline', '81c11e03-8756-4f50-8cc8-efc62351b18e') 203 9.62MiB 1.86MiB 5.57MiB 9.43MiB 12.0MiB 12.49MiB 13.47MiB 14.42MiB 0.0966217
('splunk_transforms_splunk3', 'comparison', '548f97ef-517a-46a7-bf5e-b88668afc573') 202 9.51MiB 1.8MiB 5.66MiB 9.65MiB 11.77MiB 12.33MiB 12.99MiB 13.45MiB -0.104448
('splunk_transforms_splunk3', 'baseline', '97e1faea-a1bc-4ca3-b9ca-b07cef33cd93') 203 9.51MiB 1.85MiB 5.51MiB 9.51MiB 11.82MiB 12.33MiB 13.1MiB 15.67MiB 0.0788707
('splunk_transforms_splunk3', 'comparison', '47f74417-9f59-4f8d-8e43-49bf2f3e1c99') 202 9.23MiB 1.74MiB 5.63MiB 9.28MiB 11.69MiB 12.1MiB 12.62MiB 13.08MiB 0.0518192
('http_datadog_filter_blackhole', 'comparison', 'c76fef96-beca-4ebe-88ef-70239f554248') 201 6.35MiB 665.64KiB 4.92MiB 6.2MiB 7.25MiB 7.4MiB 8.0MiB 9.14MiB 0.753296
('http_datadog_filter_blackhole', 'comparison', '10ab66e2-e260-450f-8b26-f267867e111e') 101 6.31MiB 771.97KiB 3.5MiB 6.28MiB 7.34MiB 7.65MiB 7.8MiB 7.97MiB -0.168336
('http_datadog_filter_blackhole', 'comparison', 'f423b627-dc16-49b4-baee-3f056e070a5a') 201 6.28MiB 630.39KiB 4.86MiB 6.2MiB 7.05MiB 7.24MiB 7.73MiB 8.07MiB 0.198333
('http_datadog_filter_blackhole', 'baseline', '92530aae-4a96-4a96-ae5e-7f9f6048f2c3') 202 6.22MiB 636.99KiB 4.92MiB 6.08MiB 7.1MiB 7.39MiB 7.61MiB 7.85MiB 0.428556
('http_pipelines_no_grok_blackhole', 'comparison', '1fce91cd-4ff1-4d17-8c59-8228fdb8b5c2') 200 6.2MiB 664.29KiB 4.64MiB 6.13MiB 7.07MiB 7.37MiB 7.88MiB 8.57MiB 0.521592
('http_datadog_filter_blackhole', 'baseline', 'f68649d2-d3fd-4e8d-beeb-d44087b4ff81') 202 6.18MiB 656.11KiB 4.33MiB 6.09MiB 7.05MiB 7.31MiB 7.7MiB 8.06MiB 0.323756
('http_datadog_filter_blackhole', 'baseline', 'fcbbab22-6d87-42d0-bbc4-255fb382c9be') 202 6.17MiB 650.22KiB 4.26MiB 6.13MiB 7.04MiB 7.22MiB 7.58MiB 8.18MiB 0.181143
('http_pipelines_no_grok_blackhole', 'comparison', 'ff0cee76-d4da-4ad5-a0c0-dc42ba487f7a') 200 6.14MiB 674.31KiB 4.71MiB 6.1MiB 7.01MiB 7.25MiB 7.63MiB 7.94MiB 0.188995
('http_pipelines_no_grok_blackhole', 'comparison', '3eb2d8f2-35f4-4c9c-a245-1e5359f5aea9') 200 6.03MiB 644.21KiB 4.62MiB 5.96MiB 6.95MiB 7.17MiB 7.33MiB 7.82MiB 0.26168
('http_pipelines_no_grok_blackhole', 'baseline', '17cde918-56b7-4385-abb6-a70a2f587cea') 200 5.94MiB 640.1KiB 4.56MiB 5.9MiB 6.87MiB 7.01MiB 7.22MiB 7.45MiB 0.299799
('http_pipelines_no_grok_blackhole', 'baseline', 'd5077bda-3c4f-43c1-b13e-d1010f5ae837') 200 5.93MiB 568.51KiB 4.61MiB 5.88MiB 6.65MiB 6.9MiB 7.23MiB 7.69MiB 0.365359
('http_pipelines_no_grok_blackhole', 'baseline', 'b419fa9f-d4d8-423b-9976-298fa5792a7c') 200 5.92MiB 557.04KiB 4.76MiB 5.92MiB 6.62MiB 6.86MiB 7.04MiB 7.58MiB 0.213447
('http_pipelines_blackhole', 'baseline', '38050722-f5c7-4af8-931f-a1006e2ab289') 191 644.5KiB 443.47KiB 31.98KiB 601.96KiB 1.21MiB 1.48MiB 1.85MiB 1.95MiB 0.987478
('http_pipelines_blackhole', 'comparison', '56b70cb9-6a4d-4397-88d6-9702ccba07cf') 193 641.07KiB 424.94KiB 30.89KiB 583.25KiB 1.21MiB 1.46MiB 1.71MiB 1.84MiB 0.729229
('http_pipelines_blackhole_acks', 'comparison', '99b59798-4ba3-41f7-8943-c010761e1bb3') 194 639.64KiB 538.6KiB 15.99KiB 493.55KiB 1.3MiB 1.62MiB 2.3MiB 3.21MiB 1.6565
('http_pipelines_blackhole', 'baseline', 'db56e94b-5318-4810-b845-0b963a49ccb6') 192 639.32KiB 442.1KiB 15.99KiB 582.41KiB 1.19MiB 1.37MiB 1.92MiB 2.3MiB 0.927989
('http_pipelines_blackhole', 'comparison', '0792bfd4-e740-490b-be4d-7af54801e5da') 196 638.44KiB 428.12KiB 31.98KiB 559.23KiB 1.21MiB 1.5MiB 1.71MiB 1.95MiB 0.892552
('http_pipelines_blackhole', 'baseline', '4d014924-829d-440c-bfba-3aefa1821260') 194 636.44KiB 449.59KiB 15.99KiB 550.94KiB 1.19MiB 1.54MiB 1.81MiB 1.87MiB 0.813859
('http_pipelines_blackhole_acks', 'baseline', '7c47e556-549e-4a16-80f7-9b2ee67b3e44') 194 635.63KiB 466.91KiB 15.99KiB 550.68KiB 1.24MiB 1.44MiB 1.78MiB 2.33MiB 0.833229
('http_pipelines_blackhole_acks', 'baseline', '9097b216-9f31-4e7c-8b39-275bec9114fa') 198 633.84KiB 456.86KiB 15.99KiB 591.47KiB 1.24MiB 1.43MiB 1.84MiB 2.26MiB 0.781219
('http_pipelines_blackhole_acks', 'comparison', 'ad56806f-3173-4881-9d67-7dd7b0a4b33e') 197 631.87KiB 433.11KiB 15.99KiB 553.91KiB 1.23MiB 1.37MiB 1.57MiB 1.9MiB 0.590955
('http_pipelines_blackhole', 'comparison', 'd613a8d1-8221-426d-8da2-115f570acd85') 198 623.57KiB 455.05KiB 30.89KiB 550.39KiB 1.19MiB 1.45MiB 1.91MiB 2.45MiB 1.04738
('http_pipelines_blackhole_acks', 'baseline', '5700ad2d-cc99-43f8-af9e-c521660398b3') 196 615.86KiB 480.76KiB 15.99KiB 520.3KiB 1.28MiB 1.45MiB 1.84MiB 2.94MiB 1.22093
('http_pipelines_blackhole_acks', 'comparison', '3b2c8eba-6ae9-445f-8078-5feb9c3d97b8') 201 611.61KiB 475.07KiB 15.99KiB 491.04KiB 1.23MiB 1.5MiB 2.04MiB 2.33MiB 1.04138

@jdrouet jdrouet merged commit 476aa05 into master Mar 10, 2022
@jdrouet jdrouet deleted the jdrouet/OP-143 branch March 10, 2022 07:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
domain: sinks Anything related to the Vector's sinks
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants