Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add unit test for unix domain socket support #7766

Merged
merged 1 commit into from
Oct 15, 2024
Merged

Add unit test for unix domain socket support #7766

merged 1 commit into from
Oct 15, 2024

Conversation

jpbempel
Copy link
Member

What Does This Do

add unit test for avoid regression like #7166

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@jpbempel jpbempel added comp: testing Testing tag: no release notes Changes to exclude from release notes comp: debugger Dynamic Instrumentation labels Oct 15, 2024
@jpbempel jpbempel requested review from a team as code owners October 15, 2024 13:13
@jpbempel jpbempel requested review from ojung and ygree and removed request for a team October 15, 2024 13:13
@pr-commenter
Copy link

pr-commenter bot commented Oct 15, 2024

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1728998577 1728998965
end_time 2024-10-15T13:24:12 2024-10-15T13:30:41
git_branch master jpbempel/test-unix-dom-socket
git_commit_sha d6c734c db5b500
start_time 2024-10-15T13:22:58 2024-10-15T13:29:26
See matching parameters
Baseline Candidate
ci_job_id 672446950 672446950
ci_pipeline_id 46615424 46615424
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1728997907 1728997907

Summary

Found 3 performance improvements and 0 performance regressions! Performance is the same for 6 metrics, 6 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:loop better
[-326.491µs; -156.733µs] or [-3.031%; -1.455%]		 better
[-337.499µs; -156.597µs] or [-3.083%; -1.430%]		 better
[-345.534µs; -153.765µs] or [-3.135%; -1.395%]		 same unsure
[+0.883op/s; +3.307op/s] or [+0.976%; +3.654%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-31.436µs; +18.222µs] or [-11.808%; +6.845%]		 unstable
[-41.834µs; +31.162µs] or [-13.705%; +10.209%]		 unstable
[-54.925µs; +41.849µs] or [-17.160%; +13.075%]		 unstable
[-116.868µs; +81.502µs] or [-19.416%; +13.540%]		 same
scenario:basic unsure
[+2.648µs; +11.885µs] or [+0.997%; +4.477%]		 same same unstable
[-52.677µs; +41.387µs] or [-9.793%; +7.694%]		 unstable
[-230.969op/s; +96.016op/s] or [-8.777%; +3.649%]
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (305.249 µs) : 263, 347
.   : milestone, 305,
basic (293.734 µs) : 284, 304
.   : milestone, 294,
loop (10.948 ms) : 10917, 10980
.   : milestone, 10948,
section candidate
noprobe (299.913 µs) : 274, 326
.   : milestone, 300,
basic (300.271 µs) : 292, 308
.   : milestone, 300,
loop (10.701 ms) : 10587, 10816
.   : milestone, 10701,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 305.249 µs [263.327 µs, 347.171 µs]
basic 293.734 µs [283.921 µs, 303.547 µs]
loop 10.948 ms [10.917 ms, 10.98 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 299.913 µs [274.106 µs, 325.721 µs]
basic 300.271 µs [292.276 µs, 308.267 µs]
loop 10.701 ms [10.587 ms, 10.816 ms]

@pr-commenter
Copy link

pr-commenter bot commented Oct 15, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/test-unix-dom-socket
git_commit_date 1728980020 1728997907
git_commit_sha d6c734c db5b500
release_version 1.41.0-SNAPSHOT~d6c734ceba 1.41.0-SNAPSHOT~db5b50020f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1729000528 1729000528
ci_job_id 672446938 672446938
ci_pipeline_id 46615424 46615424
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 10 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.41.0-SNAPSHOT~db5b50020f, baseline=1.41.0-SNAPSHOT~d6c734ceba

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.072 s) : 0, 1071730
Total [baseline] (10.333 s) : 0, 10333187
Agent [candidate] (1.066 s) : 0, 1065525
Total [candidate] (10.409 s) : 0, 10409378
section appsec
Agent [baseline] (1.201 s) : 0, 1201181
Total [baseline] (10.572 s) : 0, 10571621
Agent [candidate] (1.212 s) : 0, 1212123
Total [candidate] (10.597 s) : 0, 10596636
section iast
Agent [baseline] (1.196 s) : 0, 1195875
Total [baseline] (10.811 s) : 0, 10811320
Agent [candidate] (1.203 s) : 0, 1203453
Total [candidate] (10.824 s) : 0, 10823783
section profiling
Agent [baseline] (1.264 s) : 0, 1264162
Total [baseline] (10.552 s) : 0, 10551728
Agent [candidate] (1.266 s) : 0, 1265598
Total [candidate] (10.684 s) : 0, 10684131
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.072 s -
Agent appsec 1.201 s 129.452 ms (12.1%)
Agent iast 1.196 s 124.145 ms (11.6%)
Agent profiling 1.264 s 192.432 ms (18.0%)
Total tracing 10.333 s -
Total appsec 10.572 s 238.434 ms (2.3%)
Total iast 10.811 s 478.132 ms (4.6%)
Total profiling 10.552 s 218.541 ms (2.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.212 s 146.598 ms (13.8%)
Agent iast 1.203 s 137.929 ms (12.9%)
Agent profiling 1.266 s 200.073 ms (18.8%)
Total tracing 10.409 s -
Total appsec 10.597 s 187.258 ms (1.8%)
Total iast 10.824 s 414.405 ms (4.0%)
Total profiling 10.684 s 274.754 ms (2.6%) 
gantt
    title petclinic - break down per module: candidate=1.41.0-SNAPSHOT~db5b50020f, baseline=1.41.0-SNAPSHOT~d6c734ceba

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (684.75 ms) : 0, 684750
BytebuddyAgent [candidate] (680.192 ms) : 0, 680192
GlobalTracer [baseline] (311.296 ms) : 0, 311296
GlobalTracer [candidate] (309.858 ms) : 0, 309858
AppSec [baseline] (53.744 ms) : 0, 53744
AppSec [candidate] (53.734 ms) : 0, 53734
Remote Config [baseline] (673.631 µs) : 0, 674
Remote Config [candidate] (664.79 µs) : 0, 665
Telemetry [baseline] (7.573 ms) : 0, 7573
Telemetry [candidate] (7.481 ms) : 0, 7481
section appsec
BytebuddyAgent [baseline] (698.654 ms) : 0, 698654
BytebuddyAgent [candidate] (705.399 ms) : 0, 705399
GlobalTracer [baseline] (307.287 ms) : 0, 307287
GlobalTracer [candidate] (309.798 ms) : 0, 309798
AppSec [baseline] (162.915 ms) : 0, 162915
AppSec [candidate] (163.535 ms) : 0, 163535
IAST [baseline] (21.355 ms) : 0, 21355
IAST [candidate] (21.664 ms) : 0, 21664
Remote Config [baseline] (637.347 µs) : 0, 637
Remote Config [candidate] (638.094 µs) : 0, 638
Telemetry [baseline] (7.412 ms) : 0, 7412
Telemetry [candidate] (8.148 ms) : 0, 8148
section iast
BytebuddyAgent [baseline] (797.267 ms) : 0, 797267
BytebuddyAgent [candidate] (802.74 ms) : 0, 802740
GlobalTracer [baseline] (299.085 ms) : 0, 299085
GlobalTracer [candidate] (300.545 ms) : 0, 300545
AppSec [baseline] (56.289 ms) : 0, 56289
AppSec [candidate] (55.639 ms) : 0, 55639
IAST [baseline] (21.914 ms) : 0, 21914
IAST [candidate] (23.014 ms) : 0, 23014
Remote Config [baseline] (615.664 µs) : 0, 616
Remote Config [candidate] (614.447 µs) : 0, 614
Telemetry [baseline] (7.075 ms) : 0, 7075
Telemetry [candidate] (7.147 ms) : 0, 7147
section profiling
BytebuddyAgent [baseline] (674.435 ms) : 0, 674435
BytebuddyAgent [candidate] (675.289 ms) : 0, 675289
GlobalTracer [baseline] (392.967 ms) : 0, 392967
GlobalTracer [candidate] (392.649 ms) : 0, 392649
AppSec [baseline] (54.447 ms) : 0, 54447
AppSec [candidate] (54.484 ms) : 0, 54484
Remote Config [baseline] (652.704 µs) : 0, 653
Remote Config [candidate] (647.77 µs) : 0, 648
Telemetry [baseline] (7.398 ms) : 0, 7398
Telemetry [candidate] (7.373 ms) : 0, 7373
ProfilingAgent [baseline] (95.807 ms) : 0, 95807
ProfilingAgent [candidate] (96.576 ms) : 0, 96576
Profiling [baseline] (95.831 ms) : 0, 95831
Profiling [candidate] (96.599 ms) : 0, 96599
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.41.0-SNAPSHOT~db5b50020f, baseline=1.41.0-SNAPSHOT~d6c734ceba

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.068 s) : 0, 1067651
Total [baseline] (8.539 s) : 0, 8538593
Agent [candidate] (1.074 s) : 0, 1073693
Total [candidate] (8.537 s) : 0, 8536631
section iast
Agent [baseline] (1.198 s) : 0, 1197840
Total [baseline] (9.054 s) : 0, 9053520
Agent [candidate] (1.202 s) : 0, 1201581
Total [candidate] (9.085 s) : 0, 9085054
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.192 s) : 0, 1192254
Total [baseline] (9.034 s) : 0, 9033790
Agent [candidate] (1.205 s) : 0, 1205398
Total [candidate] (9.096 s) : 0, 9095791
section iast_TELEMETRY_OFF
Agent [baseline] (1.19 s) : 0, 1190126
Total [baseline] (9.068 s) : 0, 9067735
Agent [candidate] (1.193 s) : 0, 1192561
Total [candidate] (9.045 s) : 0, 9045121
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent iast 1.198 s 130.189 ms (12.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.192 s 124.603 ms (11.7%)
Agent iast_TELEMETRY_OFF 1.19 s 122.474 ms (11.5%)
Total tracing 8.539 s -
Total iast 9.054 s 514.927 ms (6.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.034 s 495.198 ms (5.8%)
Total iast_TELEMETRY_OFF 9.068 s 529.142 ms (6.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent iast 1.202 s 127.888 ms (11.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.205 s 131.704 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.193 s 118.868 ms (11.1%)
Total tracing 8.537 s -
Total iast 9.085 s 548.423 ms (6.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.096 s 559.159 ms (6.6%)
Total iast_TELEMETRY_OFF 9.045 s 508.489 ms (6.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.41.0-SNAPSHOT~db5b50020f, baseline=1.41.0-SNAPSHOT~d6c734ceba

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.248 ms) : 0, 682248
BytebuddyAgent [candidate] (685.482 ms) : 0, 685482
GlobalTracer [baseline] (309.725 ms) : 0, 309725
GlobalTracer [candidate] (311.914 ms) : 0, 311914
AppSec [baseline] (53.828 ms) : 0, 53828
AppSec [candidate] (54.386 ms) : 0, 54386
Remote Config [baseline] (670.162 µs) : 0, 670
Remote Config [candidate] (671.968 µs) : 0, 672
Telemetry [baseline] (7.501 ms) : 0, 7501
Telemetry [candidate] (7.55 ms) : 0, 7550
section iast
BytebuddyAgent [baseline] (799.649 ms) : 0, 799649
BytebuddyAgent [candidate] (801.841 ms) : 0, 801841
GlobalTracer [baseline] (298.531 ms) : 0, 298531
GlobalTracer [candidate] (299.824 ms) : 0, 299824
AppSec [baseline] (55.411 ms) : 0, 55411
AppSec [candidate] (55.587 ms) : 0, 55587
IAST [baseline] (22.877 ms) : 0, 22877
IAST [candidate] (22.831 ms) : 0, 22831
Remote Config [baseline] (622.491 µs) : 0, 622
Remote Config [candidate] (615.932 µs) : 0, 616
Telemetry [baseline] (7.056 ms) : 0, 7056
Telemetry [candidate] (7.109 ms) : 0, 7109
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (794.466 ms) : 0, 794466
BytebuddyAgent [candidate] (802.846 ms) : 0, 802846
GlobalTracer [baseline] (298.488 ms) : 0, 298488
GlobalTracer [candidate] (301.714 ms) : 0, 301714
AppSec [baseline] (55.358 ms) : 0, 55358
AppSec [candidate] (53.11 ms) : 0, 53110
IAST [baseline] (22.668 ms) : 0, 22668
IAST [candidate] (26.302 ms) : 0, 26302
Remote Config [baseline] (605.849 µs) : 0, 606
Remote Config [candidate] (606.408 µs) : 0, 606
Telemetry [baseline] (7.02 ms) : 0, 7020
Telemetry [candidate] (7.036 ms) : 0, 7036
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (792.81 ms) : 0, 792810
BytebuddyAgent [candidate] (793.777 ms) : 0, 793777
GlobalTracer [baseline] (298.796 ms) : 0, 298796
GlobalTracer [candidate] (299.302 ms) : 0, 299302
AppSec [baseline] (55.773 ms) : 0, 55773
AppSec [candidate] (53.3 ms) : 0, 53300
IAST [baseline] (21.592 ms) : 0, 21592
IAST [candidate] (24.959 ms) : 0, 24959
Remote Config [baseline] (621.587 µs) : 0, 622
Remote Config [candidate] (624.925 µs) : 0, 625
Telemetry [baseline] (6.898 ms) : 0, 6898
Telemetry [candidate] (6.898 ms) : 0, 6898
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-10-15T13:23:58 2024-10-15T13:30:50
git_branch master jpbempel/test-unix-dom-socket
git_commit_date 1728980020 1728997907
git_commit_sha d6c734c db5b500
release_version 1.41.0-SNAPSHOT~d6c734ceba 1.41.0-SNAPSHOT~db5b50020f
start_time 2024-10-15T13:23:44 2024-10-15T13:30:36
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1728999401 1728999401
ci_job_id 672446941 672446941
ci_pipeline_id 46615424 46615424
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 17 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling worse
[+35.167µs; +89.209µs] or [+2.382%; +6.044%]		 unstable
[-651.763op/s; +405.610op/s] or [-20.368%; +12.675%]		 1.538ms 3076.923op/s 1.476ms 3200.000op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~db5b50020f, baseline=1.41.0-SNAPSHOT~d6c734ceba
    dateFormat X
    axisFormat %s
section baseline
no_agent (371.06 µs) : 351, 391
.   : milestone, 371,
iast (499.776 µs) : 478, 522
.   : milestone, 500,
iast_FULL (567.673 µs) : 546, 589
.   : milestone, 568,
iast_GLOBAL (513.268 µs) : 492, 535
.   : milestone, 513,
iast_HARDCODED_SECRET_DISABLED (491.166 µs) : 470, 513
.   : milestone, 491,
iast_INACTIVE (456.415 µs) : 435, 478
.   : milestone, 456,
iast_TELEMETRY_OFF (483.053 µs) : 462, 504
.   : milestone, 483,
tracing (455.972 µs) : 435, 477
.   : milestone, 456,
section candidate
no_agent (370.238 µs) : 350, 390
.   : milestone, 370,
iast (492.657 µs) : 471, 514
.   : milestone, 493,
iast_FULL (562.819 µs) : 542, 584
.   : milestone, 563,
iast_GLOBAL (511.529 µs) : 490, 533
.   : milestone, 512,
iast_HARDCODED_SECRET_DISABLED (491.905 µs) : 471, 513
.   : milestone, 492,
iast_INACTIVE (455.846 µs) : 435, 477
.   : milestone, 456,
iast_TELEMETRY_OFF (477.174 µs) : 456, 498
.   : milestone, 477,
tracing (454.465 µs) : 433, 476
.   : milestone, 454,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 371.06 µs [351.24 µs, 390.879 µs] -
iast 499.776 µs [477.707 µs, 521.845 µs] 128.716 µs (34.7%)
iast_FULL 567.673 µs [546.263 µs, 589.083 µs] 196.613 µs (53.0%)
iast_GLOBAL 513.268 µs [491.836 µs, 534.7 µs] 142.208 µs (38.3%)
iast_HARDCODED_SECRET_DISABLED 491.166 µs [469.819 µs, 512.514 µs] 120.107 µs (32.4%)
iast_INACTIVE 456.415 µs [435.11 µs, 477.721 µs] 85.356 µs (23.0%)
iast_TELEMETRY_OFF 483.053 µs [461.845 µs, 504.261 µs] 111.993 µs (30.2%)
tracing 455.972 µs [434.95 µs, 476.994 µs] 84.912 µs (22.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 370.238 µs [350.348 µs, 390.127 µs] -
iast 492.657 µs [471.138 µs, 514.176 µs] 122.42 µs (33.1%)
iast_FULL 562.819 µs [541.615 µs, 584.022 µs] 192.581 µs (52.0%)
iast_GLOBAL 511.529 µs [490.36 µs, 532.697 µs] 141.291 µs (38.2%)
iast_HARDCODED_SECRET_DISABLED 491.905 µs [470.516 µs, 513.295 µs] 121.668 µs (32.9%)
iast_INACTIVE 455.846 µs [434.645 µs, 477.046 µs] 85.608 µs (23.1%)
iast_TELEMETRY_OFF 477.174 µs [455.908 µs, 498.44 µs] 106.936 µs (28.9%)
tracing 454.465 µs [433.077 µs, 475.853 µs] 84.227 µs (22.7%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~db5b50020f, baseline=1.41.0-SNAPSHOT~d6c734ceba
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.349 ms) : 1330, 1369
.   : milestone, 1349,
appsec (1.723 ms) : 1698, 1748
.   : milestone, 1723,
appsec_no_iast (1.721 ms) : 1697, 1744
.   : milestone, 1721,
iast (1.478 ms) : 1455, 1501
.   : milestone, 1478,
profiling (1.476 ms) : 1452, 1501
.   : milestone, 1476,
tracing (1.459 ms) : 1434, 1483
.   : milestone, 1459,
section candidate
no_agent (1.338 ms) : 1319, 1357
.   : milestone, 1338,
appsec (1.723 ms) : 1699, 1747
.   : milestone, 1723,
appsec_no_iast (1.729 ms) : 1706, 1753
.   : milestone, 1729,
iast (1.497 ms) : 1474, 1520
.   : milestone, 1497,
profiling (1.538 ms) : 1513, 1564
.   : milestone, 1538,
tracing (1.479 ms) : 1454, 1503
.   : milestone, 1479,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.349 ms [1.33 ms, 1.369 ms] -
appsec 1.723 ms [1.698 ms, 1.748 ms] 373.46 µs (27.7%)
appsec_no_iast 1.721 ms [1.697 ms, 1.744 ms] 371.456 µs (27.5%)
iast 1.478 ms [1.455 ms, 1.501 ms] 128.793 µs (9.5%)
profiling 1.476 ms [1.452 ms, 1.501 ms] 126.874 µs (9.4%)
tracing 1.459 ms [1.434 ms, 1.483 ms] 109.521 µs (8.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.338 ms [1.319 ms, 1.357 ms] -
appsec 1.723 ms [1.699 ms, 1.747 ms] 384.442 µs (28.7%)
appsec_no_iast 1.729 ms [1.706 ms, 1.753 ms] 390.83 µs (29.2%)
iast 1.497 ms [1.474 ms, 1.52 ms] 158.731 µs (11.9%)
profiling 1.538 ms [1.513 ms, 1.564 ms] 200.011 µs (14.9%)
tracing 1.479 ms [1.454 ms, 1.503 ms] 140.334 µs (10.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/test-unix-dom-socket
git_commit_date 1728980020 1728997907
git_commit_sha d6c734c db5b500
release_version 1.41.0-SNAPSHOT~d6c734ceba 1.41.0-SNAPSHOT~db5b50020f
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1728999947 1728999947
ci_job_id 672446943 672446943
ci_pipeline_id 46615424 46615424
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~db5b50020f, baseline=1.41.0-SNAPSHOT~d6c734ceba
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.516 s) : 15516000, 15516000
.   : milestone, 15516000,
appsec (15.261 s) : 15261000, 15261000
.   : milestone, 15261000,
iast (18.88 s) : 18880000, 18880000
.   : milestone, 18880000,
iast_GLOBAL (18.105 s) : 18105000, 18105000
.   : milestone, 18105000,
profiling (14.9 s) : 14900000, 14900000
.   : milestone, 14900000,
tracing (15.1 s) : 15100000, 15100000
.   : milestone, 15100000,
section candidate
no_agent (15.545 s) : 15545000, 15545000
.   : milestone, 15545000,
appsec (15.056 s) : 15056000, 15056000
.   : milestone, 15056000,
iast (18.852 s) : 18852000, 18852000
.   : milestone, 18852000,
iast_GLOBAL (18.175 s) : 18175000, 18175000
.   : milestone, 18175000,
profiling (15.215 s) : 15215000, 15215000
.   : milestone, 15215000,
tracing (15.452 s) : 15452000, 15452000
.   : milestone, 15452000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.516 s [15.516 s, 15.516 s] -
appsec 15.261 s [15.261 s, 15.261 s] -255.0 ms (-1.6%)
iast 18.88 s [18.88 s, 18.88 s] 3.364 s (21.7%)
iast_GLOBAL 18.105 s [18.105 s, 18.105 s] 2.589 s (16.7%)
profiling 14.9 s [14.9 s, 14.9 s] -616.0 ms (-4.0%)
tracing 15.1 s [15.1 s, 15.1 s] -416.0 ms (-2.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.545 s [15.545 s, 15.545 s] -
appsec 15.056 s [15.056 s, 15.056 s] -489.0 ms (-3.1%)
iast 18.852 s [18.852 s, 18.852 s] 3.307 s (21.3%)
iast_GLOBAL 18.175 s [18.175 s, 18.175 s] 2.63 s (16.9%)
profiling 15.215 s [15.215 s, 15.215 s] -330.0 ms (-2.1%)
tracing 15.452 s [15.452 s, 15.452 s] -93.0 ms (-0.6%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~db5b50020f, baseline=1.41.0-SNAPSHOT~d6c734ceba
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.46 ms) : 1449, 1472
.   : milestone, 1460,
appsec (2.311 ms) : 2271, 2352
.   : milestone, 2311,
iast (2.068 ms) : 2016, 2120
.   : milestone, 2068,
iast_GLOBAL (2.107 ms) : 2054, 2159
.   : milestone, 2107,
profiling (1.917 ms) : 1876, 1958
.   : milestone, 1917,
tracing (1.907 ms) : 1868, 1947
.   : milestone, 1907,
section candidate
no_agent (1.463 ms) : 1451, 1474
.   : milestone, 1463,
appsec (2.331 ms) : 2290, 2373
.   : milestone, 2331,
iast (2.07 ms) : 2018, 2122
.   : milestone, 2070,
iast_GLOBAL (2.105 ms) : 2053, 2157
.   : milestone, 2105,
profiling (1.94 ms) : 1899, 1982
.   : milestone, 1940,
tracing (1.911 ms) : 1871, 1950
.   : milestone, 1911,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.46 ms [1.449 ms, 1.472 ms] -
appsec 2.311 ms [2.271 ms, 2.352 ms] 851.258 µs (58.3%)
iast 2.068 ms [2.016 ms, 2.12 ms] 607.611 µs (41.6%)
iast_GLOBAL 2.107 ms [2.054 ms, 2.159 ms] 646.469 µs (44.3%)
profiling 1.917 ms [1.876 ms, 1.958 ms] 457.244 µs (31.3%)
tracing 1.907 ms [1.868 ms, 1.947 ms] 447.122 µs (30.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.463 ms [1.451 ms, 1.474 ms] -
appsec 2.331 ms [2.29 ms, 2.373 ms] 868.71 µs (59.4%)
iast 2.07 ms [2.018 ms, 2.122 ms] 607.486 µs (41.5%)
iast_GLOBAL 2.105 ms [2.053 ms, 2.157 ms] 642.458 µs (43.9%)
profiling 1.94 ms [1.899 ms, 1.982 ms] 477.644 µs (32.7%)
tracing 1.911 ms [1.871 ms, 1.95 ms] 447.789 µs (30.6%)

@jpbempel jpbempel merged commit a1c2f48 into master Oct 15, 2024
105 of 106 checks passed
@jpbempel jpbempel deleted the jpbempel/test-unix-dom-socket branch October 15, 2024 15:58
@github-actions github-actions bot added this to the 1.41.0 milestone Oct 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ojung ojung ojung approved these changes

@ygree ygree Awaiting requested review from ygree ygree is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: debugger Dynamic Instrumentation comp: testing Testing tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.41.0
Development

Successfully merging this pull request may close these issues.
2 participants
@jpbempel @ojung