-
Notifications
You must be signed in to change notification settings - Fork 291
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Report updated trace.sampling.rules
to telemetry
#7106
Report updated trace.sampling.rules
to telemetry
#7106
Conversation
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 46 metrics, 17 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.35.0-SNAPSHOT~718e512043, baseline=1.35.0-SNAPSHOT~b2807adfa7
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.069 s) : 0, 1069056
Total [baseline] (8.561 s) : 0, 8560607
Agent [candidate] (1.066 s) : 0, 1065805
Total [candidate] (8.584 s) : 0, 8583693
section iast
Agent [baseline] (1.162 s) : 0, 1162471
Total [baseline] (8.973 s) : 0, 8973329
Agent [candidate] (1.168 s) : 0, 1167609
Total [candidate] (9.042 s) : 0, 9041942
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.166 s) : 0, 1166472
Total [baseline] (8.981 s) : 0, 8981183
Agent [candidate] (1.183 s) : 0, 1183469
Total [candidate] (9.031 s) : 0, 9030764
section iast_TELEMETRY_OFF
Agent [baseline] (1.163 s) : 0, 1162933
Total [baseline] (9.021 s) : 0, 9021192
Agent [candidate] (1.163 s) : 0, 1162749
Total [candidate] (9.05 s) : 0, 9049790
gantt
title insecure-bank - break down per module: candidate=1.35.0-SNAPSHOT~718e512043, baseline=1.35.0-SNAPSHOT~b2807adfa7
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (659.843 ms) : 0, 659843
BytebuddyAgent [candidate] (657.328 ms) : 0, 657328
GlobalTracer [baseline] (315.536 ms) : 0, 315536
GlobalTracer [candidate] (315.322 ms) : 0, 315322
AppSec [baseline] (50.283 ms) : 0, 50283
AppSec [candidate] (50.302 ms) : 0, 50302
Remote Config [baseline] (680.284 µs) : 0, 680
Remote Config [candidate] (667.652 µs) : 0, 668
Telemetry [baseline] (7.689 ms) : 0, 7689
Telemetry [candidate] (7.593 ms) : 0, 7593
section iast
BytebuddyAgent [baseline] (776.854 ms) : 0, 776854
BytebuddyAgent [candidate] (779.154 ms) : 0, 779154
GlobalTracer [baseline] (290.852 ms) : 0, 290852
GlobalTracer [candidate] (292.614 ms) : 0, 292614
AppSec [baseline] (49.655 ms) : 0, 49655
AppSec [candidate] (48.163 ms) : 0, 48163
Remote Config [baseline] (584.545 µs) : 0, 585
Remote Config [candidate] (618.289 µs) : 0, 618
Telemetry [baseline] (6.79 ms) : 0, 6790
Telemetry [candidate] (10.129 ms) : 0, 10129
IAST [baseline] (24.515 ms) : 0, 24515
IAST [candidate] (23.663 ms) : 0, 23663
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (779.088 ms) : 0, 779088
BytebuddyAgent [candidate] (789.221 ms) : 0, 789221
GlobalTracer [baseline] (292.094 ms) : 0, 292094
GlobalTracer [candidate] (296.832 ms) : 0, 296832
AppSec [baseline] (48.151 ms) : 0, 48151
AppSec [candidate] (48.824 ms) : 0, 48824
Remote Config [baseline] (596.441 µs) : 0, 596
Remote Config [candidate] (607.71 µs) : 0, 608
Telemetry [baseline] (7.681 ms) : 0, 7681
Telemetry [candidate] (9.398 ms) : 0, 9398
IAST [baseline] (25.582 ms) : 0, 25582
IAST [candidate] (25.127 ms) : 0, 25127
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (775.891 ms) : 0, 775891
BytebuddyAgent [candidate] (775.69 ms) : 0, 775690
GlobalTracer [baseline] (291.395 ms) : 0, 291395
GlobalTracer [candidate] (292.671 ms) : 0, 292671
AppSec [baseline] (51.194 ms) : 0, 51194
AppSec [candidate] (49.672 ms) : 0, 49672
Remote Config [baseline] (614.149 µs) : 0, 614
Remote Config [candidate] (616.053 µs) : 0, 616
Telemetry [baseline] (8.352 ms) : 0, 8352
Telemetry [candidate] (8.254 ms) : 0, 8254
IAST [baseline] (22.199 ms) : 0, 22199
IAST [candidate] (22.591 ms) : 0, 22591
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.35.0-SNAPSHOT~718e512043, baseline=1.35.0-SNAPSHOT~b2807adfa7
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1059509
Total [baseline] (10.318 s) : 0, 10318486
Agent [candidate] (1.056 s) : 0, 1056397
Total [candidate] (10.289 s) : 0, 10289117
section appsec
Agent [baseline] (1.176 s) : 0, 1175851
Total [baseline] (10.491 s) : 0, 10491310
Agent [candidate] (1.177 s) : 0, 1176621
Total [candidate] (10.457 s) : 0, 10456976
section iast
Agent [baseline] (1.17 s) : 0, 1170483
Total [baseline] (10.811 s) : 0, 10810672
Agent [candidate] (1.167 s) : 0, 1166832
Total [candidate] (10.718 s) : 0, 10718456
section profiling
Agent [baseline] (1.256 s) : 0, 1256469
Total [baseline] (10.594 s) : 0, 10593583
Agent [candidate] (1.255 s) : 0, 1255074
Total [candidate] (10.614 s) : 0, 10613813
gantt
title petclinic - break down per module: candidate=1.35.0-SNAPSHOT~718e512043, baseline=1.35.0-SNAPSHOT~b2807adfa7
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (655.342 ms) : 0, 655342
BytebuddyAgent [candidate] (651.808 ms) : 0, 651808
GlobalTracer [baseline] (311.83 ms) : 0, 311830
GlobalTracer [candidate] (312.659 ms) : 0, 312659
AppSec [baseline] (49.604 ms) : 0, 49604
AppSec [candidate] (49.491 ms) : 0, 49491
Remote Config [baseline] (657.85 µs) : 0, 658
Remote Config [candidate] (660.035 µs) : 0, 660
Telemetry [baseline] (7.554 ms) : 0, 7554
Telemetry [candidate] (7.54 ms) : 0, 7540
section appsec
BytebuddyAgent [baseline] (674.965 ms) : 0, 674965
BytebuddyAgent [candidate] (674.564 ms) : 0, 674564
GlobalTracer [baseline] (295.491 ms) : 0, 295491
GlobalTracer [candidate] (296.373 ms) : 0, 296373
AppSec [baseline] (152.872 ms) : 0, 152872
AppSec [candidate] (152.836 ms) : 0, 152836
Remote Config [baseline] (618.598 µs) : 0, 619
Remote Config [candidate] (621.564 µs) : 0, 622
Telemetry [baseline] (8.095 ms) : 0, 8095
Telemetry [candidate] (8.413 ms) : 0, 8413
IAST [baseline] (18.775 ms) : 0, 18775
IAST [candidate] (18.748 ms) : 0, 18748
section iast
BytebuddyAgent [baseline] (782.11 ms) : 0, 782110
BytebuddyAgent [candidate] (779.35 ms) : 0, 779350
GlobalTracer [baseline] (292.897 ms) : 0, 292897
GlobalTracer [candidate] (292.653 ms) : 0, 292653
AppSec [baseline] (49.868 ms) : 0, 49868
AppSec [candidate] (48.562 ms) : 0, 48562
Remote Config [baseline] (595.353 µs) : 0, 595
Remote Config [candidate] (593.569 µs) : 0, 594
Telemetry [baseline] (8.523 ms) : 0, 8523
Telemetry [candidate] (8.444 ms) : 0, 8444
IAST [baseline] (23.229 ms) : 0, 23229
IAST [candidate] (23.991 ms) : 0, 23991
section profiling
BytebuddyAgent [baseline] (661.129 ms) : 0, 661129
BytebuddyAgent [candidate] (660.142 ms) : 0, 660142
GlobalTracer [baseline] (384.636 ms) : 0, 384636
GlobalTracer [candidate] (384.576 ms) : 0, 384576
AppSec [baseline] (50.5 ms) : 0, 50500
AppSec [candidate] (50.229 ms) : 0, 50229
Remote Config [baseline] (784.439 µs) : 0, 784
Remote Config [candidate] (892.448 µs) : 0, 892
Telemetry [baseline] (7.368 ms) : 0, 7368
Telemetry [candidate] (7.488 ms) : 0, 7488
ProfilingAgent [baseline] (95.526 ms) : 0, 95526
ProfilingAgent [candidate] (95.405 ms) : 0, 95405
Profiling [baseline] (95.55 ms) : 0, 95550
Profiling [candidate] (95.429 ms) : 0, 95429
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 15 unstable metrics. Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.35.0-SNAPSHOT~718e512043, baseline=1.35.0-SNAPSHOT~b2807adfa7
dateFormat X
axisFormat %s
section baseline
no_agent (378.748 µs) : 358, 399
. : milestone, 379,
iast (485.554 µs) : 464, 507
. : milestone, 486,
iast_FULL (553.441 µs) : 532, 575
. : milestone, 553,
iast_GLOBAL (502.95 µs) : 482, 524
. : milestone, 503,
iast_HARDCODED_SECRET_DISABLED (488.4 µs) : 467, 510
. : milestone, 488,
iast_INACTIVE (452.106 µs) : 431, 473
. : milestone, 452,
iast_TELEMETRY_OFF (480.338 µs) : 458, 502
. : milestone, 480,
tracing (446.871 µs) : 426, 468
. : milestone, 447,
section candidate
no_agent (369.839 µs) : 350, 390
. : milestone, 370,
iast (485.932 µs) : 465, 507
. : milestone, 486,
iast_FULL (554.615 µs) : 534, 576
. : milestone, 555,
iast_GLOBAL (515.616 µs) : 494, 537
. : milestone, 516,
iast_HARDCODED_SECRET_DISABLED (486.531 µs) : 465, 508
. : milestone, 487,
iast_INACTIVE (458.945 µs) : 438, 480
. : milestone, 459,
iast_TELEMETRY_OFF (478.717 µs) : 457, 500
. : milestone, 479,
tracing (444.528 µs) : 424, 465
. : milestone, 445,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.35.0-SNAPSHOT~718e512043, baseline=1.35.0-SNAPSHOT~b2807adfa7
dateFormat X
axisFormat %s
section baseline
no_agent (1.369 ms) : 1350, 1389
. : milestone, 1369,
appsec (1.734 ms) : 1710, 1758
. : milestone, 1734,
appsec_no_iast (1.726 ms) : 1701, 1751
. : milestone, 1726,
iast (1.493 ms) : 1470, 1517
. : milestone, 1493,
profiling (1.505 ms) : 1480, 1531
. : milestone, 1505,
tracing (1.479 ms) : 1454, 1503
. : milestone, 1479,
section candidate
no_agent (1.354 ms) : 1335, 1372
. : milestone, 1354,
appsec (1.729 ms) : 1704, 1754
. : milestone, 1729,
appsec_no_iast (1.722 ms) : 1697, 1747
. : milestone, 1722,
iast (1.484 ms) : 1459, 1508
. : milestone, 1484,
profiling (1.48 ms) : 1455, 1505
. : milestone, 1480,
tracing (1.47 ms) : 1445, 1495
. : milestone, 1470,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.35.0-SNAPSHOT~718e512043, baseline=1.35.0-SNAPSHOT~b2807adfa7
dateFormat X
axisFormat %s
section baseline
no_agent (15.113 s) : 15113000, 15113000
. : milestone, 15113000,
appsec (15.133 s) : 15133000, 15133000
. : milestone, 15133000,
iast (18.774 s) : 18774000, 18774000
. : milestone, 18774000,
iast_GLOBAL (17.836 s) : 17836000, 17836000
. : milestone, 17836000,
profiling (15.655 s) : 15655000, 15655000
. : milestone, 15655000,
tracing (14.885 s) : 14885000, 14885000
. : milestone, 14885000,
section candidate
no_agent (15.585 s) : 15585000, 15585000
. : milestone, 15585000,
appsec (15.135 s) : 15135000, 15135000
. : milestone, 15135000,
iast (18.895 s) : 18895000, 18895000
. : milestone, 18895000,
iast_GLOBAL (17.988 s) : 17988000, 17988000
. : milestone, 17988000,
profiling (14.977 s) : 14977000, 14977000
. : milestone, 14977000,
tracing (14.993 s) : 14993000, 14993000
. : milestone, 14993000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.35.0-SNAPSHOT~718e512043, baseline=1.35.0-SNAPSHOT~b2807adfa7
dateFormat X
axisFormat %s
section baseline
no_agent (1.464 ms) : 1453, 1476
. : milestone, 1464,
appsec (2.204 ms) : 2170, 2239
. : milestone, 2204,
iast (1.969 ms) : 1928, 2010
. : milestone, 1969,
iast_GLOBAL (1.987 ms) : 1946, 2028
. : milestone, 1987,
profiling (1.835 ms) : 1803, 1868
. : milestone, 1835,
tracing (1.835 ms) : 1802, 1867
. : milestone, 1835,
section candidate
no_agent (1.457 ms) : 1446, 1469
. : milestone, 1457,
appsec (2.202 ms) : 2168, 2237
. : milestone, 2202,
iast (1.963 ms) : 1922, 2004
. : milestone, 1963,
iast_GLOBAL (2.003 ms) : 1962, 2045
. : milestone, 2003,
profiling (1.847 ms) : 1814, 1879
. : milestone, 1847,
tracing (1.825 ms) : 1792, 1857
. : milestone, 1825,
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, only minor nitpicks
c1b4533
to
836f422
Compare
Co-authored-by: Bruce Bujon <PerfectSlayer@users.noreply.github.com>
836f422
to
718e512
Compare
Additional Notes
The approach take here is to cache the original JSON that was parsed into the rules, for both the original static config and any updates to the dynamic config. This required a custom Moshi adapter to capture the raw JSON before it was parsed, but it was simpler than trying to reconstruct the JSON from the rule objects and more consistent with what we were sent.
Jira ticket: APMAPI-78