-
Notifications
You must be signed in to change notification settings - Fork 292
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Avoid using stdout to report bootstrapping errors #7432
Merged
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
amarziali
approved these changes
Aug 14, 2024
mcculls
approved these changes
Aug 14, 2024
This was referenced Aug 14, 2024
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 47 metrics, 16 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.39.0-SNAPSHOT~ca005cd40f, baseline=1.39.0-SNAPSHOT~a56a624469
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1054901
Total [baseline] (8.507 s) : 0, 8506780
Agent [candidate] (1.047 s) : 0, 1046664
Total [candidate] (8.477 s) : 0, 8477431
section iast
Agent [baseline] (1.175 s) : 0, 1174737
Total [baseline] (8.968 s) : 0, 8968312
Agent [candidate] (1.183 s) : 0, 1182534
Total [candidate] (9.005 s) : 0, 9004994
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.184 s) : 0, 1184073
Total [baseline] (8.968 s) : 0, 8968100
Agent [candidate] (1.195 s) : 0, 1194717
Total [candidate] (9.016 s) : 0, 9016409
section iast_TELEMETRY_OFF
Agent [baseline] (1.173 s) : 0, 1172932
Total [baseline] (9.033 s) : 0, 9033465
Agent [candidate] (1.17 s) : 0, 1169822
Total [candidate] (8.97 s) : 0, 8969806
gantt
title insecure-bank - break down per module: candidate=1.39.0-SNAPSHOT~ca005cd40f, baseline=1.39.0-SNAPSHOT~a56a624469
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (673.236 ms) : 0, 673236
BytebuddyAgent [candidate] (667.557 ms) : 0, 667557
GlobalTracer [baseline] (308.681 ms) : 0, 308681
GlobalTracer [candidate] (306.495 ms) : 0, 306495
AppSec [baseline] (51.234 ms) : 0, 51234
AppSec [candidate] (51.064 ms) : 0, 51064
Remote Config [baseline] (683.509 µs) : 0, 684
Remote Config [candidate] (682.645 µs) : 0, 683
Telemetry [baseline] (7.552 ms) : 0, 7552
Telemetry [candidate] (7.471 ms) : 0, 7471
section iast
BytebuddyAgent [baseline] (781.72 ms) : 0, 781720
BytebuddyAgent [candidate] (787.061 ms) : 0, 787061
GlobalTracer [baseline] (295.924 ms) : 0, 295924
GlobalTracer [candidate] (297.966 ms) : 0, 297966
AppSec [baseline] (53.067 ms) : 0, 53067
AppSec [candidate] (50.893 ms) : 0, 50893
IAST [baseline] (22.967 ms) : 0, 22967
IAST [candidate] (23.851 ms) : 0, 23851
Remote Config [baseline] (559.934 µs) : 0, 560
Remote Config [candidate] (572.855 µs) : 0, 573
Telemetry [baseline] (7.057 ms) : 0, 7057
Telemetry [candidate] (8.687 ms) : 0, 8687
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (788.215 ms) : 0, 788215
BytebuddyAgent [candidate] (795.157 ms) : 0, 795157
GlobalTracer [baseline] (298.195 ms) : 0, 298195
GlobalTracer [candidate] (301.564 ms) : 0, 301564
AppSec [baseline] (49.531 ms) : 0, 49531
AppSec [candidate] (50.641 ms) : 0, 50641
IAST [baseline] (25.902 ms) : 0, 25902
IAST [candidate] (24.277 ms) : 0, 24277
Remote Config [baseline] (581.581 µs) : 0, 582
Remote Config [candidate] (580.663 µs) : 0, 581
Telemetry [baseline] (8.075 ms) : 0, 8075
Telemetry [candidate] (8.795 ms) : 0, 8795
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (779.724 ms) : 0, 779724
BytebuddyAgent [candidate] (777.74 ms) : 0, 777740
GlobalTracer [baseline] (297.228 ms) : 0, 297228
GlobalTracer [candidate] (296.232 ms) : 0, 296232
AppSec [baseline] (52.938 ms) : 0, 52938
AppSec [candidate] (50.691 ms) : 0, 50691
IAST [baseline] (20.877 ms) : 0, 20877
IAST [candidate] (24.009 ms) : 0, 24009
Remote Config [baseline] (1.392 ms) : 0, 1392
Remote Config [candidate] (613.967 µs) : 0, 614
Telemetry [baseline] (7.269 ms) : 0, 7269
Telemetry [candidate] (7.049 ms) : 0, 7049
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.39.0-SNAPSHOT~ca005cd40f, baseline=1.39.0-SNAPSHOT~a56a624469
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.046 s) : 0, 1045768
Total [baseline] (10.483 s) : 0, 10482779
Agent [candidate] (1.048 s) : 0, 1047608
Total [candidate] (10.399 s) : 0, 10399138
section appsec
Agent [baseline] (1.167 s) : 0, 1166912
Total [baseline] (10.474 s) : 0, 10473979
Agent [candidate] (1.168 s) : 0, 1167579
Total [candidate] (10.448 s) : 0, 10448340
section iast
Agent [baseline] (1.183 s) : 0, 1182693
Total [baseline] (10.892 s) : 0, 10892009
Agent [candidate] (1.186 s) : 0, 1186123
Total [candidate] (10.805 s) : 0, 10804868
section profiling
Agent [baseline] (1.245 s) : 0, 1244882
Total [baseline] (10.587 s) : 0, 10586961
Agent [candidate] (1.244 s) : 0, 1244356
Total [candidate] (10.599 s) : 0, 10598952
gantt
title petclinic - break down per module: candidate=1.39.0-SNAPSHOT~ca005cd40f, baseline=1.39.0-SNAPSHOT~a56a624469
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (667.008 ms) : 0, 667008
BytebuddyAgent [candidate] (668.555 ms) : 0, 668555
GlobalTracer [baseline] (306.288 ms) : 0, 306288
GlobalTracer [candidate] (306.51 ms) : 0, 306510
AppSec [baseline] (50.877 ms) : 0, 50877
AppSec [candidate] (50.886 ms) : 0, 50886
Remote Config [baseline] (681.123 µs) : 0, 681
Remote Config [candidate] (689.077 µs) : 0, 689
Telemetry [baseline] (7.496 ms) : 0, 7496
Telemetry [candidate] (7.516 ms) : 0, 7516
section appsec
BytebuddyAgent [baseline] (676.488 ms) : 0, 676488
BytebuddyAgent [candidate] (676.257 ms) : 0, 676257
GlobalTracer [baseline] (299.719 ms) : 0, 299719
GlobalTracer [candidate] (299.808 ms) : 0, 299808
AppSec [baseline] (157.147 ms) : 0, 157147
AppSec [candidate] (157.021 ms) : 0, 157021
Remote Config [baseline] (596.249 µs) : 0, 596
Remote Config [candidate] (595.155 µs) : 0, 595
Telemetry [baseline] (8.757 ms) : 0, 8757
Telemetry [candidate] (9.961 ms) : 0, 9961
IAST [baseline] (21.48 ms) : 0, 21480
IAST [candidate] (20.93 ms) : 0, 20930
section iast
BytebuddyAgent [baseline] (787.136 ms) : 0, 787136
BytebuddyAgent [candidate] (788.863 ms) : 0, 788863
GlobalTracer [baseline] (298.129 ms) : 0, 298129
GlobalTracer [candidate] (298.578 ms) : 0, 298578
AppSec [baseline] (52.641 ms) : 0, 52641
AppSec [candidate] (52.825 ms) : 0, 52825
Remote Config [baseline] (595.428 µs) : 0, 595
Remote Config [candidate] (588.867 µs) : 0, 589
Telemetry [baseline] (7.909 ms) : 0, 7909
Telemetry [candidate] (9.67 ms) : 0, 9670
IAST [baseline] (22.723 ms) : 0, 22723
IAST [candidate] (21.999 ms) : 0, 21999
section profiling
BytebuddyAgent [baseline] (662.168 ms) : 0, 662168
BytebuddyAgent [candidate] (662.383 ms) : 0, 662383
GlobalTracer [baseline] (390.063 ms) : 0, 390063
GlobalTracer [candidate] (390.707 ms) : 0, 390707
AppSec [baseline] (52.352 ms) : 0, 52352
AppSec [candidate] (51.536 ms) : 0, 51536
Remote Config [baseline] (684.963 µs) : 0, 685
Remote Config [candidate] (702.563 µs) : 0, 703
Telemetry [baseline] (7.363 ms) : 0, 7363
Telemetry [candidate] (7.397 ms) : 0, 7397
ProfilingAgent [baseline] (95.179 ms) : 0, 95179
ProfilingAgent [candidate] (94.496 ms) : 0, 94496
Profiling [baseline] (95.203 ms) : 0, 95203
Profiling [candidate] (94.52 ms) : 0, 94520
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics. Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~ca005cd40f, baseline=1.39.0-SNAPSHOT~a56a624469
dateFormat X
axisFormat %s
section baseline
no_agent (369.236 µs) : 350, 389
. : milestone, 369,
iast (480.148 µs) : 459, 501
. : milestone, 480,
iast_FULL (545.418 µs) : 524, 567
. : milestone, 545,
iast_GLOBAL (505.654 µs) : 483, 528
. : milestone, 506,
iast_HARDCODED_SECRET_DISABLED (473.932 µs) : 453, 495
. : milestone, 474,
iast_INACTIVE (456.986 µs) : 434, 480
. : milestone, 457,
iast_TELEMETRY_OFF (474.1 µs) : 452, 496
. : milestone, 474,
tracing (438.814 µs) : 419, 459
. : milestone, 439,
section candidate
no_agent (364.63 µs) : 345, 384
. : milestone, 365,
iast (479.961 µs) : 459, 501
. : milestone, 480,
iast_FULL (559.099 µs) : 535, 583
. : milestone, 559,
iast_GLOBAL (501.738 µs) : 479, 524
. : milestone, 502,
iast_HARDCODED_SECRET_DISABLED (484.229 µs) : 463, 505
. : milestone, 484,
iast_INACTIVE (456.976 µs) : 434, 480
. : milestone, 457,
iast_TELEMETRY_OFF (470.886 µs) : 449, 493
. : milestone, 471,
tracing (440.899 µs) : 420, 462
. : milestone, 441,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~ca005cd40f, baseline=1.39.0-SNAPSHOT~a56a624469
dateFormat X
axisFormat %s
section baseline
no_agent (1.368 ms) : 1348, 1387
. : milestone, 1368,
appsec (1.729 ms) : 1706, 1753
. : milestone, 1729,
appsec_no_iast (1.727 ms) : 1703, 1750
. : milestone, 1727,
iast (1.484 ms) : 1461, 1507
. : milestone, 1484,
profiling (1.481 ms) : 1456, 1506
. : milestone, 1481,
tracing (1.451 ms) : 1426, 1476
. : milestone, 1451,
section candidate
no_agent (1.343 ms) : 1324, 1362
. : milestone, 1343,
appsec (1.717 ms) : 1692, 1742
. : milestone, 1717,
appsec_no_iast (1.723 ms) : 1699, 1747
. : milestone, 1723,
iast (1.476 ms) : 1453, 1498
. : milestone, 1476,
profiling (1.477 ms) : 1453, 1502
. : milestone, 1477,
tracing (1.462 ms) : 1438, 1486
. : milestone, 1462,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~ca005cd40f, baseline=1.39.0-SNAPSHOT~a56a624469
dateFormat X
axisFormat %s
section baseline
no_agent (14.94 s) : 14940000, 14940000
. : milestone, 14940000,
appsec (15.027 s) : 15027000, 15027000
. : milestone, 15027000,
iast (18.731 s) : 18731000, 18731000
. : milestone, 18731000,
iast_GLOBAL (17.937 s) : 17937000, 17937000
. : milestone, 17937000,
profiling (15.169 s) : 15169000, 15169000
. : milestone, 15169000,
tracing (14.922 s) : 14922000, 14922000
. : milestone, 14922000,
section candidate
no_agent (15.004 s) : 15004000, 15004000
. : milestone, 15004000,
appsec (14.854 s) : 14854000, 14854000
. : milestone, 14854000,
iast (18.684 s) : 18684000, 18684000
. : milestone, 18684000,
iast_GLOBAL (17.933 s) : 17933000, 17933000
. : milestone, 17933000,
profiling (15.281 s) : 15281000, 15281000
. : milestone, 15281000,
tracing (15.024 s) : 15024000, 15024000
. : milestone, 15024000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~ca005cd40f, baseline=1.39.0-SNAPSHOT~a56a624469
dateFormat X
axisFormat %s
section baseline
no_agent (1.463 ms) : 1452, 1475
. : milestone, 1463,
appsec (2.224 ms) : 2188, 2260
. : milestone, 2224,
iast (1.948 ms) : 1907, 1989
. : milestone, 1948,
iast_GLOBAL (2.02 ms) : 1977, 2064
. : milestone, 2020,
profiling (1.856 ms) : 1821, 1892
. : milestone, 1856,
tracing (1.823 ms) : 1791, 1856
. : milestone, 1823,
section candidate
no_agent (1.459 ms) : 1448, 1470
. : milestone, 1459,
appsec (2.214 ms) : 2179, 2248
. : milestone, 2214,
iast (1.968 ms) : 1925, 2010
. : milestone, 1968,
iast_GLOBAL (2.011 ms) : 1969, 2054
. : milestone, 2011,
profiling (1.846 ms) : 1811, 1881
. : milestone, 1846,
tracing (1.836 ms) : 1803, 1869
. : milestone, 1836,
|
Using stdout instead of stderr breaks CLI tools used in shell sub-commands if anything goes wrong.
PerfectSlayer
force-pushed
the
bbujon/bootstrap-logging
branch
from
August 14, 2024 10:54
3904fec
to
ca005cd
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
This PR removes usage of
stdout
for reporting agent bootrapping errors.Motivation
Using
stdout
instead ofstderr
breaks CLI tools used in shell sub-commands if anything goes wrong.Additional Notes
Solves #7413
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]