Fix flakiness in Gradle Launcher smoke test#8099
Merged
nikita-tkachenko-datadog merged 1 commit intomasterfrom Dec 17, 2024
Merged
Fix flakiness in Gradle Launcher smoke test#8099nikita-tkachenko-datadog merged 1 commit intomasterfrom
nikita-tkachenko-datadog merged 1 commit intomasterfrom
Conversation
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 10 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.45.0-SNAPSHOT~ad1535ee95, baseline=1.45.0-SNAPSHOT~44d088e88f
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.094 s) : 0, 1093980
Total [baseline] (10.48 s) : 0, 10479739
Agent [candidate] (1.094 s) : 0, 1093878
Total [candidate] (10.546 s) : 0, 10546014
section appsec
Agent [baseline] (1.229 s) : 0, 1228737
Total [baseline] (10.728 s) : 0, 10728066
Agent [candidate] (1.226 s) : 0, 1226289
Total [candidate] (10.74 s) : 0, 10739857
section iast
Agent [baseline] (1.228 s) : 0, 1228441
Total [baseline] (10.976 s) : 0, 10976059
Agent [candidate] (1.222 s) : 0, 1222279
Total [candidate] (11.002 s) : 0, 11001827
section profiling
Agent [baseline] (1.321 s) : 0, 1320731
Total [baseline] (10.88 s) : 0, 10880020
Agent [candidate] (1.319 s) : 0, 1319379
Total [candidate] (10.827 s) : 0, 10826967
gantt
title petclinic - break down per module: candidate=1.45.0-SNAPSHOT~ad1535ee95, baseline=1.45.0-SNAPSHOT~44d088e88f
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (696.764 ms) : 0, 696764
BytebuddyAgent [candidate] (697.356 ms) : 0, 697356
GlobalTracer [baseline] (318.637 ms) : 0, 318637
GlobalTracer [candidate] (317.624 ms) : 0, 317624
AppSec [baseline] (54.855 ms) : 0, 54855
AppSec [candidate] (54.513 ms) : 0, 54513
Remote Config [baseline] (688.602 µs) : 0, 689
Remote Config [candidate] (682.973 µs) : 0, 683
Telemetry [baseline] (9.281 ms) : 0, 9281
Telemetry [candidate] (9.841 ms) : 0, 9841
section appsec
BytebuddyAgent [baseline] (713.487 ms) : 0, 713487
BytebuddyAgent [candidate] (712.81 ms) : 0, 712810
GlobalTracer [baseline] (315.74 ms) : 0, 315740
GlobalTracer [candidate] (314.44 ms) : 0, 314440
AppSec [baseline] (166.937 ms) : 0, 166937
AppSec [candidate] (167.358 ms) : 0, 167358
IAST [baseline] (20.681 ms) : 0, 20681
IAST [candidate] (18.974 ms) : 0, 18974
Remote Config [baseline] (648.534 µs) : 0, 649
Remote Config [candidate] (643.115 µs) : 0, 643
Telemetry [baseline] (7.83 ms) : 0, 7830
Telemetry [candidate] (7.828 ms) : 0, 7828
section iast
BytebuddyAgent [baseline] (818.494 ms) : 0, 818494
BytebuddyAgent [candidate] (814.627 ms) : 0, 814627
GlobalTracer [baseline] (308.309 ms) : 0, 308309
GlobalTracer [candidate] (306.794 ms) : 0, 306794
AppSec [baseline] (55.915 ms) : 0, 55915
AppSec [candidate] (57.969 ms) : 0, 57969
IAST [baseline] (23.657 ms) : 0, 23657
IAST [candidate] (21.012 ms) : 0, 21012
Remote Config [baseline] (625.866 µs) : 0, 626
Remote Config [candidate] (620.323 µs) : 0, 620
Telemetry [baseline] (7.565 ms) : 0, 7565
Telemetry [candidate] (7.473 ms) : 0, 7473
section profiling
BytebuddyAgent [baseline] (692.29 ms) : 0, 692290
BytebuddyAgent [candidate] (690.199 ms) : 0, 690199
GlobalTracer [baseline] (434.248 ms) : 0, 434248
GlobalTracer [candidate] (433.321 ms) : 0, 433321
AppSec [baseline] (53.547 ms) : 0, 53547
AppSec [candidate] (53.769 ms) : 0, 53769
Remote Config [baseline] (665.324 µs) : 0, 665
Remote Config [candidate] (666.508 µs) : 0, 667
Telemetry [baseline] (7.665 ms) : 0, 7665
Telemetry [candidate] (7.712 ms) : 0, 7712
ProfilingAgent [baseline] (92.803 ms) : 0, 92803
ProfilingAgent [candidate] (94.45 ms) : 0, 94450
Profiling [baseline] (92.828 ms) : 0, 92828
Profiling [candidate] (94.476 ms) : 0, 94476
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.45.0-SNAPSHOT~ad1535ee95, baseline=1.45.0-SNAPSHOT~44d088e88f
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.097 s) : 0, 1096591
Total [baseline] (8.658 s) : 0, 8658238
Agent [candidate] (1.092 s) : 0, 1091592
Total [candidate] (8.664 s) : 0, 8663645
section iast
Agent [baseline] (1.22 s) : 0, 1220112
Total [baseline] (9.217 s) : 0, 9217107
Agent [candidate] (1.239 s) : 0, 1238759
Total [candidate] (9.231 s) : 0, 9231021
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.23 s) : 0, 1229782
Total [baseline] (9.216 s) : 0, 9215752
Agent [candidate] (1.223 s) : 0, 1223329
Total [candidate] (9.173 s) : 0, 9172543
section iast_TELEMETRY_OFF
Agent [baseline] (1.232 s) : 0, 1232348
Total [baseline] (9.19 s) : 0, 9190322
Agent [candidate] (1.224 s) : 0, 1223507
Total [candidate] (9.197 s) : 0, 9197160
gantt
title insecure-bank - break down per module: candidate=1.45.0-SNAPSHOT~ad1535ee95, baseline=1.45.0-SNAPSHOT~44d088e88f
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (697.227 ms) : 0, 697227
BytebuddyAgent [candidate] (696.603 ms) : 0, 696603
GlobalTracer [baseline] (318.831 ms) : 0, 318831
GlobalTracer [candidate] (317.375 ms) : 0, 317375
AppSec [baseline] (54.65 ms) : 0, 54650
AppSec [candidate] (54.649 ms) : 0, 54649
Remote Config [baseline] (680.402 µs) : 0, 680
Remote Config [candidate] (699.072 µs) : 0, 699
Telemetry [baseline] (11.405 ms) : 0, 11405
Telemetry [candidate] (8.471 ms) : 0, 8471
section iast
BytebuddyAgent [baseline] (812.274 ms) : 0, 812274
BytebuddyAgent [candidate] (826.708 ms) : 0, 826708
GlobalTracer [baseline] (307.174 ms) : 0, 307174
GlobalTracer [candidate] (310.868 ms) : 0, 310868
AppSec [baseline] (57.864 ms) : 0, 57864
AppSec [candidate] (57.266 ms) : 0, 57266
IAST [baseline] (20.956 ms) : 0, 20956
IAST [candidate] (21.824 ms) : 0, 21824
Remote Config [baseline] (636.449 µs) : 0, 636
Remote Config [candidate] (634.318 µs) : 0, 634
Telemetry [baseline] (7.487 ms) : 0, 7487
Telemetry [candidate] (7.508 ms) : 0, 7508
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (821.32 ms) : 0, 821320
BytebuddyAgent [candidate] (815.355 ms) : 0, 815355
GlobalTracer [baseline] (306.772 ms) : 0, 306772
GlobalTracer [candidate] (306.712 ms) : 0, 306712
AppSec [baseline] (58.246 ms) : 0, 58246
AppSec [candidate] (58.078 ms) : 0, 58078
IAST [baseline] (21.366 ms) : 0, 21366
IAST [candidate] (21.347 ms) : 0, 21347
Remote Config [baseline] (622.393 µs) : 0, 622
Remote Config [candidate] (634.416 µs) : 0, 634
Telemetry [baseline] (7.617 ms) : 0, 7617
Telemetry [candidate] (7.456 ms) : 0, 7456
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (821.619 ms) : 0, 821619
BytebuddyAgent [candidate] (815.502 ms) : 0, 815502
GlobalTracer [baseline] (309.512 ms) : 0, 309512
GlobalTracer [candidate] (307.525 ms) : 0, 307525
AppSec [baseline] (58.323 ms) : 0, 58323
AppSec [candidate] (57.132 ms) : 0, 57132
IAST [baseline] (20.919 ms) : 0, 20919
IAST [candidate] (21.523 ms) : 0, 21523
Remote Config [baseline] (623.333 µs) : 0, 623
Remote Config [candidate] (622.499 µs) : 0, 622
Telemetry [baseline] (7.428 ms) : 0, 7428
Telemetry [candidate] (7.383 ms) : 0, 7383
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics. Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~ad1535ee95, baseline=1.45.0-SNAPSHOT~44d088e88f
dateFormat X
axisFormat %s
section baseline
no_agent (372.97 µs) : 352, 394
. : milestone, 373,
iast (489.041 µs) : 467, 511
. : milestone, 489,
iast_FULL (653.237 µs) : 632, 675
. : milestone, 653,
iast_GLOBAL (515.372 µs) : 494, 537
. : milestone, 515,
iast_HARDCODED_SECRET_DISABLED (485.493 µs) : 464, 507
. : milestone, 485,
iast_INACTIVE (449.097 µs) : 428, 470
. : milestone, 449,
iast_TELEMETRY_OFF (480.157 µs) : 459, 502
. : milestone, 480,
tracing (448.895 µs) : 428, 470
. : milestone, 449,
section candidate
no_agent (373.615 µs) : 354, 393
. : milestone, 374,
iast (488.658 µs) : 467, 510
. : milestone, 489,
iast_FULL (646.453 µs) : 625, 668
. : milestone, 646,
iast_GLOBAL (511.138 µs) : 490, 532
. : milestone, 511,
iast_HARDCODED_SECRET_DISABLED (490.123 µs) : 469, 512
. : milestone, 490,
iast_INACTIVE (447.096 µs) : 426, 468
. : milestone, 447,
iast_TELEMETRY_OFF (485.258 µs) : 464, 507
. : milestone, 485,
tracing (445.724 µs) : 425, 467
. : milestone, 446,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~ad1535ee95, baseline=1.45.0-SNAPSHOT~44d088e88f
dateFormat X
axisFormat %s
section baseline
no_agent (1.348 ms) : 1329, 1368
. : milestone, 1348,
appsec (1.751 ms) : 1727, 1775
. : milestone, 1751,
appsec_no_iast (1.734 ms) : 1709, 1759
. : milestone, 1734,
iast (1.502 ms) : 1480, 1524
. : milestone, 1502,
profiling (1.503 ms) : 1480, 1526
. : milestone, 1503,
tracing (1.473 ms) : 1448, 1498
. : milestone, 1473,
section candidate
no_agent (1.359 ms) : 1339, 1378
. : milestone, 1359,
appsec (1.738 ms) : 1714, 1761
. : milestone, 1738,
appsec_no_iast (1.732 ms) : 1708, 1757
. : milestone, 1732,
iast (1.491 ms) : 1468, 1513
. : milestone, 1491,
profiling (1.519 ms) : 1496, 1542
. : milestone, 1519,
tracing (1.494 ms) : 1470, 1518
. : milestone, 1494,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~ad1535ee95, baseline=1.45.0-SNAPSHOT~44d088e88f
dateFormat X
axisFormat %s
section baseline
no_agent (14.939 s) : 14939000, 14939000
. : milestone, 14939000,
appsec (14.829 s) : 14829000, 14829000
. : milestone, 14829000,
iast (18.967 s) : 18967000, 18967000
. : milestone, 18967000,
iast_GLOBAL (17.867 s) : 17867000, 17867000
. : milestone, 17867000,
profiling (15.479 s) : 15479000, 15479000
. : milestone, 15479000,
tracing (15.047 s) : 15047000, 15047000
. : milestone, 15047000,
section candidate
no_agent (15.368 s) : 15368000, 15368000
. : milestone, 15368000,
appsec (15.254 s) : 15254000, 15254000
. : milestone, 15254000,
iast (18.288 s) : 18288000, 18288000
. : milestone, 18288000,
iast_GLOBAL (17.712 s) : 17712000, 17712000
. : milestone, 17712000,
profiling (14.852 s) : 14852000, 14852000
. : milestone, 14852000,
tracing (15.025 s) : 15025000, 15025000
. : milestone, 15025000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~ad1535ee95, baseline=1.45.0-SNAPSHOT~44d088e88f
dateFormat X
axisFormat %s
section baseline
no_agent (1.476 ms) : 1464, 1487
. : milestone, 1476,
appsec (2.358 ms) : 2315, 2400
. : milestone, 2358,
iast (2.095 ms) : 2042, 2148
. : milestone, 2095,
iast_GLOBAL (2.142 ms) : 2088, 2195
. : milestone, 2142,
profiling (1.978 ms) : 1934, 2021
. : milestone, 1978,
tracing (1.938 ms) : 1898, 1979
. : milestone, 1938,
section candidate
no_agent (1.477 ms) : 1465, 1488
. : milestone, 1477,
appsec (2.358 ms) : 2316, 2400
. : milestone, 2358,
iast (2.103 ms) : 2051, 2156
. : milestone, 2103,
iast_GLOBAL (2.14 ms) : 2087, 2193
. : milestone, 2140,
profiling (1.953 ms) : 1910, 1995
. : milestone, 1953,
tracing (1.944 ms) : 1903, 1985
. : milestone, 1944,
|
smola
approved these changes
Dec 17, 2024
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What Does This Do
Disables Git data upload in Gradle Launcher smoke test: the mock backend that is used by the test does not implement endpoints that are called for Git data upload.
Contributor Checklist
type:and (comp:orinst:) labels in addition to any usefull labelsclose,fixor any linking keywords when referencing an issue.Use
solvesinstead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]