Skip to content

Update Gradle dependencies#7502

Merged
smola merged 42 commits intomasterfrom
ci/update-gradle-dependencies-20240825
Aug 26, 2024
Merged

Update Gradle dependencies#7502
smola merged 42 commits intomasterfrom
ci/update-gradle-dependencies-20240825

Conversation

@github-actions
Copy link
Copy Markdown
Contributor

@github-actions github-actions Bot commented Aug 25, 2024

This PR updates the Gradle dependencies. ⚠️ Don't forget to squash commits before merging. ⚠️

github-actions Bot added 30 commits August 25, 2024 04:13
@github-actions
chore: Update Gradle dependencies
316f218
@github-actions
chore: Update Gradle dependencies
3b74d4f
@github-actions
chore: Update Gradle dependencies
8b3c2ca
@github-actions
chore: Update Gradle dependencies
a58e9f0
@github-actions
chore: Update Gradle dependencies
d9609a0
@github-actions
chore: Update Gradle dependencies
9434e99
@github-actions
chore: Update Gradle dependencies
831ca5a
@github-actions
chore: Update Gradle dependencies
ebdd154
@github-actions
chore: Update Gradle dependencies
9a538b9
@github-actions
chore: Update Gradle dependencies
0294626
@github-actions
chore: Update Gradle dependencies
3edb527
@github-actions
chore: Update Gradle dependencies
48ef4bc
@github-actions
chore: Update Gradle dependencies
9e2eee0
@github-actions
chore: Update Gradle dependencies
6e29af0
@github-actions
chore: Update Gradle dependencies
9f9575f
@github-actions
chore: Update Gradle dependencies
d9b6890
@github-actions
chore: Update Gradle dependencies
d9ff95c
@github-actions
chore: Update Gradle dependencies
fffce37
@github-actions
chore: Update Gradle dependencies
23886d7
@github-actions
chore: Update Gradle dependencies
8e110e3
@github-actions
chore: Update Gradle dependencies
abd784a
@github-actions
chore: Update Gradle dependencies
9b88c9b
@github-actions
chore: Update Gradle dependencies
5f62e00
@github-actions
chore: Update Gradle dependencies
866143e
@github-actions
chore: Update Gradle dependencies
46065ab
@github-actions
chore: Update Gradle dependencies
27c744b
@github-actions
chore: Update Gradle dependencies
9f40d72
@github-actions
chore: Update Gradle dependencies
7fefe45
@github-actions
chore: Update Gradle dependencies
5ba6a33
@github-actions
chore: Update Gradle dependencies
2010b53
@github-actions github-actions Bot added the tag: no release notes Changes to exclude from release notes label Aug 25, 2024
@github-actions github-actions Bot requested a review from a team as a code owner August 25, 2024 04:14
@github-actions github-actions Bot added the tag: dependencies Dependencies related changes label Aug 25, 2024
@github-actions github-actions Bot requested review from a team as code owners August 25, 2024 04:14
@github-actions github-actions Bot requested review from ValentinZakharov, cimi, smola and tonyredondo and removed request for a team August 25, 2024 04:14
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Aug 25, 2024 •
edited
Loading

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1724656776 1724657155
end_time 2024-08-26T07:20:49 2024-08-26T07:27:08
git_branch master ci/update-gradle-dependencies-20240825
git_commit_sha d5b629d ecda25e
start_time 2024-08-26T07:19:37 2024-08-26T07:25:56
See matching parameters
Baseline Candidate
ci_job_id 616456231 616456231
ci_pipeline_id 42780541 42780541
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1724656009 1724656009

Summary

Found 0 performance improvements and 6 performance regressions! Performance is the same for 4 metrics, 5 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:basic worse
[+7.618µs; +17.100µs] or [+2.877%; +6.458%]		 unsure
[+1.401µs; +16.031µs] or [+0.478%; +5.466%]		 same unstable
[-20.416µs; +60.025µs] or [-3.477%; +10.224%]		 same
scenario:loop worse
[+455.928µs; +533.901µs] or [+4.403%; +5.157%]		 worse
[+451.491µs; +553.183µs] or [+4.289%; +5.255%]		 worse
[+456.288µs; +576.121µs] or [+4.307%; +5.439%]		 worse
[+379.407µs; +817.745µs] or [+3.469%; +7.477%]		 worse
[-5.377op/s; -3.045op/s] or [-5.726%; -3.242%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-14959.329ns; +16303.521ns] or [-5.963%; +6.499%]		 unstable
[-27.589µs; +25.414µs] or [-9.642%; +8.881%]		 unstable
[-38.953µs; +34.490µs] or [-13.015%; +11.524%]		 unstable
[-76.057µs; +95.030µs] or [-11.997%; +14.990%]		 same
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (286.146 µs) : 259, 313
.   : milestone, 286,
basic (293.3 µs) : 287, 300
.   : milestone, 293,
loop (10.528 ms) : 10491, 10564
.   : milestone, 10528,
section candidate
noprobe (285.059 µs) : 261, 309
.   : milestone, 285,
basic (302.016 µs) : 294, 310
.   : milestone, 302,
loop (11.03 ms) : 10974, 11086
.   : milestone, 11030,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 286.146 µs [259.473 µs, 312.82 µs]
basic 293.3 µs [286.554 µs, 300.045 µs]
loop 10.528 ms [10.491 ms, 10.564 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 285.059 µs [261.217 µs, 308.901 µs]
basic 302.016 µs [294.463 µs, 309.568 µs]
loop 11.03 ms [10.974 ms, 11.086 ms]

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Aug 25, 2024 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20240825
git_commit_date 1724655985 1724656009
git_commit_sha d5b629d ecda25e
release_version 1.39.0-SNAPSHOT~d5b629dbec 1.39.0-SNAPSHOT~ecda25e857
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1724658587 1724658587
ci_job_id 616456225 616456225
ci_pipeline_id 42780541 42780541
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 13 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.39.0-SNAPSHOT~ecda25e857, baseline=1.39.0-SNAPSHOT~d5b629dbec

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.047 s) : 0, 1047206
Total [baseline] (8.501 s) : 0, 8500738
Agent [candidate] (1.046 s) : 0, 1046123
Total [candidate] (8.493 s) : 0, 8493412
section iast
Agent [baseline] (1.172 s) : 0, 1172395
Total [baseline] (8.974 s) : 0, 8974274
Agent [candidate] (1.188 s) : 0, 1187738
Total [candidate] (8.986 s) : 0, 8985686
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.171 s) : 0, 1171278
Total [baseline] (8.966 s) : 0, 8966415
Agent [candidate] (1.172 s) : 0, 1171513
Total [candidate] (8.942 s) : 0, 8941726
section iast_TELEMETRY_OFF
Agent [baseline] (1.17 s) : 0, 1170273
Total [baseline] (8.965 s) : 0, 8965161
Agent [candidate] (1.184 s) : 0, 1183928
Total [candidate] (9.0 s) : 0, 8999841
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent iast 1.172 s 125.189 ms (12.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.171 s 124.072 ms (11.8%)
Agent iast_TELEMETRY_OFF 1.17 s 123.067 ms (11.8%)
Total tracing 8.501 s -
Total iast 8.974 s 473.536 ms (5.6%)
Total iast_HARDCODED_SECRET_DISABLED 8.966 s 465.677 ms (5.5%)
Total iast_TELEMETRY_OFF 8.965 s 464.424 ms (5.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.046 s -
Agent iast 1.188 s 141.615 ms (13.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.172 s 125.389 ms (12.0%)
Agent iast_TELEMETRY_OFF 1.184 s 137.804 ms (13.2%)
Total tracing 8.493 s -
Total iast 8.986 s 492.273 ms (5.8%)
Total iast_HARDCODED_SECRET_DISABLED 8.942 s 448.314 ms (5.3%)
Total iast_TELEMETRY_OFF 9.0 s 506.429 ms (6.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.39.0-SNAPSHOT~ecda25e857, baseline=1.39.0-SNAPSHOT~d5b629dbec

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (668.044 ms) : 0, 668044
BytebuddyAgent [candidate] (667.373 ms) : 0, 667373
GlobalTracer [baseline] (306.0 ms) : 0, 306000
GlobalTracer [candidate] (306.259 ms) : 0, 306259
AppSec [baseline] (51.594 ms) : 0, 51594
AppSec [candidate] (51.062 ms) : 0, 51062
Remote Config [baseline] (661.609 µs) : 0, 662
Remote Config [candidate] (656.485 µs) : 0, 656
Telemetry [baseline] (7.451 ms) : 0, 7451
Telemetry [candidate] (7.374 ms) : 0, 7374
section iast
BytebuddyAgent [baseline] (778.346 ms) : 0, 778346
BytebuddyAgent [candidate] (789.043 ms) : 0, 789043
GlobalTracer [baseline] (295.604 ms) : 0, 295604
GlobalTracer [candidate] (299.632 ms) : 0, 299632
AppSec [baseline] (52.149 ms) : 0, 52149
AppSec [candidate] (51.748 ms) : 0, 51748
IAST [baseline] (24.18 ms) : 0, 24180
IAST [candidate] (24.971 ms) : 0, 24971
Remote Config [baseline] (598.013 µs) : 0, 598
Remote Config [candidate] (594.087 µs) : 0, 594
Telemetry [baseline] (8.021 ms) : 0, 8021
Telemetry [candidate] (8.095 ms) : 0, 8095
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (778.484 ms) : 0, 778484
BytebuddyAgent [candidate] (776.833 ms) : 0, 776833
GlobalTracer [baseline] (296.401 ms) : 0, 296401
GlobalTracer [candidate] (296.637 ms) : 0, 296637
AppSec [baseline] (49.177 ms) : 0, 49177
AppSec [candidate] (50.489 ms) : 0, 50489
IAST [baseline] (23.558 ms) : 0, 23558
IAST [candidate] (25.567 ms) : 0, 25567
Remote Config [baseline] (594.767 µs) : 0, 595
Remote Config [candidate] (593.965 µs) : 0, 594
Telemetry [baseline] (9.549 ms) : 0, 9549
Telemetry [candidate] (7.911 ms) : 0, 7911
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (776.682 ms) : 0, 776682
BytebuddyAgent [candidate] (786.428 ms) : 0, 786428
GlobalTracer [baseline] (296.621 ms) : 0, 296621
GlobalTracer [candidate] (299.943 ms) : 0, 299943
AppSec [baseline] (52.877 ms) : 0, 52877
AppSec [candidate] (51.534 ms) : 0, 51534
IAST [baseline] (22.147 ms) : 0, 22147
IAST [candidate] (24.002 ms) : 0, 24002
Remote Config [baseline] (592.873 µs) : 0, 593
Remote Config [candidate] (590.313 µs) : 0, 590
Telemetry [baseline] (7.842 ms) : 0, 7842
Telemetry [candidate] (7.782 ms) : 0, 7782
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.39.0-SNAPSHOT~ecda25e857, baseline=1.39.0-SNAPSHOT~d5b629dbec

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.048 s) : 0, 1048016
Total [baseline] (10.375 s) : 0, 10374529
Agent [candidate] (1.054 s) : 0, 1054209
Total [candidate] (10.402 s) : 0, 10402174
section appsec
Agent [baseline] (1.171 s) : 0, 1171359
Total [baseline] (10.479 s) : 0, 10479485
Agent [candidate] (1.172 s) : 0, 1171983
Total [candidate] (10.48 s) : 0, 10479661
section iast
Agent [baseline] (1.179 s) : 0, 1179225
Total [baseline] (10.831 s) : 0, 10831265
Agent [candidate] (1.181 s) : 0, 1180730
Total [candidate] (10.821 s) : 0, 10820761
section profiling
Agent [baseline] (1.245 s) : 0, 1244803
Total [baseline] (10.569 s) : 0, 10568944
Agent [candidate] (1.256 s) : 0, 1255590
Total [candidate] (10.624 s) : 0, 10624293
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.048 s -
Agent appsec 1.171 s 123.343 ms (11.8%)
Agent iast 1.179 s 131.21 ms (12.5%)
Agent profiling 1.245 s 196.787 ms (18.8%)
Total tracing 10.375 s -
Total appsec 10.479 s 104.956 ms (1.0%)
Total iast 10.831 s 456.737 ms (4.4%)
Total profiling 10.569 s 194.416 ms (1.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.054 s -
Agent appsec 1.172 s 117.774 ms (11.2%)
Agent iast 1.181 s 126.521 ms (12.0%)
Agent profiling 1.256 s 201.38 ms (19.1%)
Total tracing 10.402 s -
Total appsec 10.48 s 77.487 ms (0.7%)
Total iast 10.821 s 418.587 ms (4.0%)
Total profiling 10.624 s 222.119 ms (2.1%) 
gantt
    title petclinic - break down per module: candidate=1.39.0-SNAPSHOT~ecda25e857, baseline=1.39.0-SNAPSHOT~d5b629dbec

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (668.677 ms) : 0, 668677
BytebuddyAgent [candidate] (672.444 ms) : 0, 672444
GlobalTracer [baseline] (306.428 ms) : 0, 306428
GlobalTracer [candidate] (308.357 ms) : 0, 308357
AppSec [baseline] (51.457 ms) : 0, 51457
AppSec [candidate] (51.732 ms) : 0, 51732
Remote Config [baseline] (664.457 µs) : 0, 664
Remote Config [candidate] (672.067 µs) : 0, 672
Telemetry [baseline] (7.362 ms) : 0, 7362
Telemetry [candidate] (7.505 ms) : 0, 7505
section appsec
BytebuddyAgent [baseline] (679.097 ms) : 0, 679097
BytebuddyAgent [candidate] (679.722 ms) : 0, 679722
GlobalTracer [baseline] (300.693 ms) : 0, 300693
GlobalTracer [candidate] (301.125 ms) : 0, 301125
AppSec [baseline] (160.856 ms) : 0, 160856
AppSec [candidate] (160.134 ms) : 0, 160134
IAST [baseline] (18.296 ms) : 0, 18296
IAST [candidate] (18.312 ms) : 0, 18312
Remote Config [baseline] (638.259 µs) : 0, 638
Remote Config [candidate] (639.0 µs) : 0, 639
Telemetry [baseline] (7.448 ms) : 0, 7448
Telemetry [candidate] (7.709 ms) : 0, 7709
section iast
BytebuddyAgent [baseline] (784.167 ms) : 0, 784167
BytebuddyAgent [candidate] (783.966 ms) : 0, 783966
GlobalTracer [baseline] (296.477 ms) : 0, 296477
GlobalTracer [candidate] (297.591 ms) : 0, 297591
AppSec [baseline] (51.235 ms) : 0, 51235
AppSec [candidate] (50.659 ms) : 0, 50659
IAST [baseline] (25.203 ms) : 0, 25203
IAST [candidate] (26.295 ms) : 0, 26295
Remote Config [baseline] (597.119 µs) : 0, 597
Remote Config [candidate] (611.619 µs) : 0, 612
Telemetry [baseline] (7.994 ms) : 0, 7994
Telemetry [candidate] (8.046 ms) : 0, 8046
section profiling
BytebuddyAgent [baseline] (662.094 ms) : 0, 662094
BytebuddyAgent [candidate] (668.801 ms) : 0, 668801
GlobalTracer [baseline] (389.18 ms) : 0, 389180
GlobalTracer [candidate] (391.764 ms) : 0, 391764
AppSec [baseline] (52.23 ms) : 0, 52230
AppSec [candidate] (52.694 ms) : 0, 52694
Remote Config [baseline] (685.537 µs) : 0, 686
Remote Config [candidate] (696.646 µs) : 0, 697
Telemetry [baseline] (7.298 ms) : 0, 7298
Telemetry [candidate] (7.414 ms) : 0, 7414
ProfilingAgent [baseline] (96.221 ms) : 0, 96221
ProfilingAgent [candidate] (96.778 ms) : 0, 96778
Profiling [baseline] (96.245 ms) : 0, 96245
Profiling [candidate] (96.802 ms) : 0, 96802
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-08-26T07:20:31 2024-08-26T07:27:19
git_branch master ci/update-gradle-dependencies-20240825
git_commit_date 1724655985 1724656009
git_commit_sha d5b629d ecda25e
release_version 1.39.0-SNAPSHOT~d5b629dbec 1.39.0-SNAPSHOT~ecda25e857
start_time 2024-08-26T07:20:17 2024-08-26T07:27:06
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1724657584 1724657584
ci_job_id 616456226 616456226
ci_pipeline_id 42780541 42780541
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 19 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~ecda25e857, baseline=1.39.0-SNAPSHOT~d5b629dbec
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.336 ms) : 1317, 1356
.   : milestone, 1336,
appsec (1.712 ms) : 1689, 1736
.   : milestone, 1712,
appsec_no_iast (1.719 ms) : 1695, 1742
.   : milestone, 1719,
iast (1.494 ms) : 1471, 1517
.   : milestone, 1494,
profiling (1.494 ms) : 1470, 1518
.   : milestone, 1494,
tracing (1.454 ms) : 1430, 1479
.   : milestone, 1454,
section candidate
no_agent (1.349 ms) : 1329, 1369
.   : milestone, 1349,
appsec (1.758 ms) : 1734, 1781
.   : milestone, 1758,
appsec_no_iast (1.732 ms) : 1708, 1756
.   : milestone, 1732,
iast (1.47 ms) : 1448, 1492
.   : milestone, 1470,
profiling (1.53 ms) : 1505, 1555
.   : milestone, 1530,
tracing (1.469 ms) : 1444, 1494
.   : milestone, 1469,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.336 ms [1.317 ms, 1.356 ms] -
appsec 1.712 ms [1.689 ms, 1.736 ms] 375.845 µs (28.1%)
appsec_no_iast 1.719 ms [1.695 ms, 1.742 ms] 382.271 µs (28.6%)
iast 1.494 ms [1.471 ms, 1.517 ms] 158.145 µs (11.8%)
profiling 1.494 ms [1.47 ms, 1.518 ms] 157.406 µs (11.8%)
tracing 1.454 ms [1.43 ms, 1.479 ms] 117.783 µs (8.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.349 ms [1.329 ms, 1.369 ms] -
appsec 1.758 ms [1.734 ms, 1.781 ms] 408.865 µs (30.3%)
appsec_no_iast 1.732 ms [1.708 ms, 1.756 ms] 383.387 µs (28.4%)
iast 1.47 ms [1.448 ms, 1.492 ms] 121.126 µs (9.0%)
profiling 1.53 ms [1.505 ms, 1.555 ms] 181.183 µs (13.4%)
tracing 1.469 ms [1.444 ms, 1.494 ms] 120.463 µs (8.9%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~ecda25e857, baseline=1.39.0-SNAPSHOT~d5b629dbec
    dateFormat X
    axisFormat %s
section baseline
no_agent (364.334 µs) : 345, 384
.   : milestone, 364,
iast (478.857 µs) : 457, 501
.   : milestone, 479,
iast_FULL (550.131 µs) : 529, 571
.   : milestone, 550,
iast_GLOBAL (508.8 µs) : 486, 531
.   : milestone, 509,
iast_HARDCODED_SECRET_DISABLED (477.396 µs) : 455, 499
.   : milestone, 477,
iast_INACTIVE (443.795 µs) : 422, 466
.   : milestone, 444,
iast_TELEMETRY_OFF (474.928 µs) : 452, 498
.   : milestone, 475,
tracing (437.584 µs) : 417, 458
.   : milestone, 438,
section candidate
no_agent (363.683 µs) : 344, 383
.   : milestone, 364,
iast (479.343 µs) : 457, 502
.   : milestone, 479,
iast_FULL (552.309 µs) : 531, 574
.   : milestone, 552,
iast_GLOBAL (496.226 µs) : 475, 517
.   : milestone, 496,
iast_HARDCODED_SECRET_DISABLED (480.972 µs) : 459, 503
.   : milestone, 481,
iast_INACTIVE (447.375 µs) : 426, 469
.   : milestone, 447,
iast_TELEMETRY_OFF (466.269 µs) : 444, 488
.   : milestone, 466,
tracing (437.147 µs) : 416, 458
.   : milestone, 437,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 364.334 µs [344.638 µs, 384.03 µs] -
iast 478.857 µs [456.552 µs, 501.162 µs] 114.523 µs (31.4%)
iast_FULL 550.131 µs [528.772 µs, 571.49 µs] 185.797 µs (51.0%)
iast_GLOBAL 508.8 µs [486.166 µs, 531.434 µs] 144.466 µs (39.7%)
iast_HARDCODED_SECRET_DISABLED 477.396 µs [455.457 µs, 499.335 µs] 113.062 µs (31.0%)
iast_INACTIVE 443.795 µs [421.962 µs, 465.629 µs] 79.461 µs (21.8%)
iast_TELEMETRY_OFF 474.928 µs [452.194 µs, 497.662 µs] 110.594 µs (30.4%)
tracing 437.584 µs [416.839 µs, 458.328 µs] 73.25 µs (20.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 363.683 µs [344.247 µs, 383.118 µs] -
iast 479.343 µs [456.77 µs, 501.915 µs] 115.66 µs (31.8%)
iast_FULL 552.309 µs [530.985 µs, 573.633 µs] 188.626 µs (51.9%)
iast_GLOBAL 496.226 µs [475.06 µs, 517.392 µs] 132.544 µs (36.4%)
iast_HARDCODED_SECRET_DISABLED 480.972 µs [458.8 µs, 503.144 µs] 117.29 µs (32.3%)
iast_INACTIVE 447.375 µs [426.172 µs, 468.578 µs] 83.692 µs (23.0%)
iast_TELEMETRY_OFF 466.269 µs [444.098 µs, 488.439 µs] 102.586 µs (28.2%)
tracing 437.147 µs [416.465 µs, 457.83 µs] 73.464 µs (20.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20240825
git_commit_date 1724655985 1724656009
git_commit_sha d5b629d ecda25e
release_version 1.39.0-SNAPSHOT~d5b629dbec 1.39.0-SNAPSHOT~ecda25e857
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1724658135 1724658135
ci_job_id 616456227 616456227
ci_pipeline_id 42780541 42780541
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~ecda25e857, baseline=1.39.0-SNAPSHOT~d5b629dbec
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.453 ms) : 1441, 1464
.   : milestone, 1453,
appsec (2.206 ms) : 2171, 2241
.   : milestone, 2206,
iast (1.959 ms) : 1916, 2002
.   : milestone, 1959,
iast_GLOBAL (2.011 ms) : 1967, 2055
.   : milestone, 2011,
profiling (1.849 ms) : 1814, 1885
.   : milestone, 1849,
tracing (1.821 ms) : 1788, 1853
.   : milestone, 1821,
section candidate
no_agent (1.452 ms) : 1441, 1463
.   : milestone, 1452,
appsec (2.206 ms) : 2172, 2241
.   : milestone, 2206,
iast (1.962 ms) : 1920, 2004
.   : milestone, 1962,
iast_GLOBAL (2.022 ms) : 1979, 2066
.   : milestone, 2022,
profiling (1.865 ms) : 1829, 1901
.   : milestone, 1865,
tracing (1.834 ms) : 1801, 1867
.   : milestone, 1834,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.453 ms [1.441 ms, 1.464 ms] -
appsec 2.206 ms [2.171 ms, 2.241 ms] 753.362 µs (51.9%)
iast 1.959 ms [1.916 ms, 2.002 ms] 505.896 µs (34.8%)
iast_GLOBAL 2.011 ms [1.967 ms, 2.055 ms] 558.193 µs (38.4%)
profiling 1.849 ms [1.814 ms, 1.885 ms] 396.768 µs (27.3%)
tracing 1.821 ms [1.788 ms, 1.853 ms] 368.053 µs (25.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.452 ms [1.441 ms, 1.463 ms] -
appsec 2.206 ms [2.172 ms, 2.241 ms] 754.245 µs (51.9%)
iast 1.962 ms [1.92 ms, 2.004 ms] 510.119 µs (35.1%)
iast_GLOBAL 2.022 ms [1.979 ms, 2.066 ms] 570.314 µs (39.3%)
profiling 1.865 ms [1.829 ms, 1.901 ms] 413.245 µs (28.5%)
tracing 1.834 ms [1.801 ms, 1.867 ms] 381.907 µs (26.3%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~ecda25e857, baseline=1.39.0-SNAPSHOT~d5b629dbec
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.979 s) : 14979000, 14979000
.   : milestone, 14979000,
appsec (15.122 s) : 15122000, 15122000
.   : milestone, 15122000,
iast (18.652 s) : 18652000, 18652000
.   : milestone, 18652000,
iast_GLOBAL (17.604 s) : 17604000, 17604000
.   : milestone, 17604000,
profiling (15.102 s) : 15102000, 15102000
.   : milestone, 15102000,
tracing (15.124 s) : 15124000, 15124000
.   : milestone, 15124000,
section candidate
no_agent (15.361 s) : 15361000, 15361000
.   : milestone, 15361000,
appsec (14.763 s) : 14763000, 14763000
.   : milestone, 14763000,
iast (18.873 s) : 18873000, 18873000
.   : milestone, 18873000,
iast_GLOBAL (18.046 s) : 18046000, 18046000
.   : milestone, 18046000,
profiling (15.038 s) : 15038000, 15038000
.   : milestone, 15038000,
tracing (15.162 s) : 15162000, 15162000
.   : milestone, 15162000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.979 s [14.979 s, 14.979 s] -
appsec 15.122 s [15.122 s, 15.122 s] 143.0 ms (1.0%)
iast 18.652 s [18.652 s, 18.652 s] 3.673 s (24.5%)
iast_GLOBAL 17.604 s [17.604 s, 17.604 s] 2.625 s (17.5%)
profiling 15.102 s [15.102 s, 15.102 s] 123.0 ms (0.8%)
tracing 15.124 s [15.124 s, 15.124 s] 145.0 ms (1.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.361 s [15.361 s, 15.361 s] -
appsec 14.763 s [14.763 s, 14.763 s] -598.0 ms (-3.9%)
iast 18.873 s [18.873 s, 18.873 s] 3.512 s (22.9%)
iast_GLOBAL 18.046 s [18.046 s, 18.046 s] 2.685 s (17.5%)
profiling 15.038 s [15.038 s, 15.038 s] -323.0 ms (-2.1%)
tracing 15.162 s [15.162 s, 15.162 s] -199.0 ms (-1.3%)

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Aug 25, 2024 •
edited
Loading

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20240825
git_commit_date 1724447967 1724656009
git_commit_sha 6326167 ecda25e
See matching parameters
Baseline Candidate
ci_job_date 1724657287 1724657287
ci_job_id 616456229 616456229
ci_pipeline_id 42780541 42780541
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.21 11.0.21
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.21+9-post-Ubuntu-0ubuntu122.04 11.0.21+9-post-Ubuntu-0ubuntu122.04

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 2 metrics, 0 unstable metrics.

scenario Δ mean throughput
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce better
[+3425.808op/s; +7116.220op/s] or [+2.875%; +5.971%]
See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Aug 25, 2024 •
edited
Loading

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20240825
git_commit_date 1724447967 1724656009
git_commit_sha 6326167 ecda25e
See matching parameters
Baseline Candidate
ci_job_date 1724657325 1724657325
ci_job_id 616456230 616456230
ci_pipeline_id 42780541 42780541
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.21 11.0.21
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.21+9-post-Ubuntu-0ubuntu122.04 11.0.21+9-post-Ubuntu-0ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume unsure
[-6953.608op/s; -1266.488op/s] or [-3.899%; -0.710%]

@smola smola enabled auto-merge (squash) August 26, 2024 08:06
@smola smola merged commit 074bc9b into master Aug 26, 2024
@smola smola deleted the ci/update-gradle-dependencies-20240825 branch August 26, 2024 08:06
@github-actions github-actions Bot added this to the 1.39.0 milestone Aug 26, 2024
@smola smola mentioned this pull request Aug 26, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@smola smola smola approved these changes

@ValentinZakharov ValentinZakharov Awaiting requested review from ValentinZakharov ValentinZakharov is a code owner automatically assigned from DataDog/asm-java

@cimi cimi Awaiting requested review from cimi cimi is a code owner automatically assigned from DataDog/debugger-java

@tonyredondo tonyredondo Awaiting requested review from tonyredondo tonyredondo was automatically assigned from DataDog/ci-app-libraries-java

Assignees

No one assigned

Labels

tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.39.0

Development

Successfully merging this pull request may close these issues.

2 participants

@smola @vandonr