Skip to content

Update Gradle dependencies#8673

Merged
amarziali merged 47 commits intomasterfrom
ci/update-gradle-dependencies-20250406
Apr 7, 2025
Merged

Update Gradle dependencies#8673
amarziali merged 47 commits intomasterfrom
ci/update-gradle-dependencies-20250406

Conversation

@github-actions
Copy link
Copy Markdown
Contributor

@github-actions github-actions Bot commented Apr 6, 2025

This PR updates the Gradle dependencies. ⚠️ Don't forget to squash commits before merging. ⚠️

  • Update PR title if a code change is needed to support one of those new dependencies

github-actions Bot added 30 commits April 6, 2025 04:24
@github-actions
chore: Update Gradle dependencies
c842afe
@github-actions
chore: Update Gradle dependencies
156637e
@github-actions
chore: Update Gradle dependencies
6aaf146
@github-actions
chore: Update Gradle dependencies
c8e2c0b
@github-actions
chore: Update Gradle dependencies
98da3cb
@github-actions
chore: Update Gradle dependencies
170d347
@github-actions
chore: Update Gradle dependencies
1e63e8e
@github-actions
chore: Update Gradle dependencies
b5142fd
@github-actions
chore: Update Gradle dependencies
a86fb35
@github-actions
chore: Update Gradle dependencies
31d7275
@github-actions
chore: Update Gradle dependencies
55a1acd
@github-actions
chore: Update Gradle dependencies
c7dd79d
@github-actions
chore: Update Gradle dependencies
32ee18b
@github-actions
chore: Update Gradle dependencies
cb28e8f
@github-actions
chore: Update Gradle dependencies
7f70b1b
@github-actions
chore: Update Gradle dependencies
f59ce8e
@github-actions
chore: Update Gradle dependencies
718c832
@github-actions
chore: Update Gradle dependencies
4d61341
@github-actions
chore: Update Gradle dependencies
8d4a193
@github-actions
chore: Update Gradle dependencies
1ef159e
@github-actions
chore: Update Gradle dependencies
9578468
@github-actions
chore: Update Gradle dependencies
2b64d58
@github-actions
chore: Update Gradle dependencies
0f529ae
@github-actions
chore: Update Gradle dependencies
651e96d
@github-actions
chore: Update Gradle dependencies
6deb614
@github-actions
chore: Update Gradle dependencies
355ed04
@github-actions
chore: Update Gradle dependencies
639f49a
@github-actions
chore: Update Gradle dependencies
63c77c5
@github-actions
chore: Update Gradle dependencies
fd1bde1
@github-actions
chore: Update Gradle dependencies
44e523d
@github-actions github-actions Bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Apr 6, 2025
@github-actions github-actions Bot requested review from a team as code owners April 6, 2025 04:25
@github-actions github-actions Bot requested review from jpbempel, nikita-tkachenko-datadog, sezen-datadog and smola and removed request for a team April 6, 2025 04:25
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Apr 6, 2025 •
edited
Loading

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1743915000 1743915369
end_time 2025-04-06T04:51:18 2025-04-06T04:57:28
git_branch master ci/update-gradle-dependencies-20250406
git_commit_sha 639a30d 695b0e3
start_time 2025-04-06T04:50:01 2025-04-06T04:56:10
See matching parameters
Baseline Candidate
ci_job_id 882838250 882838250
ci_pipeline_id 61207453 61207453
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1743913496 1743913496

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 6 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-29.805µs; +32.106µs] or [-10.642%; +11.464%]		 unstable
[-44555.645ns; +43898.819ns] or [-13.835%; +13.631%]		 unstable
[-57980.306ns; +56000.320ns] or [-17.137%; +16.552%]		 unstable
[-118.673µs; +108.161µs] or [-19.032%; +17.346%]		 same
scenario:basic same same same unstable
[-58.074µs; +34.201µs] or [-10.379%; +6.113%]		 unstable
[-83.336op/s; +211.541op/s] or [-3.333%; +8.462%]
scenario:loop same same same same same
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (322.047 µs) : 274, 370
.   : milestone, 322,
basic (310.614 µs) : 300, 321
.   : milestone, 311,
loop (10.131 ms) : 10092, 10169
.   : milestone, 10131,
section candidate
noprobe (321.718 µs) : 286, 357
.   : milestone, 322,
basic (305.867 µs) : 298, 314
.   : milestone, 306,
loop (10.122 ms) : 10096, 10148
.   : milestone, 10122,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 322.047 µs [274.265 µs, 369.828 µs]
basic 310.614 µs [299.938 µs, 321.29 µs]
loop 10.131 ms [10.092 ms, 10.169 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 321.718 µs [286.106 µs, 357.33 µs]
basic 305.867 µs [298.02 µs, 313.715 µs]
loop 10.122 ms [10.096 ms, 10.148 ms]

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Apr 6, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250406
git_commit_date 1743782887 1743915006
git_commit_sha 639a30d 5142fdfc0d
release_version 1.48.0-SNAPSHOT~639a30d1ba 1.48.0-SNAPSHOT~b5142fdfc0d
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1743916863 1743916863
ci_job_id 882837495 882837495
ci_pipeline_id 61207441 61207441
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-gye2nvs3-project-304-concurrent-2-h8if2c17 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-gye2nvs3-project-304-concurrent-2-h8if2c17 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 68 metrics, 3 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~b5142fdfc0d, baseline=1.48.0-SNAPSHOT~639a30d1ba

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.069 s) : 0, 1068890
Total [baseline] (8.706 s) : 0, 8706019
Agent [candidate] (1.062 s) : 0, 1061960
Total [candidate] (8.73 s) : 0, 8729878
section iast
Agent [baseline] (1.181 s) : 0, 1181383
Total [baseline] (9.279 s) : 0, 9278878
Agent [candidate] (1.191 s) : 0, 1191485
Total [candidate] (9.232 s) : 0, 9231571
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.183 s) : 0, 1183352
Total [baseline] (9.242 s) : 0, 9242000
Agent [candidate] (1.184 s) : 0, 1184388
Total [candidate] (9.218 s) : 0, 9218115
section iast_TELEMETRY_OFF
Agent [baseline] (1.181 s) : 0, 1180907
Total [baseline] (9.26 s) : 0, 9260037
Agent [candidate] (1.188 s) : 0, 1187925
Total [candidate] (9.242 s) : 0, 9241558
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent iast 1.181 s 112.493 ms (10.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.183 s 114.462 ms (10.7%)
Agent iast_TELEMETRY_OFF 1.181 s 112.016 ms (10.5%)
Total tracing 8.706 s -
Total iast 9.279 s 572.859 ms (6.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.242 s 535.982 ms (6.2%)
Total iast_TELEMETRY_OFF 9.26 s 554.018 ms (6.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.191 s 129.525 ms (12.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.184 s 122.428 ms (11.5%)
Agent iast_TELEMETRY_OFF 1.188 s 125.965 ms (11.9%)
Total tracing 8.73 s -
Total iast 9.232 s 501.693 ms (5.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.218 s 488.237 ms (5.6%)
Total iast_TELEMETRY_OFF 9.242 s 511.68 ms (5.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~b5142fdfc0d, baseline=1.48.0-SNAPSHOT~639a30d1ba

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (732.748 ms) : 0, 732748
BytebuddyAgent [candidate] (725.155 ms) : 0, 725155
GlobalTracer [baseline] (241.809 ms) : 0, 241809
GlobalTracer [candidate] (240.45 ms) : 0, 240450
AppSec [baseline] (55.077 ms) : 0, 55077
AppSec [candidate] (56.4 ms) : 0, 56400
Debugger [baseline] (4.451 ms) : 0, 4451
Debugger [candidate] (4.447 ms) : 0, 4447
Remote Config [baseline] (710.725 µs) : 0, 711
Remote Config [candidate] (705.318 µs) : 0, 705
Telemetry [baseline] (12.936 ms) : 0, 12936
Telemetry [candidate] (13.842 ms) : 0, 13842
section iast
BytebuddyAgent [baseline] (839.32 ms) : 0, 839320
BytebuddyAgent [candidate] (846.643 ms) : 0, 846643
GlobalTracer [baseline] (228.881 ms) : 0, 228881
GlobalTracer [candidate] (230.947 ms) : 0, 230947
IAST [baseline] (22.775 ms) : 0, 22775
IAST [candidate] (22.947 ms) : 0, 22947
AppSec [baseline] (56.134 ms) : 0, 56134
AppSec [candidate] (56.516 ms) : 0, 56516
Debugger [baseline] (4.167 ms) : 0, 4167
Debugger [candidate] (4.133 ms) : 0, 4133
Remote Config [baseline] (611.633 µs) : 0, 612
Remote Config [candidate] (602.322 µs) : 0, 602
Telemetry [baseline] (8.768 ms) : 0, 8768
Telemetry [candidate] (8.723 ms) : 0, 8723
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (840.75 ms) : 0, 840750
BytebuddyAgent [candidate] (840.895 ms) : 0, 840895
GlobalTracer [baseline] (229.559 ms) : 0, 229559
GlobalTracer [candidate] (229.977 ms) : 0, 229977
IAST [baseline] (22.577 ms) : 0, 22577
IAST [candidate] (22.746 ms) : 0, 22746
AppSec [baseline] (56.284 ms) : 0, 56284
AppSec [candidate] (56.473 ms) : 0, 56473
Debugger [baseline] (4.098 ms) : 0, 4098
Debugger [candidate] (4.099 ms) : 0, 4099
Remote Config [baseline] (605.376 µs) : 0, 605
Remote Config [candidate] (601.303 µs) : 0, 601
Telemetry [baseline] (8.679 ms) : 0, 8679
Telemetry [candidate] (8.767 ms) : 0, 8767
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (839.173 ms) : 0, 839173
BytebuddyAgent [candidate] (844.584 ms) : 0, 844584
GlobalTracer [baseline] (229.532 ms) : 0, 229532
GlobalTracer [candidate] (230.65 ms) : 0, 230650
IAST [baseline] (22.268 ms) : 0, 22268
IAST [candidate] (22.38 ms) : 0, 22380
AppSec [baseline] (56.036 ms) : 0, 56036
AppSec [candidate] (56.223 ms) : 0, 56223
Debugger [baseline] (4.091 ms) : 0, 4091
Debugger [candidate] (4.087 ms) : 0, 4087
Remote Config [baseline] (606.005 µs) : 0, 606
Remote Config [candidate] (602.652 µs) : 0, 603
Telemetry [baseline] (8.521 ms) : 0, 8521
Telemetry [candidate] (8.513 ms) : 0, 8513
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~b5142fdfc0d, baseline=1.48.0-SNAPSHOT~639a30d1ba

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1066155
Total [baseline] (10.511 s) : 0, 10510831
Agent [candidate] (1.058 s) : 0, 1058016
Total [candidate] (10.509 s) : 0, 10509436
section appsec
Agent [baseline] (1.195 s) : 0, 1195485
Total [baseline] (10.786 s) : 0, 10786445
Agent [candidate] (1.197 s) : 0, 1196622
Total [candidate] (10.792 s) : 0, 10792129
section iast
Agent [baseline] (1.183 s) : 0, 1183021
Total [baseline] (11.061 s) : 0, 11061058
Agent [candidate] (1.186 s) : 0, 1185634
Total [candidate] (11.046 s) : 0, 11046489
section profiling
Agent [baseline] (1.298 s) : 0, 1297752
Total [baseline] (10.915 s) : 0, 10915058
Agent [candidate] (1.291 s) : 0, 1290763
Total [candidate] (10.93 s) : 0, 10929725
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.195 s 129.33 ms (12.1%)
Agent iast 1.183 s 116.866 ms (11.0%)
Agent profiling 1.298 s 231.596 ms (21.7%)
Total tracing 10.511 s -
Total appsec 10.786 s 275.613 ms (2.6%)
Total iast 11.061 s 550.227 ms (5.2%)
Total profiling 10.915 s 404.227 ms (3.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent appsec 1.197 s 138.606 ms (13.1%)
Agent iast 1.186 s 127.618 ms (12.1%)
Agent profiling 1.291 s 232.747 ms (22.0%)
Total tracing 10.509 s -
Total appsec 10.792 s 282.693 ms (2.7%)
Total iast 11.046 s 537.053 ms (5.1%)
Total profiling 10.93 s 420.29 ms (4.0%) 
gantt
    title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~b5142fdfc0d, baseline=1.48.0-SNAPSHOT~639a30d1ba

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (728.636 ms) : 0, 728636
BytebuddyAgent [candidate] (721.786 ms) : 0, 721786
GlobalTracer [baseline] (241.259 ms) : 0, 241259
GlobalTracer [candidate] (239.903 ms) : 0, 239903
AppSec [baseline] (54.699 ms) : 0, 54699
AppSec [candidate] (54.373 ms) : 0, 54373
Debugger [baseline] (4.434 ms) : 0, 4434
Debugger [candidate] (4.42 ms) : 0, 4420
Remote Config [baseline] (711.225 µs) : 0, 711
Remote Config [candidate] (703.93 µs) : 0, 704
Telemetry [baseline] (15.445 ms) : 0, 15445
Telemetry [candidate] (15.92 ms) : 0, 15920
section appsec
BytebuddyAgent [baseline] (739.528 ms) : 0, 739528
BytebuddyAgent [candidate] (740.196 ms) : 0, 740196
GlobalTracer [baseline] (235.121 ms) : 0, 235121
GlobalTracer [candidate] (235.802 ms) : 0, 235802
AppSec [baseline] (176.297 ms) : 0, 176297
AppSec [candidate] (175.835 ms) : 0, 175835
Debugger [baseline] (4.239 ms) : 0, 4239
Debugger [candidate] (4.238 ms) : 0, 4238
Remote Config [baseline] (644.347 µs) : 0, 644
Remote Config [candidate] (651.76 µs) : 0, 652
Telemetry [baseline] (8.221 ms) : 0, 8221
Telemetry [candidate] (8.26 ms) : 0, 8260
IAST [baseline] (21.266 ms) : 0, 21266
IAST [candidate] (21.505 ms) : 0, 21505
section iast
BytebuddyAgent [baseline] (840.42 ms) : 0, 840420
BytebuddyAgent [candidate] (841.965 ms) : 0, 841965
GlobalTracer [baseline] (229.439 ms) : 0, 229439
GlobalTracer [candidate] (230.373 ms) : 0, 230373
AppSec [baseline] (56.386 ms) : 0, 56386
AppSec [candidate] (56.373 ms) : 0, 56373
Debugger [baseline] (4.111 ms) : 0, 4111
Debugger [candidate] (4.149 ms) : 0, 4149
Remote Config [baseline] (599.92 µs) : 0, 600
Remote Config [candidate] (613.401 µs) : 0, 613
Telemetry [baseline] (8.632 ms) : 0, 8632
Telemetry [candidate] (8.732 ms) : 0, 8732
IAST [baseline] (22.719 ms) : 0, 22719
IAST [candidate] (22.633 ms) : 0, 22633
section profiling
ProfilingAgent [baseline] (104.016 ms) : 0, 104016
ProfilingAgent [candidate] (103.883 ms) : 0, 103883
BytebuddyAgent [baseline] (716.064 ms) : 0, 716064
BytebuddyAgent [candidate] (712.053 ms) : 0, 712053
GlobalTracer [baseline] (360.349 ms) : 0, 360349
GlobalTracer [candidate] (359.247 ms) : 0, 359247
AppSec [baseline] (54.826 ms) : 0, 54826
AppSec [candidate] (53.486 ms) : 0, 53486
Debugger [baseline] (4.335 ms) : 0, 4335
Debugger [candidate] (4.306 ms) : 0, 4306
Remote Config [baseline] (713.404 µs) : 0, 713
Remote Config [candidate] (714.723 µs) : 0, 715
Telemetry [baseline] (9.083 ms) : 0, 9083
Telemetry [candidate] (9.032 ms) : 0, 9032
Profiling [baseline] (104.042 ms) : 0, 104042
Profiling [candidate] (103.909 ms) : 0, 103909
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-04-06T04:50:14 2025-04-06T04:58:00
git_branch master ci/update-gradle-dependencies-20250406
git_commit_date 1743782887 1743914947
git_commit_sha 639a30d 5142fdfc0d
release_version 1.48.0-SNAPSHOT~639a30d1ba 1.48.0-SNAPSHOT~b5142fdfc0d
start_time 2025-04-06T04:50:00 2025-04-06T04:57:46
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1743915879 1743915879
ci_job_id 882837496 882837496
ci_pipeline_id 61207441 61207441
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-duquzfu1-project-304-concurrent-1-tir3tyjn 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-duquzfu1-project-304-concurrent-1-tir3tyjn 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~b5142fdfc0d, baseline=1.48.0-SNAPSHOT~639a30d1ba
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.351 ms) : 1332, 1371
.   : milestone, 1351,
appsec (1.75 ms) : 1727, 1773
.   : milestone, 1750,
appsec_no_iast (1.756 ms) : 1732, 1780
.   : milestone, 1756,
code_origins (1.706 ms) : 1680, 1732
.   : milestone, 1706,
iast (1.523 ms) : 1499, 1547
.   : milestone, 1523,
profiling (1.507 ms) : 1484, 1531
.   : milestone, 1507,
tracing (1.496 ms) : 1471, 1521
.   : milestone, 1496,
section candidate
no_agent (1.37 ms) : 1351, 1389
.   : milestone, 1370,
appsec (1.759 ms) : 1735, 1783
.   : milestone, 1759,
appsec_no_iast (1.767 ms) : 1743, 1790
.   : milestone, 1767,
code_origins (1.684 ms) : 1656, 1713
.   : milestone, 1684,
iast (1.517 ms) : 1493, 1542
.   : milestone, 1517,
profiling (1.521 ms) : 1498, 1545
.   : milestone, 1521,
tracing (1.492 ms) : 1467, 1516
.   : milestone, 1492,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.351 ms [1.332 ms, 1.371 ms] -
appsec 1.75 ms [1.727 ms, 1.773 ms] 398.572 µs (29.5%)
appsec_no_iast 1.756 ms [1.732 ms, 1.78 ms] 404.09 µs (29.9%)
code_origins 1.706 ms [1.68 ms, 1.732 ms] 354.492 µs (26.2%)
iast 1.523 ms [1.499 ms, 1.547 ms] 171.486 µs (12.7%)
profiling 1.507 ms [1.484 ms, 1.531 ms] 155.992 µs (11.5%)
tracing 1.496 ms [1.471 ms, 1.521 ms] 144.477 µs (10.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.37 ms [1.351 ms, 1.389 ms] -
appsec 1.759 ms [1.735 ms, 1.783 ms] 389.201 µs (28.4%)
appsec_no_iast 1.767 ms [1.743 ms, 1.79 ms] 396.554 µs (28.9%)
code_origins 1.684 ms [1.656 ms, 1.713 ms] 314.498 µs (23.0%)
iast 1.517 ms [1.493 ms, 1.542 ms] 147.464 µs (10.8%)
profiling 1.521 ms [1.498 ms, 1.545 ms] 151.386 µs (11.1%)
tracing 1.492 ms [1.467 ms, 1.516 ms] 121.76 µs (8.9%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~b5142fdfc0d, baseline=1.48.0-SNAPSHOT~639a30d1ba
    dateFormat X
    axisFormat %s
section baseline
no_agent (380.545 µs) : 360, 401
.   : milestone, 381,
iast (509.688 µs) : 488, 531
.   : milestone, 510,
iast_FULL (736.364 µs) : 714, 759
.   : milestone, 736,
iast_GLOBAL (564.084 µs) : 541, 587
.   : milestone, 564,
iast_HARDCODED_SECRET_DISABLED (515.692 µs) : 494, 538
.   : milestone, 516,
iast_INACTIVE (466.127 µs) : 445, 487
.   : milestone, 466,
iast_TELEMETRY_OFF (506.369 µs) : 484, 529
.   : milestone, 506,
tracing (458.105 µs) : 437, 479
.   : milestone, 458,
section candidate
no_agent (380.362 µs) : 361, 400
.   : milestone, 380,
iast (510.811 µs) : 489, 532
.   : milestone, 511,
iast_FULL (734.46 µs) : 712, 757
.   : milestone, 734,
iast_GLOBAL (566.329 µs) : 543, 590
.   : milestone, 566,
iast_HARDCODED_SECRET_DISABLED (516.721 µs) : 495, 539
.   : milestone, 517,
iast_INACTIVE (465.351 µs) : 444, 487
.   : milestone, 465,
iast_TELEMETRY_OFF (502.03 µs) : 480, 524
.   : milestone, 502,
tracing (462.54 µs) : 442, 483
.   : milestone, 463,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 380.545 µs [359.792 µs, 401.297 µs] -
iast 509.688 µs [488.279 µs, 531.097 µs] 129.143 µs (33.9%)
iast_FULL 736.364 µs [714.056 µs, 758.672 µs] 355.819 µs (93.5%)
iast_GLOBAL 564.084 µs [541.391 µs, 586.778 µs] 183.54 µs (48.2%)
iast_HARDCODED_SECRET_DISABLED 515.692 µs [493.812 µs, 537.573 µs] 135.148 µs (35.5%)
iast_INACTIVE 466.127 µs [444.85 µs, 487.403 µs] 85.582 µs (22.5%)
iast_TELEMETRY_OFF 506.369 µs [483.994 µs, 528.744 µs] 125.824 µs (33.1%)
tracing 458.105 µs [437.092 µs, 479.118 µs] 77.56 µs (20.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 380.362 µs [360.502 µs, 400.223 µs] -
iast 510.811 µs [489.337 µs, 532.286 µs] 130.449 µs (34.3%)
iast_FULL 734.46 µs [712.112 µs, 756.808 µs] 354.098 µs (93.1%)
iast_GLOBAL 566.329 µs [543.118 µs, 589.54 µs] 185.966 µs (48.9%)
iast_HARDCODED_SECRET_DISABLED 516.721 µs [494.775 µs, 538.668 µs] 136.359 µs (35.8%)
iast_INACTIVE 465.351 µs [443.659 µs, 487.044 µs] 84.989 µs (22.3%)
iast_TELEMETRY_OFF 502.03 µs [480.315 µs, 523.746 µs] 121.668 µs (32.0%)
tracing 462.54 µs [441.603 µs, 483.476 µs] 82.177 µs (21.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250406
git_commit_date 1743782887 1743915011
git_commit_sha 639a30d 5142fdfc0d
release_version 1.48.0-SNAPSHOT~639a30d1ba 1.48.0-SNAPSHOT~b5142fdfc0d
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1743916427 1743916427
ci_job_id 882837497 882837497
ci_pipeline_id 61207441 61207441
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-enocvzqb-project-304-concurrent-1-bj2shzkt 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-enocvzqb-project-304-concurrent-1-bj2shzkt 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~b5142fdfc0d, baseline=1.48.0-SNAPSHOT~639a30d1ba
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (2.378 ms) : 2331, 2424
.   : milestone, 2378,
iast (2.155 ms) : 2096, 2214
.   : milestone, 2155,
iast_GLOBAL (2.199 ms) : 2140, 2258
.   : milestone, 2199,
profiling (2.001 ms) : 1954, 2047
.   : milestone, 2001,
tracing (1.995 ms) : 1949, 2040
.   : milestone, 1995,
section candidate
no_agent (1.475 ms) : 1463, 1486
.   : milestone, 1475,
appsec (2.378 ms) : 2331, 2425
.   : milestone, 2378,
iast (2.153 ms) : 2094, 2212
.   : milestone, 2153,
iast_GLOBAL (2.198 ms) : 2140, 2257
.   : milestone, 2198,
profiling (2.001 ms) : 1954, 2048
.   : milestone, 2001,
tracing (1.994 ms) : 1948, 2040
.   : milestone, 1994,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 2.378 ms [2.331 ms, 2.424 ms] 901.678 µs (61.1%)
iast 2.155 ms [2.096 ms, 2.214 ms] 679.007 µs (46.0%)
iast_GLOBAL 2.199 ms [2.14 ms, 2.258 ms] 722.806 µs (49.0%)
profiling 2.001 ms [1.954 ms, 2.047 ms] 524.427 µs (35.5%)
tracing 1.995 ms [1.949 ms, 2.04 ms] 518.362 µs (35.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.463 ms, 1.486 ms] -
appsec 2.378 ms [2.331 ms, 2.425 ms] 903.393 µs (61.3%)
iast 2.153 ms [2.094 ms, 2.212 ms] 678.495 µs (46.0%)
iast_GLOBAL 2.198 ms [2.14 ms, 2.257 ms] 723.757 µs (49.1%)
profiling 2.001 ms [1.954 ms, 2.048 ms] 526.305 µs (35.7%)
tracing 1.994 ms [1.948 ms, 2.04 ms] 519.24 µs (35.2%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~b5142fdfc0d, baseline=1.48.0-SNAPSHOT~639a30d1ba
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.55 s) : 15550000, 15550000
.   : milestone, 15550000,
appsec (14.737 s) : 14737000, 14737000
.   : milestone, 14737000,
iast (18.768 s) : 18768000, 18768000
.   : milestone, 18768000,
iast_GLOBAL (18.005 s) : 18005000, 18005000
.   : milestone, 18005000,
profiling (15.009 s) : 15009000, 15009000
.   : milestone, 15009000,
tracing (14.836 s) : 14836000, 14836000
.   : milestone, 14836000,
section candidate
no_agent (15.478 s) : 15478000, 15478000
.   : milestone, 15478000,
appsec (14.764 s) : 14764000, 14764000
.   : milestone, 14764000,
iast (18.213 s) : 18213000, 18213000
.   : milestone, 18213000,
iast_GLOBAL (18.193 s) : 18193000, 18193000
.   : milestone, 18193000,
profiling (15.133 s) : 15133000, 15133000
.   : milestone, 15133000,
tracing (14.973 s) : 14973000, 14973000
.   : milestone, 14973000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.55 s [15.55 s, 15.55 s] -
appsec 14.737 s [14.737 s, 14.737 s] -813.0 ms (-5.2%)
iast 18.768 s [18.768 s, 18.768 s] 3.218 s (20.7%)
iast_GLOBAL 18.005 s [18.005 s, 18.005 s] 2.455 s (15.8%)
profiling 15.009 s [15.009 s, 15.009 s] -541.0 ms (-3.5%)
tracing 14.836 s [14.836 s, 14.836 s] -714.0 ms (-4.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.478 s [15.478 s, 15.478 s] -
appsec 14.764 s [14.764 s, 14.764 s] -714.0 ms (-4.6%)
iast 18.213 s [18.213 s, 18.213 s] 2.735 s (17.7%)
iast_GLOBAL 18.193 s [18.193 s, 18.193 s] 2.715 s (17.5%)
profiling 15.133 s [15.133 s, 15.133 s] -345.0 ms (-2.2%)
tracing 14.973 s [14.973 s, 14.973 s] -505.0 ms (-3.3%)

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Apr 6, 2025 •
edited
Loading

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250406
git_commit_date 1743782887 1743913496
git_commit_sha 639a30d 695b0e3
See matching parameters
Baseline Candidate
ci_job_date 1743915490 1743915490
ci_job_id 882838248 882838248
ci_pipeline_id 61207453 61207453
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce unsure
[-107473.987op/s; -17612.873op/s] or [-5.866%; -0.961%]
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Apr 6, 2025 •
edited
Loading

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250406
git_commit_date 1743782887 1743913478
git_commit_sha 639a30d 2b64d58
See matching parameters
Baseline Candidate
ci_job_date 1743915525 1743915525
ci_job_id 882837840 882837840
ci_pipeline_id 61207446 61207446
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume unsure
[-7967.876op/s; -1539.836op/s] or [-4.321%; -0.835%]

@amarziali amarziali enabled auto-merge (squash) April 7, 2025 06:38
@amarziali amarziali added dependencies and removed tag: dependencies Dependencies related changes labels Apr 7, 2025
@amarziali amarziali merged commit d1abd07 into master Apr 7, 2025
227 of 253 checks passed
@amarziali amarziali deleted the ci/update-gradle-dependencies-20250406 branch April 7, 2025 09:19
@github-actions github-actions Bot added this to the 1.48.0 milestone Apr 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@amarziali amarziali amarziali approved these changes

@smola smola Awaiting requested review from smola smola is a code owner automatically assigned from DataDog/asm-java

@sezen-datadog sezen-datadog Awaiting requested review from sezen-datadog sezen-datadog is a code owner automatically assigned from DataDog/asm-java

@jpbempel jpbempel Awaiting requested review from jpbempel jpbempel is a code owner automatically assigned from DataDog/debugger-java

@nikita-tkachenko-datadog nikita-tkachenko-datadog Awaiting requested review from nikita-tkachenko-datadog nikita-tkachenko-datadog was automatically assigned from DataDog/ci-app-libraries-java

Assignees

No one assigned

Labels

tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.48.0

Development

Successfully merging this pull request may close these issues.

1 participant

@amarziali