Skip to content

Update Gradle dependencies#7409

Merged
amarziali merged 39 commits intomasterfrom
ci/update-gradle-dependencies-20240811
Aug 14, 2024
Merged

Update Gradle dependencies#7409
amarziali merged 39 commits intomasterfrom
ci/update-gradle-dependencies-20240811

Conversation

@github-actions
Copy link
Copy Markdown
Contributor

This PR updates the Gradle dependencies. \n:warning: Don't forget to squash commits before merging :warning:

@github-actions github-actions Bot added the tag: dependencies Dependencies related changes label Aug 11, 2024
@github-actions github-actions Bot requested review from a team as code owners August 11, 2024 04:14
@github-actions github-actions Bot requested review from PerfectSlayer, ValentinZakharov, dougqh, romainkomorn-exdatadog, shatzi and smola and removed request for a team August 11, 2024 04:14
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Aug 11, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20240811
git_commit_date 1723457525 1723468095
git_commit_sha 93ecbc6 e149ea1
release_version 1.39.0-SNAPSHOT~93ecbc62b2 1.39.0-SNAPSHOT~e149ea1282
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1723470675 1723470675
ci_job_id 601708777 601708777
ci_pipeline_id 41461327 41461327
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 15 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.39.0-SNAPSHOT~e149ea1282, baseline=1.39.0-SNAPSHOT~93ecbc62b2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1055337
Total [baseline] (8.5 s) : 0, 8499663
Agent [candidate] (1.053 s) : 0, 1053045
Total [candidate] (8.481 s) : 0, 8481234
section iast
Agent [baseline] (1.175 s) : 0, 1174917
Total [baseline] (8.994 s) : 0, 8993641
Agent [candidate] (1.175 s) : 0, 1174873
Total [candidate] (8.973 s) : 0, 8972857
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.18 s) : 0, 1180294
Total [baseline] (8.992 s) : 0, 8991502
Agent [candidate] (1.177 s) : 0, 1176856
Total [candidate] (8.963 s) : 0, 8962605
section iast_TELEMETRY_OFF
Agent [baseline] (1.189 s) : 0, 1189101
Total [baseline] (9.001 s) : 0, 9001338
Agent [candidate] (1.171 s) : 0, 1170634
Total [candidate] (8.992 s) : 0, 8992054
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.175 s 119.58 ms (11.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.18 s 124.958 ms (11.8%)
Agent iast_TELEMETRY_OFF 1.189 s 133.764 ms (12.7%)
Total tracing 8.5 s -
Total iast 8.994 s 493.979 ms (5.8%)
Total iast_HARDCODED_SECRET_DISABLED 8.992 s 491.839 ms (5.8%)
Total iast_TELEMETRY_OFF 9.001 s 501.675 ms (5.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent iast 1.175 s 121.828 ms (11.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.177 s 123.811 ms (11.8%)
Agent iast_TELEMETRY_OFF 1.171 s 117.589 ms (11.2%)
Total tracing 8.481 s -
Total iast 8.973 s 491.623 ms (5.8%)
Total iast_HARDCODED_SECRET_DISABLED 8.963 s 481.372 ms (5.7%)
Total iast_TELEMETRY_OFF 8.992 s 510.821 ms (6.0%)
gantt
    title insecure-bank - break down per module: candidate=1.39.0-SNAPSHOT~e149ea1282, baseline=1.39.0-SNAPSHOT~93ecbc62b2

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (675.841 ms) : 0, 675841
BytebuddyAgent [candidate] (671.65 ms) : 0, 671650
GlobalTracer [baseline] (306.543 ms) : 0, 306543
GlobalTracer [candidate] (308.132 ms) : 0, 308132
AppSec [baseline] (51.08 ms) : 0, 51080
AppSec [candidate] (51.556 ms) : 0, 51556
Remote Config [baseline] (692.465 µs) : 0, 692
Remote Config [candidate] (691.472 µs) : 0, 691
Telemetry [baseline] (7.618 ms) : 0, 7618
Telemetry [candidate] (7.547 ms) : 0, 7547
section iast
BytebuddyAgent [baseline] (782.001 ms) : 0, 782001
BytebuddyAgent [candidate] (781.16 ms) : 0, 781160
GlobalTracer [baseline] (296.026 ms) : 0, 296026
GlobalTracer [candidate] (295.667 ms) : 0, 295667
AppSec [baseline] (53.36 ms) : 0, 53360
AppSec [candidate] (50.856 ms) : 0, 50856
IAST [baseline] (21.534 ms) : 0, 21534
IAST [candidate] (23.511 ms) : 0, 23511
Remote Config [baseline] (594.25 µs) : 0, 594
Remote Config [candidate] (603.839 µs) : 0, 604
Telemetry [baseline] (7.95 ms) : 0, 7950
Telemetry [candidate] (9.618 ms) : 0, 9618
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (786.453 ms) : 0, 786453
BytebuddyAgent [candidate] (782.667 ms) : 0, 782667
GlobalTracer [baseline] (298.369 ms) : 0, 298369
GlobalTracer [candidate] (296.81 ms) : 0, 296810
AppSec [baseline] (49.634 ms) : 0, 49634
AppSec [candidate] (47.903 ms) : 0, 47903
IAST [baseline] (23.553 ms) : 0, 23553
IAST [candidate] (27.526 ms) : 0, 27526
Remote Config [baseline] (591.504 µs) : 0, 592
Remote Config [candidate] (568.413 µs) : 0, 568
Telemetry [baseline] (8.112 ms) : 0, 8112
Telemetry [candidate] (7.877 ms) : 0, 7877
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (790.213 ms) : 0, 790213
BytebuddyAgent [candidate] (777.675 ms) : 0, 777675
GlobalTracer [baseline] (300.574 ms) : 0, 300574
GlobalTracer [candidate] (296.25 ms) : 0, 296250
AppSec [baseline] (49.729 ms) : 0, 49729
AppSec [candidate] (50.623 ms) : 0, 50623
IAST [baseline] (25.877 ms) : 0, 25877
IAST [candidate] (25.043 ms) : 0, 25043
Remote Config [baseline] (639.739 µs) : 0, 640
Remote Config [candidate] (595.799 µs) : 0, 596
Telemetry [baseline] (8.376 ms) : 0, 8376
Telemetry [candidate] (6.976 ms) : 0, 6976
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.39.0-SNAPSHOT~e149ea1282, baseline=1.39.0-SNAPSHOT~93ecbc62b2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.048 s) : 0, 1047902
Total [baseline] (10.412 s) : 0, 10411755
Agent [candidate] (1.047 s) : 0, 1046844
Total [candidate] (10.345 s) : 0, 10344835
section appsec
Agent [baseline] (1.174 s) : 0, 1174032
Total [baseline] (10.517 s) : 0, 10516820
Agent [candidate] (1.168 s) : 0, 1167825
Total [candidate] (10.498 s) : 0, 10497538
section iast
Agent [baseline] (1.175 s) : 0, 1174795
Total [baseline] (10.782 s) : 0, 10782486
Agent [candidate] (1.178 s) : 0, 1177925
Total [candidate] (10.827 s) : 0, 10827192
section profiling
Agent [baseline] (1.245 s) : 0, 1244783
Total [baseline] (10.525 s) : 0, 10525236
Agent [candidate] (1.246 s) : 0, 1246279
Total [candidate] (10.612 s) : 0, 10612297
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.048 s -
Agent appsec 1.174 s 126.129 ms (12.0%)
Agent iast 1.175 s 126.893 ms (12.1%)
Agent profiling 1.245 s 196.881 ms (18.8%)
Total tracing 10.412 s -
Total appsec 10.517 s 105.065 ms (1.0%)
Total iast 10.782 s 370.73 ms (3.6%)
Total profiling 10.525 s 113.481 ms (1.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent appsec 1.168 s 120.981 ms (11.6%)
Agent iast 1.178 s 131.08 ms (12.5%)
Agent profiling 1.246 s 199.435 ms (19.1%)
Total tracing 10.345 s -
Total appsec 10.498 s 152.703 ms (1.5%)
Total iast 10.827 s 482.357 ms (4.7%)
Total profiling 10.612 s 267.462 ms (2.6%)
gantt
    title petclinic - break down per module: candidate=1.39.0-SNAPSHOT~e149ea1282, baseline=1.39.0-SNAPSHOT~93ecbc62b2

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (668.419 ms) : 0, 668419
BytebuddyAgent [candidate] (667.521 ms) : 0, 667521
GlobalTracer [baseline] (306.887 ms) : 0, 306887
GlobalTracer [candidate] (306.574 ms) : 0, 306574
AppSec [baseline] (51.021 ms) : 0, 51021
AppSec [candidate] (51.222 ms) : 0, 51222
Remote Config [baseline] (690.223 µs) : 0, 690
Remote Config [candidate] (673.869 µs) : 0, 674
Telemetry [baseline] (7.458 ms) : 0, 7458
Telemetry [candidate] (7.452 ms) : 0, 7452
section appsec
BytebuddyAgent [baseline] (681.111 ms) : 0, 681111
BytebuddyAgent [candidate] (677.019 ms) : 0, 677019
GlobalTracer [baseline] (302.126 ms) : 0, 302126
GlobalTracer [candidate] (299.559 ms) : 0, 299559
AppSec [baseline] (157.255 ms) : 0, 157255
AppSec [candidate] (156.386 ms) : 0, 156386
IAST [baseline] (21.824 ms) : 0, 21824
IAST [candidate] (22.779 ms) : 0, 22779
Remote Config [baseline] (608.67 µs) : 0, 609
Remote Config [candidate] (604.481 µs) : 0, 604
Telemetry [baseline] (8.474 ms) : 0, 8474
Telemetry [candidate] (9.372 ms) : 0, 9372
section iast
BytebuddyAgent [baseline] (782.14 ms) : 0, 782140
BytebuddyAgent [candidate] (783.496 ms) : 0, 783496
GlobalTracer [baseline] (295.982 ms) : 0, 295982
GlobalTracer [candidate] (296.981 ms) : 0, 296981
AppSec [baseline] (53.085 ms) : 0, 53085
AppSec [candidate] (53.095 ms) : 0, 53095
IAST [baseline] (22.382 ms) : 0, 22382
IAST [candidate] (21.634 ms) : 0, 21634
Remote Config [baseline] (568.856 µs) : 0, 569
Remote Config [candidate] (585.126 µs) : 0, 585
Telemetry [baseline] (7.14 ms) : 0, 7140
Telemetry [candidate] (8.613 ms) : 0, 8613
section profiling
BytebuddyAgent [baseline] (663.051 ms) : 0, 663051
BytebuddyAgent [candidate] (663.009 ms) : 0, 663009
GlobalTracer [baseline] (389.705 ms) : 0, 389705
GlobalTracer [candidate] (390.36 ms) : 0, 390360
AppSec [baseline] (52.554 ms) : 0, 52554
AppSec [candidate] (52.627 ms) : 0, 52627
Remote Config [baseline] (680.091 µs) : 0, 680
Remote Config [candidate] (689.587 µs) : 0, 690
Telemetry [baseline] (7.395 ms) : 0, 7395
Telemetry [candidate] (7.365 ms) : 0, 7365
ProfilingAgent [baseline] (94.264 ms) : 0, 94264
ProfilingAgent [candidate] (95.057 ms) : 0, 95057
Profiling [baseline] (94.289 ms) : 0, 94289
Profiling [candidate] (95.082 ms) : 0, 95082
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-08-12T13:22:03 2024-08-12T13:28:49
git_branch master ci/update-gradle-dependencies-20240811
git_commit_date 1723457525 1723468095
git_commit_sha 93ecbc6 e149ea1
release_version 1.39.0-SNAPSHOT~93ecbc62b2 1.39.0-SNAPSHOT~e149ea1282
start_time 2024-08-12T13:21:50 2024-08-12T13:28:36
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1723469673 1723469673
ci_job_id 601708779 601708779
ci_pipeline_id 41461327 41461327
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~e149ea1282, baseline=1.39.0-SNAPSHOT~93ecbc62b2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.318 ms) : 1299, 1337
.   : milestone, 1318,
appsec (1.711 ms) : 1688, 1735
.   : milestone, 1711,
appsec_no_iast (1.683 ms) : 1658, 1708
.   : milestone, 1683,
iast (1.466 ms) : 1444, 1488
.   : milestone, 1466,
profiling (1.476 ms) : 1451, 1500
.   : milestone, 1476,
tracing (1.454 ms) : 1430, 1477
.   : milestone, 1454,
section candidate
no_agent (1.346 ms) : 1326, 1366
.   : milestone, 1346,
appsec (1.715 ms) : 1692, 1739
.   : milestone, 1715,
appsec_no_iast (1.69 ms) : 1666, 1714
.   : milestone, 1690,
iast (1.478 ms) : 1455, 1501
.   : milestone, 1478,
profiling (1.497 ms) : 1474, 1521
.   : milestone, 1497,
tracing (1.443 ms) : 1418, 1467
.   : milestone, 1443,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.318 ms [1.299 ms, 1.337 ms] -
appsec 1.711 ms [1.688 ms, 1.735 ms] 393.408 µs (29.9%)
appsec_no_iast 1.683 ms [1.658 ms, 1.708 ms] 365.616 µs (27.7%)
iast 1.466 ms [1.444 ms, 1.488 ms] 147.905 µs (11.2%)
profiling 1.476 ms [1.451 ms, 1.5 ms] 157.875 µs (12.0%)
tracing 1.454 ms [1.43 ms, 1.477 ms] 135.827 µs (10.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.346 ms [1.326 ms, 1.366 ms] -
appsec 1.715 ms [1.692 ms, 1.739 ms] 369.689 µs (27.5%)
appsec_no_iast 1.69 ms [1.666 ms, 1.714 ms] 344.231 µs (25.6%)
iast 1.478 ms [1.455 ms, 1.501 ms] 131.957 µs (9.8%)
profiling 1.497 ms [1.474 ms, 1.521 ms] 151.713 µs (11.3%)
tracing 1.443 ms [1.418 ms, 1.467 ms] 96.893 µs (7.2%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~e149ea1282, baseline=1.39.0-SNAPSHOT~93ecbc62b2
    dateFormat X
    axisFormat %s
section baseline
no_agent (362.177 µs) : 342, 383
.   : milestone, 362,
iast (478.452 µs) : 457, 500
.   : milestone, 478,
iast_FULL (551.845 µs) : 529, 574
.   : milestone, 552,
iast_GLOBAL (501.703 µs) : 480, 524
.   : milestone, 502,
iast_HARDCODED_SECRET_DISABLED (477.687 µs) : 457, 499
.   : milestone, 478,
iast_INACTIVE (455.719 µs) : 433, 479
.   : milestone, 456,
iast_TELEMETRY_OFF (473.939 µs) : 452, 496
.   : milestone, 474,
tracing (432.207 µs) : 412, 453
.   : milestone, 432,
section candidate
no_agent (371.623 µs) : 352, 391
.   : milestone, 372,
iast (477.337 µs) : 456, 499
.   : milestone, 477,
iast_FULL (550.657 µs) : 528, 573
.   : milestone, 551,
iast_GLOBAL (511.077 µs) : 488, 534
.   : milestone, 511,
iast_HARDCODED_SECRET_DISABLED (477.146 µs) : 456, 498
.   : milestone, 477,
iast_INACTIVE (450.902 µs) : 428, 473
.   : milestone, 451,
iast_TELEMETRY_OFF (468.022 µs) : 447, 489
.   : milestone, 468,
tracing (431.919 µs) : 412, 452
.   : milestone, 432,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 362.177 µs [341.754 µs, 382.601 µs] -
iast 478.452 µs [457.087 µs, 499.817 µs] 116.275 µs (32.1%)
iast_FULL 551.845 µs [529.286 µs, 574.403 µs] 189.667 µs (52.4%)
iast_GLOBAL 501.703 µs [479.57 µs, 523.836 µs] 139.526 µs (38.5%)
iast_HARDCODED_SECRET_DISABLED 477.687 µs [456.679 µs, 498.696 µs] 115.51 µs (31.9%)
iast_INACTIVE 455.719 µs [432.887 µs, 478.551 µs] 93.542 µs (25.8%)
iast_TELEMETRY_OFF 473.939 µs [452.075 µs, 495.803 µs] 111.762 µs (30.9%)
tracing 432.207 µs [411.774 µs, 452.64 µs] 70.03 µs (19.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 371.623 µs [352.008 µs, 391.237 µs] -
iast 477.337 µs [456.104 µs, 498.569 µs] 105.714 µs (28.4%)
iast_FULL 550.657 µs [528.183 µs, 573.131 µs] 179.034 µs (48.2%)
iast_GLOBAL 511.077 µs [488.073 µs, 534.082 µs] 139.455 µs (37.5%)
iast_HARDCODED_SECRET_DISABLED 477.146 µs [456.022 µs, 498.27 µs] 105.523 µs (28.4%)
iast_INACTIVE 450.902 µs [428.485 µs, 473.318 µs] 79.279 µs (21.3%)
iast_TELEMETRY_OFF 468.022 µs [446.653 µs, 489.39 µs] 96.399 µs (25.9%)
tracing 431.919 µs [411.988 µs, 451.85 µs] 60.296 µs (16.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20240811
git_commit_date 1723457525 1723468095
git_commit_sha 93ecbc6 e149ea1
release_version 1.39.0-SNAPSHOT~93ecbc62b2 1.39.0-SNAPSHOT~e149ea1282
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1723470219 1723470219
ci_job_id 601708781 601708781
ci_pipeline_id 41461327 41461327
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~e149ea1282, baseline=1.39.0-SNAPSHOT~93ecbc62b2
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.098 s) : 15098000, 15098000
.   : milestone, 15098000,
appsec (15.271 s) : 15271000, 15271000
.   : milestone, 15271000,
iast (18.946 s) : 18946000, 18946000
.   : milestone, 18946000,
iast_GLOBAL (17.902 s) : 17902000, 17902000
.   : milestone, 17902000,
profiling (15.282 s) : 15282000, 15282000
.   : milestone, 15282000,
tracing (15.176 s) : 15176000, 15176000
.   : milestone, 15176000,
section candidate
no_agent (14.992 s) : 14992000, 14992000
.   : milestone, 14992000,
appsec (15.113 s) : 15113000, 15113000
.   : milestone, 15113000,
iast (18.959 s) : 18959000, 18959000
.   : milestone, 18959000,
iast_GLOBAL (17.888 s) : 17888000, 17888000
.   : milestone, 17888000,
profiling (14.947 s) : 14947000, 14947000
.   : milestone, 14947000,
tracing (15.012 s) : 15012000, 15012000
.   : milestone, 15012000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.098 s [15.098 s, 15.098 s] -
appsec 15.271 s [15.271 s, 15.271 s] 173.0 ms (1.1%)
iast 18.946 s [18.946 s, 18.946 s] 3.848 s (25.5%)
iast_GLOBAL 17.902 s [17.902 s, 17.902 s] 2.804 s (18.6%)
profiling 15.282 s [15.282 s, 15.282 s] 184.0 ms (1.2%)
tracing 15.176 s [15.176 s, 15.176 s] 78.0 ms (0.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.992 s [14.992 s, 14.992 s] -
appsec 15.113 s [15.113 s, 15.113 s] 121.0 ms (0.8%)
iast 18.959 s [18.959 s, 18.959 s] 3.967 s (26.5%)
iast_GLOBAL 17.888 s [17.888 s, 17.888 s] 2.896 s (19.3%)
profiling 14.947 s [14.947 s, 14.947 s] -45.0 ms (-0.3%)
tracing 15.012 s [15.012 s, 15.012 s] 20.0 ms (0.1%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~e149ea1282, baseline=1.39.0-SNAPSHOT~93ecbc62b2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.457 ms) : 1446, 1469
.   : milestone, 1457,
appsec (2.196 ms) : 2162, 2231
.   : milestone, 2196,
iast (1.986 ms) : 1942, 2030
.   : milestone, 1986,
iast_GLOBAL (2.022 ms) : 1978, 2067
.   : milestone, 2022,
profiling (1.845 ms) : 1811, 1879
.   : milestone, 1845,
tracing (1.836 ms) : 1802, 1869
.   : milestone, 1836,
section candidate
no_agent (1.454 ms) : 1442, 1465
.   : milestone, 1454,
appsec (2.211 ms) : 2176, 2247
.   : milestone, 2211,
iast (1.962 ms) : 1920, 2004
.   : milestone, 1962,
iast_GLOBAL (2.015 ms) : 1971, 2058
.   : milestone, 2015,
profiling (1.847 ms) : 1812, 1882
.   : milestone, 1847,
tracing (1.829 ms) : 1796, 1862
.   : milestone, 1829,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.457 ms [1.446 ms, 1.469 ms] -
appsec 2.196 ms [2.162 ms, 2.231 ms] 738.884 µs (50.7%)
iast 1.986 ms [1.942 ms, 2.03 ms] 528.582 µs (36.3%)
iast_GLOBAL 2.022 ms [1.978 ms, 2.067 ms] 564.918 µs (38.8%)
profiling 1.845 ms [1.811 ms, 1.879 ms] 387.535 µs (26.6%)
tracing 1.836 ms [1.802 ms, 1.869 ms] 378.533 µs (26.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.454 ms [1.442 ms, 1.465 ms] -
appsec 2.211 ms [2.176 ms, 2.247 ms] 757.54 µs (52.1%)
iast 1.962 ms [1.92 ms, 2.004 ms] 508.202 µs (35.0%)
iast_GLOBAL 2.015 ms [1.971 ms, 2.058 ms] 560.856 µs (38.6%)
profiling 1.847 ms [1.812 ms, 1.882 ms] 392.885 µs (27.0%)
tracing 1.829 ms [1.796 ms, 1.862 ms] 375.276 µs (25.8%)

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Aug 11, 2024

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20240811
git_commit_date 1723229801 1723468095
git_commit_sha 67ad13b e149ea1
See matching parameters
Baseline Candidate
ci_job_date 1723469315 1723469315
ci_job_id 601708784 601708784
ci_pipeline_id 41461327 41461327
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.21 11.0.21
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.21+9-post-Ubuntu-0ubuntu122.04 11.0.21+9-post-Ubuntu-0ubuntu122.04

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 2 metrics, 0 unstable metrics.

scenario Δ mean throughput
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce better
[+2212.930op/s; +5812.648op/s] or [+1.859%; +4.882%]
See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Aug 11, 2024

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20240811
git_commit_date 1723229801 1723468095
git_commit_sha 67ad13b e149ea1
See matching parameters
Baseline Candidate
ci_job_date 1723469352 1723469352
ci_job_id 601708786 601708786
ci_pipeline_id 41461327 41461327
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.21 11.0.21
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.21+9-post-Ubuntu-0ubuntu122.04 11.0.21+9-post-Ubuntu-0ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume unsure
[-13283.966op/s; -2871.642op/s] or [-4.170%; -0.901%]
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume unsure
[+91.058op/s; +4156.842op/s] or [+0.052%; +2.395%]

@amarziali amarziali merged commit c39de5e into master Aug 14, 2024
@amarziali amarziali deleted the ci/update-gradle-dependencies-20240811 branch August 14, 2024 10:15
@github-actions github-actions Bot added this to the 1.39.0 milestone Aug 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants