Skip to content

Migrate Maven instrumentation and Utf8Cache tests to JUnit 5 #9568

Merged
daniel-mohedano merged 5 commits intomasterfrom
daniel.mohedano/maven-instrumentation-junit5
Sep 22, 2025
Merged

Migrate Maven instrumentation and Utf8Cache tests to JUnit 5 #9568
daniel-mohedano merged 5 commits intomasterfrom
daniel.mohedano/maven-instrumentation-junit5

Conversation

@daniel-mohedano
Copy link
Copy Markdown
Contributor

@daniel-mohedano daniel-mohedano commented Sep 19, 2025

What Does This Do

  • Migrate tests still using JUnit 4's org.junit.test to JUnit 5.

Motivation

  • Without these changes, the tests were not being discovered by Gradle and not run.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@daniel-mohedano daniel-mohedano added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Sep 19, 2025
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Sep 19, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/maven-instrumentation-junit5
git_commit_date 1758286417 1758291697
git_commit_sha abb87ab 67f1cf7
release_version 1.54.0-SNAPSHOT~abb87aba78 1.54.0-SNAPSHOT~67f1cf75fc
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1758293488 1758293488
ci_job_id 1138413726 1138413726
ci_pipeline_id 76992472 76992472
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-4b4z2fcf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-4b4z2fcf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 2 performance improvements and 13 performance regressions! Performance is the same for 32 metrics, 12 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent.start worse
[+31.885ms; +43.689ms] or [+2.764%; +3.787%]		 1.191s 1.154s
scenario:startup:insecure-bank:iast:BytebuddyAgent worse
[+40.124ms; +48.559ms] or [+4.962%; +6.005%]		 853.031ms 808.690ms
scenario:startup:insecure-bank:tracing:Agent.start worse
[+34.994ms; +67.105ms] or [+3.439%; +6.594%]		 1.069s 1.018s
scenario:startup:insecure-bank:tracing:BytebuddyAgent worse
[+36.526ms; +61.401ms] or [+5.305%; +8.918%]		 737.463ms 688.499ms
scenario:startup:petclinic:appsec:BytebuddyAgent worse
[+29.678ms; +50.376ms] or [+4.139%; +7.025%]		 757.122ms 717.095ms
scenario:startup:petclinic:appsec:IAST better
[-1.551ms; -0.703ms] or [-6.226%; -2.822%]		 23.779ms 24.906ms
scenario:startup:petclinic:iast:Agent.start worse
[+32.341ms; +42.244ms] or [+2.803%; +3.662%]		 1.191s 1.154s
scenario:startup:petclinic:iast:BytebuddyAgent worse
[+41.041ms; +47.827ms] or [+5.078%; +5.918%]		 852.587ms 808.153ms
scenario:startup:petclinic:profiling:Agent.start worse
[+36.845ms; +64.139ms] or [+3.162%; +5.504%]		 1.216s 1.165s
scenario:startup:petclinic:profiling:ProfilingAgent worse
[+5.906ms; +7.766ms] or [+5.814%; +7.645%]		 108.417ms 101.581ms
scenario:startup:petclinic:profiling:BytebuddyAgent worse
[+36.409ms; +55.691ms] or [+5.059%; +7.738%]		 765.767ms 719.717ms
scenario:startup:petclinic:profiling:Profiling worse
[+6.000ms; +7.829ms] or [+5.872%; +7.662%]		 109.097ms 102.182ms
scenario:startup:petclinic:tracing:Agent.start worse
[+21.296ms; +49.391ms] or [+2.080%; +4.824%]		 1.059s 1.024s
scenario:startup:petclinic:tracing:BytebuddyAgent worse
[+29.571ms; +48.997ms] or [+4.274%; +7.081%]		 731.232ms 691.948ms
scenario:startup:petclinic:tracing:AppSec better
[-1.987ms; -0.907ms] or [-6.216%; -2.838%]		 30.527ms 31.974ms
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~67f1cf75fc, baseline=1.54.0-SNAPSHOT~abb87aba78

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.018 s) : 0, 1017669
Total [baseline] (8.625 s) : 0, 8624982
Agent [candidate] (1.069 s) : 0, 1068718
Total [candidate] (8.632 s) : 0, 8632171
section iast
Agent [baseline] (1.154 s) : 0, 1153561
Total [baseline] (9.388 s) : 0, 9387885
Agent [candidate] (1.191 s) : 0, 1191348
Total [candidate] (9.284 s) : 0, 9284129
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.018 s -
Agent iast 1.154 s 135.892 ms (13.4%)
Total tracing 8.625 s -
Total iast 9.388 s 762.902 ms (8.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent iast 1.191 s 122.63 ms (11.5%)
Total tracing 8.632 s -
Total iast 9.284 s 651.958 ms (7.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~67f1cf75fc, baseline=1.54.0-SNAPSHOT~abb87aba78

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.465 ms) : 0, 1465
crashtracking [candidate] (1.464 ms) : 0, 1464
BytebuddyAgent [baseline] (688.499 ms) : 0, 688499
BytebuddyAgent [candidate] (737.463 ms) : 0, 737463
GlobalTracer [baseline] (257.789 ms) : 0, 257789
GlobalTracer [candidate] (254.346 ms) : 0, 254346
AppSec [baseline] (31.581 ms) : 0, 31581
AppSec [candidate] (30.762 ms) : 0, 30762
Debugger [baseline] (6.344 ms) : 0, 6344
Debugger [candidate] (6.413 ms) : 0, 6413
Remote Config [baseline] (684.271 µs) : 0, 684
Remote Config [candidate] (700.633 µs) : 0, 701
Telemetry [baseline] (10.334 ms) : 0, 10334
Telemetry [candidate] (16.488 ms) : 0, 16488
section iast
crashtracking [baseline] (1.455 ms) : 0, 1455
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (808.69 ms) : 0, 808690
BytebuddyAgent [candidate] (853.031 ms) : 0, 853031
GlobalTracer [baseline] (248.933 ms) : 0, 248933
GlobalTracer [candidate] (249.192 ms) : 0, 249192
IAST [baseline] (30.661 ms) : 0, 30661
IAST [candidate] (25.39 ms) : 0, 25390
AppSec [baseline] (28.07 ms) : 0, 28070
AppSec [candidate] (26.364 ms) : 0, 26364
Debugger [baseline] (6.128 ms) : 0, 6128
Debugger [candidate] (6.036 ms) : 0, 6036
Remote Config [baseline] (600.346 µs) : 0, 600
Remote Config [candidate] (596.771 µs) : 0, 597
Telemetry [baseline] (8.134 ms) : 0, 8134
Telemetry [candidate] (8.242 ms) : 0, 8242
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~67f1cf75fc, baseline=1.54.0-SNAPSHOT~abb87aba78

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.024 s) : 0, 1023880
Total [baseline] (10.743 s) : 0, 10743407
Agent [candidate] (1.059 s) : 0, 1059224
Total [candidate] (10.695 s) : 0, 10694932
section appsec
Agent [baseline] (1.205 s) : 0, 1204806
Total [baseline] (11.031 s) : 0, 11030502
Agent [candidate] (1.237 s) : 0, 1237174
Total [candidate] (11.108 s) : 0, 11108035
section iast
Agent [baseline] (1.154 s) : 0, 1153683
Total [baseline] (11.068 s) : 0, 11067536
Agent [candidate] (1.191 s) : 0, 1190976
Total [candidate] (11.065 s) : 0, 11064913
section profiling
Agent [baseline] (1.165 s) : 0, 1165265
Total [baseline] (11.06 s) : 0, 11059962
Agent [candidate] (1.216 s) : 0, 1215757
Total [candidate] (10.95 s) : 0, 10949757
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.024 s -
Agent appsec 1.205 s 180.926 ms (17.7%)
Agent iast 1.154 s 129.803 ms (12.7%)
Agent profiling 1.165 s 141.384 ms (13.8%)
Total tracing 10.743 s -
Total appsec 11.031 s 287.095 ms (2.7%)
Total iast 11.068 s 324.129 ms (3.0%)
Total profiling 11.06 s 316.555 ms (2.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.237 s 177.95 ms (16.8%)
Agent iast 1.191 s 131.752 ms (12.4%)
Agent profiling 1.216 s 156.533 ms (14.8%)
Total tracing 10.695 s -
Total appsec 11.108 s 413.103 ms (3.9%)
Total iast 11.065 s 369.981 ms (3.5%)
Total profiling 10.95 s 254.825 ms (2.4%) 
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~67f1cf75fc, baseline=1.54.0-SNAPSHOT~abb87aba78

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.476 ms) : 0, 1476
crashtracking [candidate] (1.448 ms) : 0, 1448
BytebuddyAgent [baseline] (691.948 ms) : 0, 691948
BytebuddyAgent [candidate] (731.232 ms) : 0, 731232
GlobalTracer [baseline] (260.493 ms) : 0, 260493
GlobalTracer [candidate] (252.641 ms) : 0, 252641
AppSec [baseline] (31.974 ms) : 0, 31974
AppSec [candidate] (30.527 ms) : 0, 30527
Debugger [baseline] (6.374 ms) : 0, 6374
Debugger [candidate] (6.378 ms) : 0, 6378
Remote Config [baseline] (692.295 µs) : 0, 692
Remote Config [candidate] (684.863 µs) : 0, 685
Telemetry [baseline] (9.74 ms) : 0, 9740
Telemetry [candidate] (15.343 ms) : 0, 15343
section appsec
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.44 ms) : 0, 1440
BytebuddyAgent [baseline] (717.095 ms) : 0, 717095
BytebuddyAgent [candidate] (757.122 ms) : 0, 757122
GlobalTracer [baseline] (252.462 ms) : 0, 252462
GlobalTracer [candidate] (246.821 ms) : 0, 246821
IAST [baseline] (24.906 ms) : 0, 24906
IAST [candidate] (23.779 ms) : 0, 23779
AppSec [baseline] (170.214 ms) : 0, 170214
AppSec [candidate] (171.594 ms) : 0, 171594
Debugger [baseline] (6.124 ms) : 0, 6124
Debugger [candidate] (6.023 ms) : 0, 6023
Remote Config [baseline] (624.164 µs) : 0, 624
Remote Config [candidate] (636.852 µs) : 0, 637
Telemetry [baseline] (10.727 ms) : 0, 10727
Telemetry [candidate] (8.58 ms) : 0, 8580
section iast
crashtracking [baseline] (1.463 ms) : 0, 1463
crashtracking [candidate] (1.457 ms) : 0, 1457
BytebuddyAgent [baseline] (808.153 ms) : 0, 808153
BytebuddyAgent [candidate] (852.587 ms) : 0, 852587
GlobalTracer [baseline] (249.469 ms) : 0, 249469
GlobalTracer [candidate] (246.674 ms) : 0, 246674
IAST [baseline] (31.468 ms) : 0, 31468
IAST [candidate] (27.289 ms) : 0, 27289
AppSec [baseline] (26.428 ms) : 0, 26428
AppSec [candidate] (26.95 ms) : 0, 26950
Debugger [baseline] (6.161 ms) : 0, 6161
Debugger [candidate] (6.032 ms) : 0, 6032
Remote Config [baseline] (597.003 µs) : 0, 597
Remote Config [candidate] (602.136 µs) : 0, 602
Telemetry [baseline] (8.958 ms) : 0, 8958
Telemetry [candidate] (8.359 ms) : 0, 8359
section profiling
crashtracking [baseline] (1.443 ms) : 0, 1443
crashtracking [candidate] (1.442 ms) : 0, 1442
BytebuddyAgent [baseline] (719.717 ms) : 0, 719717
BytebuddyAgent [candidate] (765.767 ms) : 0, 765767
GlobalTracer [baseline] (236.688 ms) : 0, 236688
GlobalTracer [candidate] (234.452 ms) : 0, 234452
AppSec [baseline] (31.117 ms) : 0, 31117
AppSec [candidate] (30.31 ms) : 0, 30310
Debugger [baseline] (6.514 ms) : 0, 6514
Debugger [candidate] (12.956 ms) : 0, 12956
Remote Config [baseline] (719.747 µs) : 0, 720
Remote Config [candidate] (1.577 ms) : 0, 1577
Telemetry [baseline] (16.504 ms) : 0, 16504
Telemetry [candidate] (9.476 ms) : 0, 9476
ProfilingAgent [baseline] (101.581 ms) : 0, 101581
ProfilingAgent [candidate] (108.417 ms) : 0, 108417
Profiling [baseline] (102.182 ms) : 0, 102182
Profiling [candidate] (109.097 ms) : 0, 109097
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/maven-instrumentation-junit5
git_commit_date 1758286417 1758291697
git_commit_sha abb87ab 67f1cf7
release_version 1.54.0-SNAPSHOT~abb87aba78 1.54.0-SNAPSHOT~67f1cf75fc
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1758293162 1758293162
ci_job_id 1138413728 1138413728
ci_pipeline_id 76992472 76992472
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-zcwixfw2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-zcwixfw2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:tracing:high_load worse
[+208.919µs; +450.543µs] or [+2.745%; +5.920%]		 unstable
[-98.178op/s; +48.303op/s] or [-16.136%; +7.939%]		 7.940ms 583.500op/s 7.610ms 608.438op/s
scenario:load:insecure-bank:profiling:high_load better
[-508.807µs; -192.518µs] or [-5.491%; -2.078%]		 unstable
[-44.520op/s; +83.145op/s] or [-8.888%; +16.599%]		 8.915ms 520.219op/s 9.266ms 500.906op/s
scenario:load:insecure-bank:no_agent:high_load worse
[+218.913µs; +327.713µs] or [+5.290%; +7.919%]		 unstable
[-184.633op/s; +49.820op/s] or [-16.667%; +4.497%]		 4.412ms 1040.344op/s 4.138ms 1107.750op/s
scenario:load:insecure-bank:iast:high_load better
[-1083.802µs; -706.392µs] or [-10.261%; -6.688%]		 unstable
[-14.025op/s; +94.650op/s] or [-3.187%; +21.508%]		 9.667ms 480.375op/s 10.562ms 440.062op/s
scenario:load:insecure-bank:iast_FULL:high_load better
[-981.161µs; -352.886µs] or [-6.603%; -2.375%]		 unstable
[-22.283op/s; +51.533op/s] or [-7.104%; +16.428%]		 14.193ms 328.312op/s 14.860ms 313.688op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~67f1cf75fc, baseline=1.54.0-SNAPSHOT~abb87aba78
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.138 ms) : 4089, 4187
.   : milestone, 4138,
iast (10.562 ms) : 10373, 10751
.   : milestone, 10562,
iast_FULL (14.86 ms) : 14565, 15155
.   : milestone, 14860,
iast_GLOBAL (10.941 ms) : 10747, 11134
.   : milestone, 10941,
profiling (9.266 ms) : 9118, 9414
.   : milestone, 9266,
tracing (7.61 ms) : 7501, 7719
.   : milestone, 7610,
section candidate
no_agent (4.412 ms) : 4360, 4463
.   : milestone, 4412,
iast (9.667 ms) : 9506, 9828
.   : milestone, 9667,
iast_FULL (14.193 ms) : 13905, 14482
.   : milestone, 14193,
iast_GLOBAL (10.626 ms) : 10426, 10826
.   : milestone, 10626,
profiling (8.915 ms) : 8769, 9061
.   : milestone, 8915,
tracing (7.94 ms) : 7824, 8056
.   : milestone, 7940,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.138 ms [4.089 ms, 4.187 ms] -
iast 10.562 ms [10.373 ms, 10.751 ms] 6.424 ms (155.2%)
iast_FULL 14.86 ms [14.565 ms, 15.155 ms] 10.722 ms (259.1%)
iast_GLOBAL 10.941 ms [10.747 ms, 11.134 ms] 6.803 ms (164.4%)
profiling 9.266 ms [9.118 ms, 9.414 ms] 5.128 ms (123.9%)
tracing 7.61 ms [7.501 ms, 7.719 ms] 3.472 ms (83.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.412 ms [4.36 ms, 4.463 ms] -
iast 9.667 ms [9.506 ms, 9.828 ms] 5.255 ms (119.1%)
iast_FULL 14.193 ms [13.905 ms, 14.482 ms] 9.782 ms (221.7%)
iast_GLOBAL 10.626 ms [10.426 ms, 10.826 ms] 6.215 ms (140.9%)
profiling 8.915 ms [8.769 ms, 9.061 ms] 4.504 ms (102.1%)
tracing 7.94 ms [7.824 ms, 8.056 ms] 3.528 ms (80.0%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~67f1cf75fc, baseline=1.54.0-SNAPSHOT~abb87aba78
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.77 ms) : 36469, 37071
.   : milestone, 36770,
appsec (48.788 ms) : 48355, 49221
.   : milestone, 48788,
code_origins (45.642 ms) : 45244, 46040
.   : milestone, 45642,
iast (44.922 ms) : 44513, 45331
.   : milestone, 44922,
profiling (50.024 ms) : 49496, 50552
.   : milestone, 50024,
tracing (44.548 ms) : 44170, 44925
.   : milestone, 44548,
section candidate
no_agent (36.627 ms) : 36335, 36918
.   : milestone, 36627,
appsec (48.44 ms) : 48014, 48866
.   : milestone, 48440,
code_origins (45.869 ms) : 45469, 46269
.   : milestone, 45869,
iast (44.384 ms) : 43995, 44773
.   : milestone, 44384,
profiling (48.498 ms) : 48029, 48966
.   : milestone, 48498,
tracing (43.85 ms) : 43468, 44232
.   : milestone, 43850,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.77 ms [36.469 ms, 37.071 ms] -
appsec 48.788 ms [48.355 ms, 49.221 ms] 12.018 ms (32.7%)
code_origins 45.642 ms [45.244 ms, 46.04 ms] 8.872 ms (24.1%)
iast 44.922 ms [44.513 ms, 45.331 ms] 8.152 ms (22.2%)
profiling 50.024 ms [49.496 ms, 50.552 ms] 13.254 ms (36.0%)
tracing 44.548 ms [44.17 ms, 44.925 ms] 7.778 ms (21.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.627 ms [36.335 ms, 36.918 ms] -
appsec 48.44 ms [48.014 ms, 48.866 ms] 11.814 ms (32.3%)
code_origins 45.869 ms [45.469 ms, 46.269 ms] 9.242 ms (25.2%)
iast 44.384 ms [43.995 ms, 44.773 ms] 7.757 ms (21.2%)
profiling 48.498 ms [48.029 ms, 48.966 ms] 11.871 ms (32.4%)
tracing 43.85 ms [43.468 ms, 44.232 ms] 7.223 ms (19.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/maven-instrumentation-junit5
git_commit_date 1758286417 1758291697
git_commit_sha abb87ab 67f1cf7
release_version 1.54.0-SNAPSHOT~abb87aba78 1.54.0-SNAPSHOT~67f1cf75fc
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1758293624 1758293624
ci_job_id 1138413729 1138413729
ci_pipeline_id 76992472 76992472
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-ljzhxyku 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-ljzhxyku 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~67f1cf75fc, baseline=1.54.0-SNAPSHOT~abb87aba78
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (2.445 ms) : 2395, 2494
.   : milestone, 2445,
iast (2.201 ms) : 2139, 2264
.   : milestone, 2201,
iast_GLOBAL (2.249 ms) : 2186, 2311
.   : milestone, 2249,
profiling (2.068 ms) : 2016, 2120
.   : milestone, 2068,
tracing (2.038 ms) : 1989, 2087
.   : milestone, 2038,
section candidate
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (3.75 ms) : 3532, 3968
.   : milestone, 3750,
iast (2.214 ms) : 2151, 2277
.   : milestone, 2214,
iast_GLOBAL (2.244 ms) : 2181, 2307
.   : milestone, 2244,
profiling (2.369 ms) : 2225, 2514
.   : milestone, 2369,
tracing (2.038 ms) : 1989, 2088
.   : milestone, 2038,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.468 ms, 1.491 ms] -
appsec 2.445 ms [2.395 ms, 2.494 ms] 965.218 µs (65.2%)
iast 2.201 ms [2.139 ms, 2.264 ms] 721.977 µs (48.8%)
iast_GLOBAL 2.249 ms [2.186 ms, 2.311 ms] 769.2 µs (52.0%)
profiling 2.068 ms [2.016 ms, 2.12 ms] 588.548 µs (39.8%)
tracing 2.038 ms [1.989 ms, 2.087 ms] 558.619 µs (37.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 3.75 ms [3.532 ms, 3.968 ms] 2.276 ms (154.4%)
iast 2.214 ms [2.151 ms, 2.277 ms] 739.905 µs (50.2%)
iast_GLOBAL 2.244 ms [2.181 ms, 2.307 ms] 769.726 µs (52.2%)
profiling 2.369 ms [2.225 ms, 2.514 ms] 895.229 µs (60.7%)
tracing 2.038 ms [1.989 ms, 2.088 ms] 564.042 µs (38.3%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~67f1cf75fc, baseline=1.54.0-SNAPSHOT~abb87aba78
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.395 s) : 15395000, 15395000
.   : milestone, 15395000,
appsec (15.16 s) : 15160000, 15160000
.   : milestone, 15160000,
iast (18.356 s) : 18356000, 18356000
.   : milestone, 18356000,
iast_GLOBAL (18.406 s) : 18406000, 18406000
.   : milestone, 18406000,
profiling (16.01 s) : 16010000, 16010000
.   : milestone, 16010000,
tracing (15.182 s) : 15182000, 15182000
.   : milestone, 15182000,
section candidate
no_agent (14.969 s) : 14969000, 14969000
.   : milestone, 14969000,
appsec (14.946 s) : 14946000, 14946000
.   : milestone, 14946000,
iast (18.92 s) : 18920000, 18920000
.   : milestone, 18920000,
iast_GLOBAL (18.113 s) : 18113000, 18113000
.   : milestone, 18113000,
profiling (15.582 s) : 15582000, 15582000
.   : milestone, 15582000,
tracing (15.065 s) : 15065000, 15065000
.   : milestone, 15065000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.395 s [15.395 s, 15.395 s] -
appsec 15.16 s [15.16 s, 15.16 s] -235.0 ms (-1.5%)
iast 18.356 s [18.356 s, 18.356 s] 2.961 s (19.2%)
iast_GLOBAL 18.406 s [18.406 s, 18.406 s] 3.011 s (19.6%)
profiling 16.01 s [16.01 s, 16.01 s] 615.0 ms (4.0%)
tracing 15.182 s [15.182 s, 15.182 s] -213.0 ms (-1.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.969 s [14.969 s, 14.969 s] -
appsec 14.946 s [14.946 s, 14.946 s] -23.0 ms (-0.2%)
iast 18.92 s [18.92 s, 18.92 s] 3.951 s (26.4%)
iast_GLOBAL 18.113 s [18.113 s, 18.113 s] 3.144 s (21.0%)
profiling 15.582 s [15.582 s, 15.582 s] 613.0 ms (4.1%)
tracing 15.065 s [15.065 s, 15.065 s] 96.0 ms (0.6%)

@daniel-mohedano daniel-mohedano marked this pull request as ready for review September 19, 2025 12:41
@daniel-mohedano daniel-mohedano requested review from a team as code owners September 19, 2025 12:41
@dougqh
Making bigStrings no cache tests more reliable
1d17958 
- updating tests to not use magic number and use MAX_ENTRY_LEN of their respective cache
- had to make MAX_ENTRY_LEN package visible in both caches
@datadog-official
Copy link
Copy Markdown
Contributor

datadog-official Bot commented Sep 19, 2025 •
edited by datadog-datadog-prod-us1 Bot
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 63.14% (+3.36%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 67f1cf7 | Docs | Was this helpful? Give us feedback!

@daniel-mohedano daniel-mohedano changed the title Migrate Maven instrumentation and Ut8Cache tests to JUnit 5 Migrate Maven instrumentation and Utf8Cache tests to JUnit 5 Sep 22, 2025
@daniel-mohedano daniel-mohedano merged commit 942d6b3 into master Sep 22, 2025
504 checks passed
@daniel-mohedano daniel-mohedano deleted the daniel.mohedano/maven-instrumentation-junit5 branch September 22, 2025 08:08
@github-actions github-actions Bot added this to the 1.54.0 milestone Sep 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@amarziali amarziali amarziali approved these changes

@nikita-tkachenko-datadog nikita-tkachenko-datadog nikita-tkachenko-datadog approved these changes

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

@Mariovido Mariovido Awaiting requested review from Mariovido Mariovido was automatically assigned from DataDog/ci-app-libraries-java

Assignees

No one assigned

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.54.0

Development

Successfully merging this pull request may close these issues.

5 participants

@daniel-mohedano @amarziali @nikita-tkachenko-datadog @AlexeyKuznetsov-DD @dougqh