Skip to content

Disable CodeOrigin by default #10027

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
jpbempel merged 1 commit into from
Nov 25, 2025
Merged

Disable CodeOrigin by default #10027

jpbempel merged 1 commit into from
Nov 25, 2025

Conversation

@jpbempel
Copy link
Member

@jpbempel jpbempel commented Nov 25, 2025 •
edited by atlassian bot
Loading

What Does This Do

Motivation

it seems to lead to crashes on JDK8

Additional Notes

Contributor Checklist

Jira ticket: DEBUG-4768

@jpbempel jpbempel added the type: bug Bug report and fix label Nov 25, 2025
@jpbempel jpbempel requested a review from a team as a code owner November 25, 2025 09:15
@jpbempel jpbempel added the comp: debugger Dynamic Instrumentation label Nov 25, 2025
@jpbempel
Disable CodeOrigin by default
353b02e 
it seems to lead to crashes on JDK8
@jpbempel jpbempel force-pushed the jpbempel/disable-code-origin branch from db0ad35 to 353b02e Compare November 25, 2025 09:46
mcculls
mcculls approved these changes Nov 25, 2025
View reviewed changes
Copy link
Contributor

@mcculls mcculls left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

(note you can use the JavaVirtualMachine utility if you want to only disable it on Java 8)

@pr-commenter
Copy link

pr-commenter bot commented Nov 25, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/disable-code-origin
git_commit_date 1763992896 1764063965
git_commit_sha c8bb444 353b02e
release_version 1.57.0-SNAPSHOT~c8bb44440b 1.57.0-SNAPSHOT~353b02e363
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1764074170 1764074170
ci_job_id 1255649177 1255649177
ci_pipeline_id 83915533 83915533
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-73kwnc8n 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-73kwnc8n 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 12 performance improvements and 8 performance regressions! Performance is the same for 33 metrics, 12 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent better
[-262.628ms; -195.129ms] or [-2.759%; -2.050%]		 9.291s 9.520s
scenario:startup:insecure-bank:iast:Agent.start better
[-51.958ms; -41.625ms] or [-4.197%; -3.362%]		 1.191s 1.238s
scenario:startup:insecure-bank:iast:Debugger better
[-54.356ms; -53.138ms] or [-91.004%; -88.964%]		 5.982ms 59.729ms
scenario:startup:insecure-bank:iast:Remote Config worse
[+51.646µs; +80.967µs] or [+9.575%; +15.011%]		 605.685µs 539.378µs
scenario:startup:insecure-bank:iast:Telemetry worse
[+167.043µs; +405.658µs] or [+2.203%; +5.350%]		 7.868ms 7.582ms
scenario:startup:insecure-bank:iast:Flare Poller worse
[+7.282ms; +7.583ms] or [+213.340%; +222.149%]		 10.846ms 3.414ms
scenario:startup:insecure-bank:tracing:Agent.start better
[-56.366ms; -47.378ms] or [-5.115%; -4.300%]		 1.050s 1.102s
scenario:startup:insecure-bank:tracing:Debugger better
[-57.578ms; -56.938ms] or [-90.481%; -89.475%]		 6.377ms 63.635ms
scenario:startup:petclinic:appsec:Agent.start better
[-61.614ms; -27.087ms] or [-4.799%; -2.110%]		 1.239s 1.284s
scenario:startup:petclinic:appsec:Debugger better
[-56.817ms; -54.513ms] or [-91.764%; -88.043%]		 6.251ms 61.916ms
scenario:startup:petclinic:iast:Agent.start better
[-87.538ms; -42.957ms] or [-6.954%; -3.413%]		 1.194s 1.259s
scenario:startup:petclinic:iast:Debugger better
[-56.329ms; -54.171ms] or [-91.905%; -88.383%]		 6.041ms 61.291ms
scenario:startup:petclinic:iast:Remote Config worse
[+24.697µs; +72.301µs] or [+4.431%; +12.971%]		 605.907µs 557.408µs
scenario:startup:petclinic:profiling:ProfilingAgent worse
[+12.656ms; +15.495ms] or [+13.055%; +15.983%]		 111.019ms 96.943ms
scenario:startup:petclinic:profiling:Debugger better
[-57.193ms; -53.759ms] or [-90.425%; -84.996%]		 7.773ms 63.248ms
scenario:startup:petclinic:profiling:Flare Poller worse
[+369.814µs; +543.483µs] or [+9.922%; +14.582%]		 4.184ms 3.727ms
scenario:startup:petclinic:profiling:Profiling worse
[+12.701ms; +15.554ms] or [+13.022%; +15.947%]		 111.660ms 97.532ms
scenario:startup:petclinic:tracing:Agent.start better
[-50.022ms; -43.539ms] or [-4.543%; -3.954%]		 1.054s 1.101s
scenario:startup:petclinic:tracing:Debugger better
[-58.638ms; -57.254ms] or [-91.133%; -88.983%]		 6.397ms 64.343ms
scenario:startup:petclinic:tracing:Remote Config worse
[+34.173µs; +65.085µs] or [+5.414%; +10.311%]		 680.847µs 631.218µs
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~353b02e363, baseline=1.57.0-SNAPSHOT~c8bb44440b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.101 s) : 0, 1101093
Total [baseline] (10.802 s) : 0, 10801780
Agent [candidate] (1.054 s) : 0, 1054313
Total [candidate] (10.908 s) : 0, 10907998
section appsec
Agent [baseline] (1.284 s) : 0, 1283814
Total [baseline] (11.041 s) : 0, 11041041
Agent [candidate] (1.239 s) : 0, 1239464
Total [candidate] (11.0 s) : 0, 11000180
section iast
Agent [baseline] (1.259 s) : 0, 1258781
Total [baseline] (11.341 s) : 0, 11341228
Agent [candidate] (1.194 s) : 0, 1193533
Total [candidate] (11.232 s) : 0, 11231877
section profiling
Agent [baseline] (1.24 s) : 0, 1240045
Total [baseline] (11.173 s) : 0, 11173012
Agent [candidate] (1.204 s) : 0, 1204478
Total [candidate] (10.963 s) : 0, 10962809
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.101 s -
Agent appsec 1.284 s 182.721 ms (16.6%)
Agent iast 1.259 s 157.687 ms (14.3%)
Agent profiling 1.24 s 138.951 ms (12.6%)
Total tracing 10.802 s -
Total appsec 11.041 s 239.261 ms (2.2%)
Total iast 11.341 s 539.448 ms (5.0%)
Total profiling 11.173 s 371.232 ms (3.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.054 s -
Agent appsec 1.239 s 185.151 ms (17.6%)
Agent iast 1.194 s 139.22 ms (13.2%)
Agent profiling 1.204 s 150.165 ms (14.2%)
Total tracing 10.908 s -
Total appsec 11.0 s 92.182 ms (0.8%)
Total iast 11.232 s 323.879 ms (3.0%)
Total profiling 10.963 s 54.811 ms (0.5%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~353b02e363, baseline=1.57.0-SNAPSHOT~c8bb44440b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.488 ms) : 0, 1488
BytebuddyAgent [baseline] (707.074 ms) : 0, 707074
BytebuddyAgent [candidate] (709.1 ms) : 0, 709100
GlobalTracer [baseline] (248.947 ms) : 0, 248947
GlobalTracer [candidate] (249.442 ms) : 0, 249442
AppSec [baseline] (32.061 ms) : 0, 32061
AppSec [candidate] (32.151 ms) : 0, 32151
Debugger [baseline] (64.343 ms) : 0, 64343
Debugger [candidate] (6.397 ms) : 0, 6397
Remote Config [baseline] (631.218 µs) : 0, 631
Remote Config [candidate] (680.847 µs) : 0, 681
Telemetry [baseline] (8.185 ms) : 0, 8185
Telemetry [candidate] (14.731 ms) : 0, 14731
Flare Poller [baseline] (3.69 ms) : 0, 3690
Flare Poller [candidate] (5.544 ms) : 0, 5544
section appsec
crashtracking [baseline] (1.488 ms) : 0, 1488
crashtracking [candidate] (1.506 ms) : 0, 1506
BytebuddyAgent [baseline] (732.415 ms) : 0, 732415
BytebuddyAgent [candidate] (739.982 ms) : 0, 739982
GlobalTracer [baseline] (241.006 ms) : 0, 241006
GlobalTracer [candidate] (243.445 ms) : 0, 243445
IAST [baseline] (24.762 ms) : 0, 24762
IAST [candidate] (25.455 ms) : 0, 25455
AppSec [baseline] (174.091 ms) : 0, 174091
AppSec [candidate] (174.807 ms) : 0, 174807
Debugger [baseline] (61.916 ms) : 0, 61916
Debugger [candidate] (6.251 ms) : 0, 6251
Remote Config [baseline] (690.611 µs) : 0, 691
Remote Config [candidate] (685.795 µs) : 0, 686
Telemetry [baseline] (8.425 ms) : 0, 8425
Telemetry [candidate] (8.117 ms) : 0, 8117
Flare Poller [baseline] (3.996 ms) : 0, 3996
Flare Poller [candidate] (3.981 ms) : 0, 3981
section iast
crashtracking [baseline] (1.509 ms) : 0, 1509
crashtracking [candidate] (1.487 ms) : 0, 1487
BytebuddyAgent [baseline] (847.062 ms) : 0, 847062
BytebuddyAgent [candidate] (832.378 ms) : 0, 832378
GlobalTracer [baseline] (239.598 ms) : 0, 239598
GlobalTracer [candidate] (238.052 ms) : 0, 238052
IAST [baseline] (27.906 ms) : 0, 27906
IAST [candidate] (31.686 ms) : 0, 31686
AppSec [baseline] (34.362 ms) : 0, 34362
AppSec [candidate] (29.762 ms) : 0, 29762
Debugger [baseline] (61.291 ms) : 0, 61291
Debugger [candidate] (6.041 ms) : 0, 6041
Remote Config [baseline] (557.408 µs) : 0, 557
Remote Config [candidate] (605.907 µs) : 0, 606
Telemetry [baseline] (7.667 ms) : 0, 7667
Telemetry [candidate] (7.938 ms) : 0, 7938
Flare Poller [baseline] (3.551 ms) : 0, 3551
Flare Poller [candidate] (10.789 ms) : 0, 10789
section profiling
crashtracking [baseline] (1.468 ms) : 0, 1468
crashtracking [candidate] (1.439 ms) : 0, 1439
BytebuddyAgent [baseline] (739.937 ms) : 0, 739937
BytebuddyAgent [candidate] (737.995 ms) : 0, 737995
GlobalTracer [baseline] (223.944 ms) : 0, 223944
GlobalTracer [candidate] (223.825 ms) : 0, 223825
AppSec [baseline] (32.633 ms) : 0, 32633
AppSec [candidate] (32.529 ms) : 0, 32529
Debugger [baseline] (63.248 ms) : 0, 63248
Debugger [candidate] (7.773 ms) : 0, 7773
Remote Config [baseline] (671.942 µs) : 0, 672
Remote Config [candidate] (746.428 µs) : 0, 746
Telemetry [baseline] (8.013 ms) : 0, 8013
Telemetry [candidate] (15.496 ms) : 0, 15496
Flare Poller [baseline] (3.727 ms) : 0, 3727
Flare Poller [candidate] (4.184 ms) : 0, 4184
ProfilingAgent [baseline] (96.943 ms) : 0, 96943
ProfilingAgent [candidate] (111.019 ms) : 0, 111019
Profiling [baseline] (97.532 ms) : 0, 97532
Profiling [candidate] (111.66 ms) : 0, 111660
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~353b02e363, baseline=1.57.0-SNAPSHOT~c8bb44440b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.102 s) : 0, 1101893
Total [baseline] (8.878 s) : 0, 8878267
Agent [candidate] (1.05 s) : 0, 1050021
Total [candidate] (8.644 s) : 0, 8643956
section iast
Agent [baseline] (1.238 s) : 0, 1237954
Total [baseline] (9.52 s) : 0, 9519752
Agent [candidate] (1.191 s) : 0, 1191163
Total [candidate] (9.291 s) : 0, 9290874
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.102 s -
Agent iast 1.238 s 136.061 ms (12.3%)
Total tracing 8.878 s -
Total iast 9.52 s 641.485 ms (7.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.05 s -
Agent iast 1.191 s 141.142 ms (13.4%)
Total tracing 8.644 s -
Total iast 9.291 s 646.918 ms (7.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~353b02e363, baseline=1.57.0-SNAPSHOT~c8bb44440b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.482 ms) : 0, 1482
crashtracking [candidate] (1.483 ms) : 0, 1483
BytebuddyAgent [baseline] (708.499 ms) : 0, 708499
BytebuddyAgent [candidate] (706.266 ms) : 0, 706266
GlobalTracer [baseline] (248.831 ms) : 0, 248831
GlobalTracer [candidate] (248.123 ms) : 0, 248123
AppSec [baseline] (32.036 ms) : 0, 32036
AppSec [candidate] (31.876 ms) : 0, 31876
Debugger [baseline] (63.635 ms) : 0, 63635
Debugger [candidate] (6.377 ms) : 0, 6377
Remote Config [baseline] (646.108 µs) : 0, 646
Remote Config [candidate] (677.409 µs) : 0, 677
Telemetry [baseline] (8.228 ms) : 0, 8228
Telemetry [candidate] (14.855 ms) : 0, 14855
Flare Poller [baseline] (3.693 ms) : 0, 3693
Flare Poller [candidate] (5.606 ms) : 0, 5606
section iast
crashtracking [baseline] (1.47 ms) : 0, 1470
crashtracking [candidate] (1.482 ms) : 0, 1482
BytebuddyAgent [baseline] (831.36 ms) : 0, 831360
BytebuddyAgent [candidate] (831.107 ms) : 0, 831107
GlobalTracer [baseline] (237.417 ms) : 0, 237417
GlobalTracer [candidate] (237.499 ms) : 0, 237499
AppSec [baseline] (33.103 ms) : 0, 33103
AppSec [candidate] (26.878 ms) : 0, 26878
Debugger [baseline] (59.729 ms) : 0, 59729
Debugger [candidate] (5.982 ms) : 0, 5982
Remote Config [baseline] (539.378 µs) : 0, 539
Remote Config [candidate] (605.685 µs) : 0, 606
Telemetry [baseline] (7.582 ms) : 0, 7582
Telemetry [candidate] (7.868 ms) : 0, 7868
Flare Poller [baseline] (3.414 ms) : 0, 3414
Flare Poller [candidate] (10.846 ms) : 0, 10846
IAST [baseline] (28.53 ms) : 0, 28530
IAST [candidate] (34.171 ms) : 0, 34171
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/disable-code-origin
git_commit_date 1763992896 1764063965
git_commit_sha c8bb444 353b02e
release_version 1.57.0-SNAPSHOT~c8bb44440b 1.57.0-SNAPSHOT~353b02e363
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1764066291 1764066291
ci_job_id 1255346203 1255346203
ci_pipeline_id 83915533 83915533
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-d4b56g9t 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-d4b56g9t 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 14 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-197.162µs; -88.663µs] or [-6.798%; -3.057%]		 unsure
[-543.537µs; -116.866µs] or [-6.662%; -1.432%]		 unstable
[-90.019op/s; +192.957op/s] or [-7.166%; +15.361%]		 2.757ms 7.829ms 1307.625op/s 2.900ms 8.159ms 1256.156op/s
scenario:load:insecure-bank:iast:high_load better
[-127.126µs; -59.145µs] or [-5.087%; -2.367%]		 unsure
[-394.953µs; -122.226µs] or [-5.403%; -1.672%]		 unstable
[-118.261op/s; +196.261op/s] or [-8.287%; +13.753%]		 2.406ms 7.052ms 1466.062op/s 2.499ms 7.310ms 1427.062op/s
scenario:load:petclinic:code_origins:high_load worse
[+1.150ms; +1.909ms] or [+6.718%; +11.151%]		 worse
[+0.774ms; +2.417ms] or [+2.714%; +8.471%]		 unstable
[-49.459op/s; +9.021op/s] or [-18.578%; +3.389%]		 18.647ms 30.124ms 246.000op/s 17.118ms 28.529ms 266.219op/s
scenario:load:petclinic:no_agent:high_load better
[-2.377ms; -0.642ms] or [-13.093%; -3.536%]		 unstable
[-3.675ms; -0.182ms] or [-12.223%; -0.605%]		 unstable
[-10.565op/s; +52.628op/s] or [-4.182%; +20.832%]		 16.645ms 28.136ms 273.656op/s 18.155ms 30.065ms 252.625op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~353b02e363, baseline=1.57.0-SNAPSHOT~c8bb44440b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.21 ms) : 1198, 1222
.   : milestone, 1210,
iast (3.204 ms) : 3160, 3249
.   : milestone, 3204,
iast_FULL (5.773 ms) : 5715, 5831
.   : milestone, 5773,
iast_GLOBAL (3.653 ms) : 3600, 3707
.   : milestone, 3653,
profiling (2.016 ms) : 1998, 2035
.   : milestone, 2016,
tracing (1.872 ms) : 1856, 1888
.   : milestone, 1872,
section candidate
no_agent (1.201 ms) : 1189, 1213
.   : milestone, 1201,
iast (3.12 ms) : 3077, 3163
.   : milestone, 3120,
iast_FULL (5.694 ms) : 5638, 5751
.   : milestone, 5694,
iast_GLOBAL (3.506 ms) : 3455, 3558
.   : milestone, 3506,
profiling (2.001 ms) : 1983, 2019
.   : milestone, 2001,
tracing (1.778 ms) : 1762, 1793
.   : milestone, 1778,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.21 ms [1.198 ms, 1.222 ms] -
iast 3.204 ms [3.16 ms, 3.249 ms] 1.995 ms (164.9%)
iast_FULL 5.773 ms [5.715 ms, 5.831 ms] 4.563 ms (377.2%)
iast_GLOBAL 3.653 ms [3.6 ms, 3.707 ms] 2.444 ms (202.0%)
profiling 2.016 ms [1.998 ms, 2.035 ms] 806.624 µs (66.7%)
tracing 1.872 ms [1.856 ms, 1.888 ms] 662.19 µs (54.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.201 ms [1.189 ms, 1.213 ms] -
iast 3.12 ms [3.077 ms, 3.163 ms] 1.919 ms (159.7%)
iast_FULL 5.694 ms [5.638 ms, 5.751 ms] 4.493 ms (374.1%)
iast_GLOBAL 3.506 ms [3.455 ms, 3.558 ms] 2.305 ms (191.9%)
profiling 2.001 ms [1.983 ms, 2.019 ms] 799.962 µs (66.6%)
tracing 1.778 ms [1.762 ms, 1.793 ms] 576.745 µs (48.0%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~353b02e363, baseline=1.57.0-SNAPSHOT~c8bb44440b
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.474 ms) : 18285, 18663
.   : milestone, 18474,
appsec (18.591 ms) : 18405, 18778
.   : milestone, 18591,
code_origins (17.525 ms) : 17350, 17700
.   : milestone, 17525,
iast (17.688 ms) : 17511, 17866
.   : milestone, 17688,
profiling (18.756 ms) : 18568, 18944
.   : milestone, 18756,
tracing (17.567 ms) : 17391, 17744
.   : milestone, 17567,
section candidate
no_agent (17.043 ms) : 16872, 17213
.   : milestone, 17043,
appsec (18.728 ms) : 18536, 18921
.   : milestone, 18728,
code_origins (18.97 ms) : 18781, 19160
.   : milestone, 18970,
iast (17.737 ms) : 17559, 17916
.   : milestone, 17737,
profiling (18.509 ms) : 18325, 18692
.   : milestone, 18509,
tracing (17.445 ms) : 17273, 17618
.   : milestone, 17445,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.474 ms [18.285 ms, 18.663 ms] -
appsec 18.591 ms [18.405 ms, 18.778 ms] 117.29 µs (0.6%)
code_origins 17.525 ms [17.35 ms, 17.7 ms] -949.167 µs (-5.1%)
iast 17.688 ms [17.511 ms, 17.866 ms] -785.55 µs (-4.3%)
profiling 18.756 ms [18.568 ms, 18.944 ms] 281.84 µs (1.5%)
tracing 17.567 ms [17.391 ms, 17.744 ms] -906.638 µs (-4.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.043 ms [16.872 ms, 17.213 ms] -
appsec 18.728 ms [18.536 ms, 18.921 ms] 1.686 ms (9.9%)
code_origins 18.97 ms [18.781 ms, 19.16 ms] 1.928 ms (11.3%)
iast 17.737 ms [17.559 ms, 17.916 ms] 694.856 µs (4.1%)
profiling 18.509 ms [18.325 ms, 18.692 ms] 1.466 ms (8.6%)
tracing 17.445 ms [17.273 ms, 17.618 ms] 402.707 µs (2.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/disable-code-origin
git_commit_date 1763992896 1764063965
git_commit_sha c8bb444 353b02e
release_version 1.57.0-SNAPSHOT~c8bb44440b 1.57.0-SNAPSHOT~353b02e363
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1764065999 1764065999
ci_job_id 1255346205 1255346205
ci_pipeline_id 83915533 83915533
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-7jhcj4fn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-7jhcj4fn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~353b02e363, baseline=1.57.0-SNAPSHOT~c8bb44440b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (2.461 ms) : 2409, 2514
.   : milestone, 2461,
iast (2.217 ms) : 2151, 2282
.   : milestone, 2217,
iast_GLOBAL (2.258 ms) : 2193, 2324
.   : milestone, 2258,
profiling (2.076 ms) : 2023, 2129
.   : milestone, 2076,
tracing (2.042 ms) : 1991, 2093
.   : milestone, 2042,
section candidate
no_agent (1.482 ms) : 1470, 1493
.   : milestone, 1482,
appsec (2.462 ms) : 2410, 2514
.   : milestone, 2462,
iast (2.214 ms) : 2149, 2278
.   : milestone, 2214,
iast_GLOBAL (2.262 ms) : 2196, 2328
.   : milestone, 2262,
profiling (2.098 ms) : 2043, 2152
.   : milestone, 2098,
tracing (2.058 ms) : 2007, 2109
.   : milestone, 2058,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.462 ms, 1.485 ms] -
appsec 2.461 ms [2.409 ms, 2.514 ms] 987.938 µs (67.1%)
iast 2.217 ms [2.151 ms, 2.282 ms] 743.156 µs (50.4%)
iast_GLOBAL 2.258 ms [2.193 ms, 2.324 ms] 784.757 µs (53.3%)
profiling 2.076 ms [2.023 ms, 2.129 ms] 602.901 µs (40.9%)
tracing 2.042 ms [1.991 ms, 2.093 ms] 568.4 µs (38.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.47 ms, 1.493 ms] -
appsec 2.462 ms [2.41 ms, 2.514 ms] 980.611 µs (66.2%)
iast 2.214 ms [2.149 ms, 2.278 ms] 731.907 µs (49.4%)
iast_GLOBAL 2.262 ms [2.196 ms, 2.328 ms] 780.407 µs (52.7%)
profiling 2.098 ms [2.043 ms, 2.152 ms] 615.942 µs (41.6%)
tracing 2.058 ms [2.007 ms, 2.109 ms] 576.63 µs (38.9%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~353b02e363, baseline=1.57.0-SNAPSHOT~c8bb44440b
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.477 s) : 15477000, 15477000
.   : milestone, 15477000,
appsec (14.802 s) : 14802000, 14802000
.   : milestone, 14802000,
iast (18.832 s) : 18832000, 18832000
.   : milestone, 18832000,
iast_GLOBAL (17.898 s) : 17898000, 17898000
.   : milestone, 17898000,
profiling (14.867 s) : 14867000, 14867000
.   : milestone, 14867000,
tracing (14.793 s) : 14793000, 14793000
.   : milestone, 14793000,
section candidate
no_agent (14.868 s) : 14868000, 14868000
.   : milestone, 14868000,
appsec (15.114 s) : 15114000, 15114000
.   : milestone, 15114000,
iast (18.576 s) : 18576000, 18576000
.   : milestone, 18576000,
iast_GLOBAL (17.912 s) : 17912000, 17912000
.   : milestone, 17912000,
profiling (15.154 s) : 15154000, 15154000
.   : milestone, 15154000,
tracing (14.916 s) : 14916000, 14916000
.   : milestone, 14916000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.477 s [15.477 s, 15.477 s] -
appsec 14.802 s [14.802 s, 14.802 s] -675.0 ms (-4.4%)
iast 18.832 s [18.832 s, 18.832 s] 3.355 s (21.7%)
iast_GLOBAL 17.898 s [17.898 s, 17.898 s] 2.421 s (15.6%)
profiling 14.867 s [14.867 s, 14.867 s] -610.0 ms (-3.9%)
tracing 14.793 s [14.793 s, 14.793 s] -684.0 ms (-4.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.868 s [14.868 s, 14.868 s] -
appsec 15.114 s [15.114 s, 15.114 s] 246.0 ms (1.7%)
iast 18.576 s [18.576 s, 18.576 s] 3.708 s (24.9%)
iast_GLOBAL 17.912 s [17.912 s, 17.912 s] 3.044 s (20.5%)
profiling 15.154 s [15.154 s, 15.154 s] 286.0 ms (1.9%)
tracing 14.916 s [14.916 s, 14.916 s] 48.0 ms (0.3%)

@mcculls mcculls mentioned this pull request Nov 25, 2025
Merged
@jpbempel jpbempel added the performance: ignore-performance-regression Ignore performance regression in `check-big-regressions` job label Nov 25, 2025
@jpbempel
Copy link
Member Author

jpbempel commented Nov 25, 2025

Added ignore-performance-regression label has this PR will never cause regression (disabling a feature)

@jpbempel jpbempel merged commit eed100b into master Nov 25, 2025
540 checks passed
@jpbempel jpbempel deleted the jpbempel/disable-code-origin branch November 25, 2025 12:47
@github-actions github-actions bot added this to the 1.57.0 milestone Nov 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mcculls mcculls mcculls approved these changes

@bric3 bric3 bric3 approved these changes

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

Assignees

No one assigned

Labels

comp: debugger Dynamic Instrumentation performance: ignore-performance-regression Ignore performance regression in `check-big-regressions` job type: bug Bug report and fix

Projects

None yet

Milestone

1.57.0

Development

Successfully merging this pull request may close these issues.

5 participants

@jpbempel @mcculls @bric3 @PerfectSlayer