Skip to content

Fix metric expressions with @return #10178

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
jpbempel merged 1 commit into from
Dec 13, 2025
Merged

Fix metric expressions with @return #10178

jpbempel merged 1 commit into from
Dec 13, 2025

Conversation

@jpbempel
Copy link
Member

@jpbempel jpbempel commented Dec 12, 2025 •
edited
Loading

What Does This Do

When compiling the metric expression using @return synthetic variable, the type of @return was not propagated correctly and the generic Object type was used instead which prevent to call length() when this
is a String.
Fix also reporting errors as ProbeSatus by returning Error status when instrumenting.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: DEBUG-4840

@jpbempel
Fix metric expressions with @return
7b19179 
When compiling the metric expression using @return synthetic variable,
the type of @return was not propagated correctly and the generic
Object type was used instead which prevent to call length() when this
 is a String.
Fix also reporting errors as ProbeSatus by returning Error status
when instrumenting.
@jpbempel jpbempel requested a review from a team as a code owner December 12, 2025 08:45
@jpbempel jpbempel requested review from ojung and removed request for a team December 12, 2025 08:45
@github-actions
Copy link
Contributor

github-actions bot commented Dec 12, 2025

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@jpbempel jpbempel added comp: debugger Dynamic Instrumentation type: bug Bug report and fix labels Dec 12, 2025
@jpbempel jpbempel changed the title Fix metric expressions with @return Fix metric expressions with @return Dec 12, 2025
@pr-commenter
Copy link

pr-commenter bot commented Dec 12, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1765528881 1765529226
end_time 2025-12-12T08:42:41 2025-12-12T08:48:27
git_branch master jpbempel/fix-return-metric
git_commit_sha 766474f 7b19179
start_time 2025-12-12T08:41:22 2025-12-12T08:47:07
See matching parameters
Baseline Candidate
ci_job_id 1289870916 1289870916
ci_pipeline_id 86414938 86414938
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1765528190 1765528190

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 6 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-13.492µs; +25.110µs] or [-4.887%; +9.095%]		 unstable
[-22.854µs; +38.023µs] or [-7.257%; +12.073%]		 unstable
[-32.941µs; +48.409µs] or [-10.019%; +14.724%]		 unstable
[-68.318µs; +147.499µs] or [-7.296%; +15.752%]		 same
scenario:basic same same same unstable
[-52.280µs; +150.523µs] or [-7.118%; +20.495%]		 unstable
[-170.840op/s; +170.840op/s] or [-6.492%; +6.492%]
scenario:loop unsure
[-6.499µs; -0.508µs] or [-0.073%; -0.006%]		 unsure
[-10.277µs; -0.664µs] or [-0.115%; -0.007%]		 same same same
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (314.941 µs) : 292, 338
.   : milestone, 315,
basic (281.794 µs) : 276, 288
.   : milestone, 282,
loop (8.967 ms) : 8963, 8972
.   : milestone, 8967,
section candidate
noprobe (322.525 µs) : 289, 356
.   : milestone, 323,
basic (284.209 µs) : 277, 291
.   : milestone, 284,
loop (8.962 ms) : 8958, 8966
.   : milestone, 8962,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 314.941 µs [291.565 µs, 338.318 µs]
basic 281.794 µs [275.51 µs, 288.078 µs]
loop 8.967 ms [8.963 ms, 8.972 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 322.525 µs [288.862 µs, 356.189 µs]
basic 284.209 µs [277.26 µs, 291.158 µs]
loop 8.962 ms [8.958 ms, 8.966 ms]

@pr-commenter
Copy link

pr-commenter bot commented Dec 12, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-return-metric
git_commit_date 1765467203 1765528190
git_commit_sha c7e1489 7b19179
release_version 1.57.0-SNAPSHOT~c7e1489fab 1.57.0-SNAPSHOT~7b19179cc7
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765530154 1765530154
ci_job_id 1289870908 1289870908
ci_pipeline_id 86414938 86414938
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-twq6syi7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-twq6syi7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 5 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~7b19179cc7, baseline=1.57.0-SNAPSHOT~c7e1489fab

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.081 s) : 0, 1081207
Total [baseline] (8.771 s) : 0, 8770540
Agent [candidate] (1.08 s) : 0, 1080411
Total [candidate] (8.801 s) : 0, 8800554
section iast
Agent [baseline] (1.219 s) : 0, 1218798
Total [baseline] (9.454 s) : 0, 9453883
Agent [candidate] (1.23 s) : 0, 1229780
Total [candidate] (9.497 s) : 0, 9496952
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.081 s -
Agent iast 1.219 s 137.591 ms (12.7%)
Total tracing 8.771 s -
Total iast 9.454 s 683.343 ms (7.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.08 s -
Agent iast 1.23 s 149.369 ms (13.8%)
Total tracing 8.801 s -
Total iast 9.497 s 696.398 ms (7.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~7b19179cc7, baseline=1.57.0-SNAPSHOT~c7e1489fab

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (649.405 ms) : 0, 649405
BytebuddyAgent [candidate] (648.408 ms) : 0, 648408
GlobalTracer [baseline] (282.237 ms) : 0, 282237
GlobalTracer [candidate] (282.058 ms) : 0, 282058
AppSec [baseline] (32.251 ms) : 0, 32251
AppSec [candidate] (32.298 ms) : 0, 32298
Debugger [baseline] (67.057 ms) : 0, 67057
Debugger [candidate] (67.464 ms) : 0, 67464
Remote Config [baseline] (654.945 µs) : 0, 655
Remote Config [candidate] (650.139 µs) : 0, 650
Telemetry [baseline] (9.002 ms) : 0, 9002
Telemetry [candidate] (9.017 ms) : 0, 9017
Flare Poller [baseline] (3.712 ms) : 0, 3712
Flare Poller [candidate] (3.767 ms) : 0, 3767
section iast
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.216 ms) : 0, 1216
BytebuddyAgent [baseline] (788.285 ms) : 0, 788285
BytebuddyAgent [candidate] (795.345 ms) : 0, 795345
GlobalTracer [baseline] (255.005 ms) : 0, 255005
GlobalTracer [candidate] (257.222 ms) : 0, 257222
AppSec [baseline] (33.658 ms) : 0, 33658
AppSec [candidate] (35.643 ms) : 0, 35643
Debugger [baseline] (66.03 ms) : 0, 66030
Debugger [candidate] (65.048 ms) : 0, 65048
Remote Config [baseline] (536.66 µs) : 0, 537
Remote Config [candidate] (546.457 µs) : 0, 546
Telemetry [baseline] (8.399 ms) : 0, 8399
Telemetry [candidate] (8.467 ms) : 0, 8467
Flare Poller [baseline] (3.467 ms) : 0, 3467
Flare Poller [candidate] (3.506 ms) : 0, 3506
IAST [baseline] (26.761 ms) : 0, 26761
IAST [candidate] (27.147 ms) : 0, 27147
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~7b19179cc7, baseline=1.57.0-SNAPSHOT~c7e1489fab

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.086 s) : 0, 1086241
Total [baseline] (10.881 s) : 0, 10881445
Agent [candidate] (1.081 s) : 0, 1080960
Total [candidate] (10.866 s) : 0, 10866191
section appsec
Agent [baseline] (1.272 s) : 0, 1272248
Total [baseline] (11.151 s) : 0, 11151346
Agent [candidate] (1.266 s) : 0, 1265730
Total [candidate] (11.105 s) : 0, 11105353
section iast
Agent [baseline] (1.222 s) : 0, 1222227
Total [baseline] (11.124 s) : 0, 11123854
Agent [candidate] (1.232 s) : 0, 1232069
Total [candidate] (11.102 s) : 0, 11101677
section profiling
Agent [baseline] (1.212 s) : 0, 1211573
Total [baseline] (10.947 s) : 0, 10947412
Agent [candidate] (1.208 s) : 0, 1208203
Total [candidate] (11.054 s) : 0, 11053895
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.086 s -
Agent appsec 1.272 s 186.007 ms (17.1%)
Agent iast 1.222 s 135.987 ms (12.5%)
Agent profiling 1.212 s 125.332 ms (11.5%)
Total tracing 10.881 s -
Total appsec 11.151 s 269.902 ms (2.5%)
Total iast 11.124 s 242.409 ms (2.2%)
Total profiling 10.947 s 65.967 ms (0.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.081 s -
Agent appsec 1.266 s 184.769 ms (17.1%)
Agent iast 1.232 s 151.108 ms (14.0%)
Agent profiling 1.208 s 127.243 ms (11.8%)
Total tracing 10.866 s -
Total appsec 11.105 s 239.162 ms (2.2%)
Total iast 11.102 s 235.487 ms (2.2%)
Total profiling 11.054 s 187.704 ms (1.7%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~7b19179cc7, baseline=1.57.0-SNAPSHOT~c7e1489fab

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.215 ms) : 0, 1215
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (651.791 ms) : 0, 651791
BytebuddyAgent [candidate] (648.298 ms) : 0, 648298
GlobalTracer [baseline] (283.168 ms) : 0, 283168
GlobalTracer [candidate] (281.896 ms) : 0, 281896
AppSec [baseline] (32.557 ms) : 0, 32557
AppSec [candidate] (32.173 ms) : 0, 32173
Debugger [baseline] (68.453 ms) : 0, 68453
Debugger [candidate] (68.556 ms) : 0, 68556
Remote Config [baseline] (623.149 µs) : 0, 623
Remote Config [candidate] (619.61 µs) : 0, 620
Telemetry [baseline] (8.986 ms) : 0, 8986
Telemetry [candidate] (8.971 ms) : 0, 8971
Flare Poller [baseline] (3.702 ms) : 0, 3702
Flare Poller [candidate] (3.691 ms) : 0, 3691
section appsec
crashtracking [baseline] (1.205 ms) : 0, 1205
crashtracking [candidate] (1.203 ms) : 0, 1203
BytebuddyAgent [baseline] (693.803 ms) : 0, 693803
BytebuddyAgent [candidate] (689.758 ms) : 0, 689758
GlobalTracer [baseline] (260.74 ms) : 0, 260740
GlobalTracer [candidate] (259.329 ms) : 0, 259329
IAST [baseline] (24.834 ms) : 0, 24834
IAST [candidate] (24.656 ms) : 0, 24656
AppSec [baseline] (175.72 ms) : 0, 175720
AppSec [candidate] (175.207 ms) : 0, 175207
Debugger [baseline] (66.545 ms) : 0, 66545
Debugger [candidate] (66.481 ms) : 0, 66481
Remote Config [baseline] (733.538 µs) : 0, 734
Remote Config [candidate] (710.304 µs) : 0, 710
Telemetry [baseline] (9.028 ms) : 0, 9028
Telemetry [candidate] (8.916 ms) : 0, 8916
Flare Poller [baseline] (3.89 ms) : 0, 3890
Flare Poller [candidate] (3.811 ms) : 0, 3811
section iast
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (790.077 ms) : 0, 790077
BytebuddyAgent [candidate] (796.399 ms) : 0, 796399
GlobalTracer [baseline] (255.529 ms) : 0, 255529
GlobalTracer [candidate] (257.069 ms) : 0, 257069
IAST [baseline] (26.878 ms) : 0, 26878
IAST [candidate] (27.202 ms) : 0, 27202
AppSec [baseline] (35.441 ms) : 0, 35441
AppSec [candidate] (35.588 ms) : 0, 35588
Debugger [baseline] (65.287 ms) : 0, 65287
Debugger [candidate] (66.172 ms) : 0, 66172
Remote Config [baseline] (541.83 µs) : 0, 542
Remote Config [candidate] (567.157 µs) : 0, 567
Telemetry [baseline] (8.391 ms) : 0, 8391
Telemetry [candidate] (8.642 ms) : 0, 8642
Flare Poller [baseline] (3.437 ms) : 0, 3437
Flare Poller [candidate] (3.599 ms) : 0, 3599
section profiling
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.2 ms) : 0, 1200
BytebuddyAgent [baseline] (705.822 ms) : 0, 705822
BytebuddyAgent [candidate] (704.453 ms) : 0, 704453
GlobalTracer [baseline] (221.702 ms) : 0, 221702
GlobalTracer [candidate] (221.051 ms) : 0, 221051
AppSec [baseline] (32.494 ms) : 0, 32494
AppSec [candidate] (32.359 ms) : 0, 32359
Debugger [baseline] (68.721 ms) : 0, 68721
Debugger [candidate] (67.913 ms) : 0, 67913
Remote Config [baseline] (624.401 µs) : 0, 624
Remote Config [candidate] (624.779 µs) : 0, 625
Telemetry [baseline] (9.009 ms) : 0, 9009
Telemetry [candidate] (8.993 ms) : 0, 8993
Flare Poller [baseline] (3.73 ms) : 0, 3730
Flare Poller [candidate] (3.796 ms) : 0, 3796
ProfilingAgent [baseline] (97.959 ms) : 0, 97959
ProfilingAgent [candidate] (97.943 ms) : 0, 97943
Profiling [baseline] (98.538 ms) : 0, 98538
Profiling [candidate] (98.53 ms) : 0, 98530
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-return-metric
git_commit_date 1765467203 1765528190
git_commit_sha c7e1489 7b19179
release_version 1.57.0-SNAPSHOT~c7e1489fab 1.57.0-SNAPSHOT~7b19179cc7
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765530547 1765530547
ci_job_id 1289870909 1289870909
ci_pipeline_id 86414938 86414938
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-6usjxbit 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-6usjxbit 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 3 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load worse
[+78.236µs; +163.251µs] or [+3.201%; +6.679%]		 same
[-36.907µs; +441.257µs] or [-0.507%; +6.059%]		 unstable
[-194.414op/s; +100.852op/s] or [-13.549%; +7.029%]		 2.565ms 7.485ms 1388.062op/s 2.444ms 7.283ms 1434.844op/s
scenario:load:insecure-bank:iast_FULL:high_load worse
[+280.427µs; +572.358µs] or [+5.690%; +11.614%]		 worse
[+612.097µs; +1334.632µs] or [+5.173%; +11.279%]		 unstable
[-143.356op/s; +15.481op/s] or [-17.282%; +1.866%]		 5.354ms 12.806ms 765.562op/s 4.928ms 11.833ms 829.500op/s
scenario:load:petclinic:iast:high_load better
[-1249.456µs; -488.036µs] or [-6.823%; -2.665%]		 unsure
[-1414.537µs; -129.643µs] or [-4.728%; -0.433%]		 unstable
[-15.496op/s; +35.746op/s] or [-6.184%; +14.266%]		 17.445ms 29.145ms 260.688op/s 18.313ms 29.917ms 250.562op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~7b19179cc7, baseline=1.57.0-SNAPSHOT~c7e1489fab
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.188 ms) : 18997, 19380
.   : milestone, 19188,
appsec (18.578 ms) : 18386, 18769
.   : milestone, 18578,
code_origins (18.078 ms) : 17897, 18259
.   : milestone, 18078,
iast (18.627 ms) : 18437, 18816
.   : milestone, 18627,
profiling (18.789 ms) : 18602, 18976
.   : milestone, 18789,
tracing (17.9 ms) : 17722, 18078
.   : milestone, 17900,
section candidate
no_agent (18.353 ms) : 18160, 18546
.   : milestone, 18353,
appsec (18.518 ms) : 18329, 18706
.   : milestone, 18518,
code_origins (18.803 ms) : 18612, 18995
.   : milestone, 18803,
iast (17.894 ms) : 17714, 18074
.   : milestone, 17894,
profiling (18.663 ms) : 18474, 18852
.   : milestone, 18663,
tracing (17.663 ms) : 17489, 17837
.   : milestone, 17663,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.188 ms [18.997 ms, 19.38 ms] -
appsec 18.578 ms [18.386 ms, 18.769 ms] -610.728 µs (-3.2%)
code_origins 18.078 ms [17.897 ms, 18.259 ms] -1.11 ms (-5.8%)
iast 18.627 ms [18.437 ms, 18.816 ms] -561.749 µs (-2.9%)
profiling 18.789 ms [18.602 ms, 18.976 ms] -399.482 µs (-2.1%)
tracing 17.9 ms [17.722 ms, 18.078 ms] -1.288 ms (-6.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.353 ms [18.16 ms, 18.546 ms] -
appsec 18.518 ms [18.329 ms, 18.706 ms] 164.853 µs (0.9%)
code_origins 18.803 ms [18.612 ms, 18.995 ms] 450.392 µs (2.5%)
iast 17.894 ms [17.714 ms, 18.074 ms] -458.775 µs (-2.5%)
profiling 18.663 ms [18.474 ms, 18.852 ms] 310.262 µs (1.7%)
tracing 17.663 ms [17.489 ms, 17.837 ms] -690.173 µs (-3.8%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~7b19179cc7, baseline=1.57.0-SNAPSHOT~c7e1489fab
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.191 ms) : 1179, 1203
.   : milestone, 1191,
iast (3.189 ms) : 3142, 3236
.   : milestone, 3189,
iast_FULL (5.57 ms) : 5516, 5625
.   : milestone, 5570,
iast_GLOBAL (3.602 ms) : 3545, 3660
.   : milestone, 3602,
profiling (2.082 ms) : 2064, 2100
.   : milestone, 2082,
tracing (1.893 ms) : 1873, 1912
.   : milestone, 1893,
section candidate
no_agent (1.199 ms) : 1188, 1210
.   : milestone, 1199,
iast (3.297 ms) : 3253, 3342
.   : milestone, 3297,
iast_FULL (6.041 ms) : 5979, 6103
.   : milestone, 6041,
iast_GLOBAL (3.673 ms) : 3620, 3727
.   : milestone, 3673,
profiling (2.175 ms) : 2155, 2195
.   : milestone, 2175,
tracing (1.816 ms) : 1800, 1832
.   : milestone, 1816,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.191 ms [1.179 ms, 1.203 ms] -
iast 3.189 ms [3.142 ms, 3.236 ms] 1.998 ms (167.8%)
iast_FULL 5.57 ms [5.516 ms, 5.625 ms] 4.379 ms (367.7%)
iast_GLOBAL 3.602 ms [3.545 ms, 3.66 ms] 2.411 ms (202.4%)
profiling 2.082 ms [2.064 ms, 2.1 ms] 890.871 µs (74.8%)
tracing 1.893 ms [1.873 ms, 1.912 ms] 701.516 µs (58.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.199 ms [1.188 ms, 1.21 ms] -
iast 3.297 ms [3.253 ms, 3.342 ms] 2.098 ms (175.0%)
iast_FULL 6.041 ms [5.979 ms, 6.103 ms] 4.842 ms (403.8%)
iast_GLOBAL 3.673 ms [3.62 ms, 3.727 ms] 2.474 ms (206.3%)
profiling 2.175 ms [2.155 ms, 2.195 ms] 975.787 µs (81.4%)
tracing 1.816 ms [1.8 ms, 1.832 ms] 616.798 µs (51.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-return-metric
git_commit_date 1765467203 1765528190
git_commit_sha c7e1489 7b19179
release_version 1.57.0-SNAPSHOT~c7e1489fab 1.57.0-SNAPSHOT~7b19179cc7
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1765530401 1765530401
ci_job_id 1289870910 1289870910
ci_pipeline_id 86414938 86414938
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-r99c1mnl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-r99c1mnl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.433ms; -1.090ms] or [-38.527%; -29.289%]		 2.459ms 3.720ms
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~7b19179cc7, baseline=1.57.0-SNAPSHOT~c7e1489fab
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.255 s) : 15255000, 15255000
.   : milestone, 15255000,
appsec (14.842 s) : 14842000, 14842000
.   : milestone, 14842000,
iast (18.097 s) : 18097000, 18097000
.   : milestone, 18097000,
iast_GLOBAL (18.012 s) : 18012000, 18012000
.   : milestone, 18012000,
profiling (14.63 s) : 14630000, 14630000
.   : milestone, 14630000,
tracing (14.623 s) : 14623000, 14623000
.   : milestone, 14623000,
section candidate
no_agent (15.06 s) : 15060000, 15060000
.   : milestone, 15060000,
appsec (14.589 s) : 14589000, 14589000
.   : milestone, 14589000,
iast (18.356 s) : 18356000, 18356000
.   : milestone, 18356000,
iast_GLOBAL (17.874 s) : 17874000, 17874000
.   : milestone, 17874000,
profiling (14.664 s) : 14664000, 14664000
.   : milestone, 14664000,
tracing (14.76 s) : 14760000, 14760000
.   : milestone, 14760000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.255 s [15.255 s, 15.255 s] -
appsec 14.842 s [14.842 s, 14.842 s] -413.0 ms (-2.7%)
iast 18.097 s [18.097 s, 18.097 s] 2.842 s (18.6%)
iast_GLOBAL 18.012 s [18.012 s, 18.012 s] 2.757 s (18.1%)
profiling 14.63 s [14.63 s, 14.63 s] -625.0 ms (-4.1%)
tracing 14.623 s [14.623 s, 14.623 s] -632.0 ms (-4.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.06 s [15.06 s, 15.06 s] -
appsec 14.589 s [14.589 s, 14.589 s] -471.0 ms (-3.1%)
iast 18.356 s [18.356 s, 18.356 s] 3.296 s (21.9%)
iast_GLOBAL 17.874 s [17.874 s, 17.874 s] 2.814 s (18.7%)
profiling 14.664 s [14.664 s, 14.664 s] -396.0 ms (-2.6%)
tracing 14.76 s [14.76 s, 14.76 s] -300.0 ms (-2.0%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~7b19179cc7, baseline=1.57.0-SNAPSHOT~c7e1489fab
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.475 ms) : 1463, 1486
.   : milestone, 1475,
appsec (3.72 ms) : 3500, 3940
.   : milestone, 3720,
iast (2.221 ms) : 2157, 2285
.   : milestone, 2221,
iast_GLOBAL (2.265 ms) : 2200, 2329
.   : milestone, 2265,
profiling (2.081 ms) : 2027, 2135
.   : milestone, 2081,
tracing (2.043 ms) : 1993, 2094
.   : milestone, 2043,
section candidate
no_agent (1.475 ms) : 1463, 1486
.   : milestone, 1475,
appsec (2.459 ms) : 2407, 2510
.   : milestone, 2459,
iast (2.218 ms) : 2154, 2283
.   : milestone, 2218,
iast_GLOBAL (2.27 ms) : 2204, 2335
.   : milestone, 2270,
profiling (2.073 ms) : 2021, 2125
.   : milestone, 2073,
tracing (2.044 ms) : 1993, 2094
.   : milestone, 2044,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.463 ms, 1.486 ms] -
appsec 3.72 ms [3.5 ms, 3.94 ms] 2.245 ms (152.3%)
iast 2.221 ms [2.157 ms, 2.285 ms] 746.24 µs (50.6%)
iast_GLOBAL 2.265 ms [2.2 ms, 2.329 ms] 789.738 µs (53.6%)
profiling 2.081 ms [2.027 ms, 2.135 ms] 606.26 µs (41.1%)
tracing 2.043 ms [1.993 ms, 2.094 ms] 568.433 µs (38.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.463 ms, 1.486 ms] -
appsec 2.459 ms [2.407 ms, 2.51 ms] 983.793 µs (66.7%)
iast 2.218 ms [2.154 ms, 2.283 ms] 743.371 µs (50.4%)
iast_GLOBAL 2.27 ms [2.204 ms, 2.335 ms] 794.67 µs (53.9%)
profiling 2.073 ms [2.021 ms, 2.125 ms] 598.441 µs (40.6%)
tracing 2.044 ms [1.993 ms, 2.094 ms] 568.834 µs (38.6%)

@jpbempel jpbempel merged commit 4416578 into master Dec 13, 2025
563 of 570 checks passed
@jpbempel jpbempel deleted the jpbempel/fix-return-metric branch December 13, 2025 07:39
@github-actions github-actions bot added this to the 1.57.0 milestone Dec 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@evanchooly evanchooly evanchooly approved these changes

@ojung ojung Awaiting requested review from ojung ojung is a code owner automatically assigned from DataDog/debugger-java

Assignees

No one assigned

Labels

comp: debugger Dynamic Instrumentation type: bug Bug report and fix

Projects

None yet

Milestone

1.57.0

Development

Successfully merging this pull request may close these issues.

3 participants

@jpbempel @evanchooly