Skip to content

Disable debugger metrics by default#9279

Merged
jpbempel merged 1 commit intomasterfrom
jpbempel/disable-debugger-metrics
Jul 31, 2025
Merged

Disable debugger metrics by default#9279
jpbempel merged 1 commit intomasterfrom
jpbempel/disable-debugger-metrics

Conversation

@jpbempel
Copy link
Copy Markdown
Member

@jpbempel jpbempel commented Jul 30, 2025

What Does This Do

In some hot loops can be costly. will also in the future transition to telemetry metrics

Motivation

Additional Notes

Contributor Checklist

@jpbempel
Disable debugger metrics by default
1bdc547 
In some hot loops can be costly. will also in the future transition to
telemetry metrics
@jpbempel jpbempel added the type: bug Bug report and fix label Jul 30, 2025
@jpbempel jpbempel requested a review from a team as a code owner July 30, 2025 15:11
@jpbempel jpbempel added the tag: no release notes Changes to exclude from release notes label Jul 30, 2025
@jpbempel jpbempel requested a review from a team as a code owner July 30, 2025 15:11
@jpbempel jpbempel added the comp: debugger Dynamic Instrumentation label Jul 30, 2025
@jpbempel jpbempel requested review from amarziali, evanchooly and ojung and removed request for a team July 30, 2025 15:11
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Jul 30, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1753888814 1753889159
end_time 2025-07-30T15:21:34 2025-07-30T15:27:20
git_branch master jpbempel/disable-debugger-metrics
git_commit_sha 2c5960b 1bdc547
start_time 2025-07-30T15:20:14 2025-07-30T15:26:00
See matching parameters
Baseline Candidate
ci_job_id 1055594724 1055594724
ci_pipeline_id 72183398 72183398
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1753888216 1753888216

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 6 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-61.040µs; +26.077µs] or [-20.530%; +8.771%]		 unstable
[-76.482µs; +38.207µs] or [-22.474%; +11.227%]		 unstable
[-89.158µs; +46.688µs] or [-25.007%; +13.095%]		 unstable
[-562.913µs; +309.363µs] or [-50.679%; +27.852%]		 same
scenario:basic same same same unstable
[-168.986µs; +56.109µs] or [-21.642%; +7.186%]		 unstable
[-132.580op/s; +267.532op/s] or [-5.171%; +10.434%]
scenario:loop same same same same same
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (340.312 µs) : 270, 411
.   : milestone, 340,
basic (285.427 µs) : 276, 295
.   : milestone, 285,
loop (8.969 ms) : 8963, 8976
.   : milestone, 8969,
section candidate
noprobe (321.175 µs) : 290, 352
.   : milestone, 321,
basic (283.765 µs) : 278, 290
.   : milestone, 284,
loop (8.969 ms) : 8964, 8974
.   : milestone, 8969,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 340.312 µs [269.562 µs, 411.062 µs]
basic 285.427 µs [275.815 µs, 295.039 µs]
loop 8.969 ms [8.963 ms, 8.976 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 321.175 µs [290.277 µs, 352.073 µs]
basic 283.765 µs [277.79 µs, 289.739 µs]
loop 8.969 ms [8.964 ms, 8.974 ms]

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Jul 30, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/disable-debugger-metrics
git_commit_date 1753877213 1753888216
git_commit_sha 2c5960b 1bdc547
release_version 1.51.1-SNAPSHOT~2c5960be47 1.51.1-SNAPSHOT~1bdc5472ee
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1753890040 1753890040
ci_job_id 1055594712 1055594712
ci_pipeline_id 72183398 72183398
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-3c02o1s4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-3c02o1s4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 11 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.51.1-SNAPSHOT~1bdc5472ee, baseline=1.51.1-SNAPSHOT~2c5960be47

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.043 s) : 0, 1043028
Total [baseline] (10.793 s) : 0, 10792706
Agent [candidate] (1.042 s) : 0, 1042383
Total [candidate] (10.677 s) : 0, 10676953
section appsec
Agent [baseline] (1.224 s) : 0, 1224180
Total [baseline] (10.745 s) : 0, 10745048
Agent [candidate] (1.229 s) : 0, 1229496
Total [candidate] (10.858 s) : 0, 10857666
section iast
Agent [baseline] (1.184 s) : 0, 1183896
Total [baseline] (10.843 s) : 0, 10843037
Agent [candidate] (1.174 s) : 0, 1173649
Total [candidate] (10.806 s) : 0, 10806035
section profiling
Agent [baseline] (1.19 s) : 0, 1190492
Total [baseline] (10.903 s) : 0, 10903385
Agent [candidate] (1.189 s) : 0, 1189198
Total [candidate] (10.859 s) : 0, 10858715
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.043 s -
Agent appsec 1.224 s 181.151 ms (17.4%)
Agent iast 1.184 s 140.868 ms (13.5%)
Agent profiling 1.19 s 147.464 ms (14.1%)
Total tracing 10.793 s -
Total appsec 10.745 s -47.659 ms (-0.4%)
Total iast 10.843 s 50.331 ms (0.5%)
Total profiling 10.903 s 110.679 ms (1.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.042 s -
Agent appsec 1.229 s 187.112 ms (18.0%)
Agent iast 1.174 s 131.266 ms (12.6%)
Agent profiling 1.189 s 146.815 ms (14.1%)
Total tracing 10.677 s -
Total appsec 10.858 s 180.714 ms (1.7%)
Total iast 10.806 s 129.082 ms (1.2%)
Total profiling 10.859 s 181.762 ms (1.7%) 
gantt
    title petclinic - break down per module: candidate=1.51.1-SNAPSHOT~1bdc5472ee, baseline=1.51.1-SNAPSHOT~2c5960be47

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.427 ms) : 0, 1427
crashtracking [candidate] (1.438 ms) : 0, 1438
BytebuddyAgent [baseline] (728.627 ms) : 0, 728627
BytebuddyAgent [candidate] (730.588 ms) : 0, 730588
GlobalTracer [baseline] (241.198 ms) : 0, 241198
GlobalTracer [candidate] (241.902 ms) : 0, 241902
AppSec [baseline] (30.19 ms) : 0, 30190
AppSec [candidate] (30.286 ms) : 0, 30286
Debugger [baseline] (6.001 ms) : 0, 6001
Debugger [candidate] (5.999 ms) : 0, 5999
Remote Config [baseline] (647.001 µs) : 0, 647
Remote Config [candidate] (655.909 µs) : 0, 656
Telemetry [baseline] (14.019 ms) : 0, 14019
Telemetry [candidate] (10.46 ms) : 0, 10460
section appsec
crashtracking [baseline] (1.441 ms) : 0, 1441
crashtracking [candidate] (1.447 ms) : 0, 1447
BytebuddyAgent [baseline] (755.848 ms) : 0, 755848
BytebuddyAgent [candidate] (758.632 ms) : 0, 758632
GlobalTracer [baseline] (235.783 ms) : 0, 235783
GlobalTracer [candidate] (237.6 ms) : 0, 237600
IAST [baseline] (23.762 ms) : 0, 23762
IAST [candidate] (23.883 ms) : 0, 23883
AppSec [baseline] (168.47 ms) : 0, 168470
AppSec [candidate] (169.801 ms) : 0, 169801
Debugger [baseline] (7.293 ms) : 0, 7293
Debugger [candidate] (7.896 ms) : 0, 7896
Remote Config [baseline] (629.164 µs) : 0, 629
Remote Config [candidate] (626.065 µs) : 0, 626
Telemetry [baseline] (9.803 ms) : 0, 9803
Telemetry [candidate] (8.4 ms) : 0, 8400
section iast
crashtracking [baseline] (1.441 ms) : 0, 1441
crashtracking [candidate] (1.444 ms) : 0, 1444
BytebuddyAgent [baseline] (855.323 ms) : 0, 855323
BytebuddyAgent [candidate] (846.956 ms) : 0, 846956
GlobalTracer [baseline] (232.858 ms) : 0, 232858
GlobalTracer [candidate] (231.451 ms) : 0, 231451
IAST [baseline] (29.3 ms) : 0, 29300
IAST [candidate] (28.361 ms) : 0, 28361
AppSec [baseline] (28.312 ms) : 0, 28312
AppSec [candidate] (28.201 ms) : 0, 28201
Debugger [baseline] (6.738 ms) : 0, 6738
Debugger [candidate] (7.457 ms) : 0, 7457
Remote Config [baseline] (606.664 µs) : 0, 607
Remote Config [candidate] (591.012 µs) : 0, 591
Telemetry [baseline] (8.202 ms) : 0, 8202
Telemetry [candidate] (8.127 ms) : 0, 8127
section profiling
crashtracking [baseline] (1.397 ms) : 0, 1397
crashtracking [candidate] (1.389 ms) : 0, 1389
BytebuddyAgent [baseline] (758.435 ms) : 0, 758435
BytebuddyAgent [candidate] (757.267 ms) : 0, 757267
GlobalTracer [baseline] (220.739 ms) : 0, 220739
GlobalTracer [candidate] (220.792 ms) : 0, 220792
AppSec [baseline] (30.08 ms) : 0, 30080
AppSec [candidate] (30.102 ms) : 0, 30102
Debugger [baseline] (6.265 ms) : 0, 6265
Debugger [candidate] (6.218 ms) : 0, 6218
Remote Config [baseline] (683.199 µs) : 0, 683
Remote Config [candidate] (672.129 µs) : 0, 672
Telemetry [baseline] (16.01 ms) : 0, 16010
Telemetry [candidate] (15.91 ms) : 0, 15910
ProfilingAgent [baseline] (107.64 ms) : 0, 107640
ProfilingAgent [candidate] (107.547 ms) : 0, 107547
Profiling [baseline] (108.288 ms) : 0, 108288
Profiling [candidate] (108.194 ms) : 0, 108194
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.51.1-SNAPSHOT~1bdc5472ee, baseline=1.51.1-SNAPSHOT~2c5960be47

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1058753
Total [baseline] (8.632 s) : 0, 8632095
Agent [candidate] (1.051 s) : 0, 1051105
Total [candidate] (8.594 s) : 0, 8593619
section iast
Agent [baseline] (1.17 s) : 0, 1170218
Total [baseline] (9.283 s) : 0, 9282739
Agent [candidate] (1.182 s) : 0, 1182366
Total [candidate] (9.373 s) : 0, 9372859
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent iast 1.17 s 111.466 ms (10.5%)
Total tracing 8.632 s -
Total iast 9.283 s 650.644 ms (7.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent iast 1.182 s 131.262 ms (12.5%)
Total tracing 8.594 s -
Total iast 9.373 s 779.24 ms (9.1%) 
gantt
    title insecure-bank - break down per module: candidate=1.51.1-SNAPSHOT~1bdc5472ee, baseline=1.51.1-SNAPSHOT~2c5960be47

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.45 ms) : 0, 1450
crashtracking [candidate] (1.436 ms) : 0, 1436
BytebuddyAgent [baseline] (741.639 ms) : 0, 741639
BytebuddyAgent [candidate] (735.714 ms) : 0, 735714
GlobalTracer [baseline] (243.748 ms) : 0, 243748
GlobalTracer [candidate] (243.483 ms) : 0, 243483
AppSec [baseline] (30.73 ms) : 0, 30730
AppSec [candidate] (30.714 ms) : 0, 30714
Debugger [baseline] (6.075 ms) : 0, 6075
Debugger [candidate] (6.036 ms) : 0, 6036
Remote Config [baseline] (669.085 µs) : 0, 669
Remote Config [candidate] (654.674 µs) : 0, 655
Telemetry [baseline] (13.281 ms) : 0, 13281
Telemetry [candidate] (11.984 ms) : 0, 11984
section iast
crashtracking [baseline] (1.423 ms) : 0, 1423
crashtracking [candidate] (1.428 ms) : 0, 1428
BytebuddyAgent [baseline] (844.479 ms) : 0, 844479
BytebuddyAgent [candidate] (854.332 ms) : 0, 854332
GlobalTracer [baseline] (230.852 ms) : 0, 230852
GlobalTracer [candidate] (232.459 ms) : 0, 232459
IAST [baseline] (29.083 ms) : 0, 29083
IAST [candidate] (29.976 ms) : 0, 29976
AppSec [baseline] (27.175 ms) : 0, 27175
AppSec [candidate] (28.434 ms) : 0, 28434
Debugger [baseline] (7.516 ms) : 0, 7516
Debugger [candidate] (5.83 ms) : 0, 5830
Remote Config [baseline] (586.285 µs) : 0, 586
Remote Config [candidate] (589.506 µs) : 0, 590
Telemetry [baseline] (8.13 ms) : 0, 8130
Telemetry [candidate] (8.186 ms) : 0, 8186
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/disable-debugger-metrics
git_commit_date 1753877213 1753888216
git_commit_sha 2c5960b 1bdc547
release_version 1.51.1-SNAPSHOT~2c5960be47 1.51.1-SNAPSHOT~1bdc5472ee
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1753889753 1753889753
ci_job_id 1055594714 1055594714
ci_pipeline_id 72183398 72183398
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-vzk0xco5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-vzk0xco5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:code_origins:high_load better
[-2.470ms; -1.640ms] or [-5.393%; -3.580%]		 unstable
[-2.485op/s; +11.935op/s] or [-2.431%; +11.677%]		 43.746ms 106.938op/s 45.800ms 102.213op/s
scenario:load:petclinic:profiling:high_load better
[-2.554ms; -1.565ms] or [-5.192%; -3.180%]		 unstable
[-2.773op/s; +11.023op/s] or [-2.915%; +11.587%]		 47.142ms 99.263op/s 49.201ms 95.138op/s
scenario:load:petclinic:no_agent:high_load better
[-1.397ms; -0.761ms] or [-3.687%; -2.007%]		 unstable
[-4.856op/s; +11.981op/s] or [-3.936%; +9.712%]		 36.819ms 126.925op/s 37.898ms 123.362op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.51.1-SNAPSHOT~1bdc5472ee, baseline=1.51.1-SNAPSHOT~2c5960be47
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.259 ms) : 4211, 4308
.   : milestone, 4259,
iast (9.237 ms) : 9087, 9387
.   : milestone, 9237,
iast_FULL (13.828 ms) : 13555, 14102
.   : milestone, 13828,
iast_GLOBAL (10.401 ms) : 10219, 10584
.   : milestone, 10401,
profiling (8.803 ms) : 8665, 8941
.   : milestone, 8803,
tracing (7.393 ms) : 7290, 7495
.   : milestone, 7393,
section candidate
no_agent (4.318 ms) : 4260, 4376
.   : milestone, 4318,
iast (9.147 ms) : 8988, 9306
.   : milestone, 9147,
iast_FULL (13.869 ms) : 13589, 14150
.   : milestone, 13869,
iast_GLOBAL (10.099 ms) : 9920, 10278
.   : milestone, 10099,
profiling (8.502 ms) : 8364, 8640
.   : milestone, 8502,
tracing (7.541 ms) : 7421, 7662
.   : milestone, 7541,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.259 ms [4.211 ms, 4.308 ms] -
iast 9.237 ms [9.087 ms, 9.387 ms] 4.978 ms (116.9%)
iast_FULL 13.828 ms [13.555 ms, 14.102 ms] 9.569 ms (224.7%)
iast_GLOBAL 10.401 ms [10.219 ms, 10.584 ms] 6.142 ms (144.2%)
profiling 8.803 ms [8.665 ms, 8.941 ms] 4.544 ms (106.7%)
tracing 7.393 ms [7.29 ms, 7.495 ms] 3.133 ms (73.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.318 ms [4.26 ms, 4.376 ms] -
iast 9.147 ms [8.988 ms, 9.306 ms] 4.829 ms (111.8%)
iast_FULL 13.869 ms [13.589 ms, 14.15 ms] 9.551 ms (221.2%)
iast_GLOBAL 10.099 ms [9.92 ms, 10.278 ms] 5.78 ms (133.9%)
profiling 8.502 ms [8.364 ms, 8.64 ms] 4.184 ms (96.9%)
tracing 7.541 ms [7.421 ms, 7.662 ms] 3.223 ms (74.6%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.51.1-SNAPSHOT~1bdc5472ee, baseline=1.51.1-SNAPSHOT~2c5960be47
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.898 ms) : 37596, 38201
.   : milestone, 37898,
appsec (48.541 ms) : 48106, 48975
.   : milestone, 48541,
code_origins (45.8 ms) : 45408, 46192
.   : milestone, 45800,
iast (45.212 ms) : 44816, 45608
.   : milestone, 45212,
profiling (49.201 ms) : 48725, 49678
.   : milestone, 49201,
tracing (44.835 ms) : 44430, 45241
.   : milestone, 44835,
section candidate
no_agent (36.819 ms) : 36530, 37109
.   : milestone, 36819,
appsec (47.999 ms) : 47560, 48438
.   : milestone, 47999,
code_origins (43.746 ms) : 43366, 44125
.   : milestone, 43746,
iast (45.677 ms) : 45266, 46088
.   : milestone, 45677,
profiling (47.142 ms) : 46699, 47585
.   : milestone, 47142,
tracing (44.545 ms) : 44152, 44937
.   : milestone, 44545,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.898 ms [37.596 ms, 38.201 ms] -
appsec 48.541 ms [48.106 ms, 48.975 ms] 10.642 ms (28.1%)
code_origins 45.8 ms [45.408 ms, 46.192 ms] 7.902 ms (20.9%)
iast 45.212 ms [44.816 ms, 45.608 ms] 7.313 ms (19.3%)
profiling 49.201 ms [48.725 ms, 49.678 ms] 11.303 ms (29.8%)
tracing 44.835 ms [44.43 ms, 45.241 ms] 6.937 ms (18.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.819 ms [36.53 ms, 37.109 ms] -
appsec 47.999 ms [47.56 ms, 48.438 ms] 11.18 ms (30.4%)
code_origins 43.746 ms [43.366 ms, 44.125 ms] 6.926 ms (18.8%)
iast 45.677 ms [45.266 ms, 46.088 ms] 8.857 ms (24.1%)
profiling 47.142 ms [46.699 ms, 47.585 ms] 10.322 ms (28.0%)
tracing 44.545 ms [44.152 ms, 44.937 ms] 7.725 ms (21.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/disable-debugger-metrics
git_commit_date 1753877213 1753888216
git_commit_sha 2c5960b 1bdc547
release_version 1.51.1-SNAPSHOT~2c5960be47 1.51.1-SNAPSHOT~1bdc5472ee
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1753890259 1753890259
ci_job_id 1055594716 1055594716
ci_pipeline_id 72183398 72183398
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-95mto7bt 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-95mto7bt 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.440ms; -1.098ms] or [-38.996%; -29.737%]		 2.423ms 3.692ms
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.51.1-SNAPSHOT~1bdc5472ee, baseline=1.51.1-SNAPSHOT~2c5960be47
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.014 s) : 15014000, 15014000
.   : milestone, 15014000,
appsec (15.059 s) : 15059000, 15059000
.   : milestone, 15059000,
iast (18.475 s) : 18475000, 18475000
.   : milestone, 18475000,
iast_GLOBAL (18.101 s) : 18101000, 18101000
.   : milestone, 18101000,
profiling (15.526 s) : 15526000, 15526000
.   : milestone, 15526000,
tracing (14.913 s) : 14913000, 14913000
.   : milestone, 14913000,
section candidate
no_agent (14.961 s) : 14961000, 14961000
.   : milestone, 14961000,
appsec (15.05 s) : 15050000, 15050000
.   : milestone, 15050000,
iast (18.215 s) : 18215000, 18215000
.   : milestone, 18215000,
iast_GLOBAL (18.056 s) : 18056000, 18056000
.   : milestone, 18056000,
profiling (15.465 s) : 15465000, 15465000
.   : milestone, 15465000,
tracing (15.126 s) : 15126000, 15126000
.   : milestone, 15126000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.014 s [15.014 s, 15.014 s] -
appsec 15.059 s [15.059 s, 15.059 s] 45.0 ms (0.3%)
iast 18.475 s [18.475 s, 18.475 s] 3.461 s (23.1%)
iast_GLOBAL 18.101 s [18.101 s, 18.101 s] 3.087 s (20.6%)
profiling 15.526 s [15.526 s, 15.526 s] 512.0 ms (3.4%)
tracing 14.913 s [14.913 s, 14.913 s] -101.0 ms (-0.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.961 s [14.961 s, 14.961 s] -
appsec 15.05 s [15.05 s, 15.05 s] 89.0 ms (0.6%)
iast 18.215 s [18.215 s, 18.215 s] 3.254 s (21.7%)
iast_GLOBAL 18.056 s [18.056 s, 18.056 s] 3.095 s (20.7%)
profiling 15.465 s [15.465 s, 15.465 s] 504.0 ms (3.4%)
tracing 15.126 s [15.126 s, 15.126 s] 165.0 ms (1.1%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.51.1-SNAPSHOT~1bdc5472ee, baseline=1.51.1-SNAPSHOT~2c5960be47
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.49 ms) : 1478, 1502
.   : milestone, 1490,
appsec (3.692 ms) : 3473, 3911
.   : milestone, 3692,
iast (2.116 ms) : 2058, 2174
.   : milestone, 2116,
iast_GLOBAL (2.26 ms) : 2196, 2323
.   : milestone, 2260,
profiling (2.069 ms) : 2018, 2121
.   : milestone, 2069,
tracing (2.034 ms) : 1985, 2083
.   : milestone, 2034,
section candidate
no_agent (1.482 ms) : 1471, 1494
.   : milestone, 1482,
appsec (2.423 ms) : 2373, 2474
.   : milestone, 2423,
iast (2.215 ms) : 2152, 2279
.   : milestone, 2215,
iast_GLOBAL (2.251 ms) : 2187, 2314
.   : milestone, 2251,
profiling (2.084 ms) : 2032, 2136
.   : milestone, 2084,
tracing (2.044 ms) : 1994, 2093
.   : milestone, 2044,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.49 ms [1.478 ms, 1.502 ms] -
appsec 3.692 ms [3.473 ms, 3.911 ms] 2.203 ms (147.8%)
iast 2.116 ms [2.058 ms, 2.174 ms] 626.18 µs (42.0%)
iast_GLOBAL 2.26 ms [2.196 ms, 2.323 ms] 769.826 µs (51.7%)
profiling 2.069 ms [2.018 ms, 2.121 ms] 579.281 µs (38.9%)
tracing 2.034 ms [1.985 ms, 2.083 ms] 544.187 µs (36.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.471 ms, 1.494 ms] -
appsec 2.423 ms [2.373 ms, 2.474 ms] 941.253 µs (63.5%)
iast 2.215 ms [2.152 ms, 2.279 ms] 733.224 µs (49.5%)
iast_GLOBAL 2.251 ms [2.187 ms, 2.314 ms] 768.405 µs (51.8%)
profiling 2.084 ms [2.032 ms, 2.136 ms] 601.84 µs (40.6%)
tracing 2.044 ms [1.994 ms, 2.093 ms] 561.339 µs (37.9%)

@jpbempel jpbempel merged commit 1b40197 into master Jul 31, 2025
515 checks passed
@jpbempel jpbempel deleted the jpbempel/disable-debugger-metrics branch July 31, 2025 06:55
@github-actions github-actions Bot added this to the 1.52.0 milestone Jul 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@evanchooly evanchooly evanchooly approved these changes

@ojung ojung Awaiting requested review from ojung ojung is a code owner automatically assigned from DataDog/debugger-java

@amarziali amarziali Awaiting requested review from amarziali amarziali is a code owner automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

comp: debugger Dynamic Instrumentation tag: no release notes Changes to exclude from release notes type: bug Bug report and fix

Projects

None yet

Milestone

1.52.0

Development

Successfully merging this pull request may close these issues.

2 participants

@jpbempel @evanchooly