Skip to content

Conversation

@sarahchen6
Copy link
Contributor

@sarahchen6 sarahchen6 commented Dec 10, 2025

Backport #9774 to release/v1.56.x branch

@sarahchen6 sarahchen6 requested review from a team as code owners December 10, 2025 19:31
@sarahchen6 sarahchen6 requested review from dougqh and removed request for a team December 10, 2025 19:31
@datadog-official
Copy link

datadog-official bot commented Dec 10, 2025

🎯 Code Coverage
Patch Coverage: 0.00%
Total Coverage: 59.65% (+0.03%)

View detailed report

This comment will be updated automatically if new data arrives.
* Fix with Cursor requires Datadog plugin ≥v2.17.0
🔗 Commit SHA: 181e889 | Docs | Datadog PR Page | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Dec 10, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch release/v1.56.x sarah.chen/backport-pr-9774
git_commit_date 1765227844 1765395097
git_commit_sha cf52dcd 181e889
See matching parameters
Baseline Candidate
ci_job_date 1765396276 1765396276
ci_job_id 1285221728 1285221728
ci_pipeline_id 86043316 86043316
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce unsure
[-74232.054op/s; -9509.143op/s] or [-4.045%; -0.518%]
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce unsure
[-7849.688op/s; -194.115op/s] or [-4.401%; -0.109%]
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Dec 10, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch release/v1.56.x sarah.chen/backport-pr-9774
git_commit_date 1765227844 1765395097
git_commit_sha cf52dcd 181e889
See matching parameters
Baseline Candidate
ci_job_date 1765396318 1765396318
ci_job_id 1285221731 1285221731
ci_pipeline_id 86043316 86043316
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@pr-commenter
Copy link

pr-commenter bot commented Dec 10, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarah.chen/backport-pr-9774
git_commit_date 1763637994 1765395097
git_commit_sha c05874d 181e889
release_version 1.56.0~c05874d84e 1.57.0-SNAPSHOT~181e8892a9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765396985 1765396985
ci_job_id 1285221711 1285221711
ci_pipeline_id 86043316 86043316
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-jplcljra 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-jplcljra 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 10 performance improvements and 10 performance regressions! Performance is the same for 35 metrics, 10 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent better
[-293.937ms; -231.071ms] or [-3.073%; -2.416%]
9.302s 9.565s
scenario:startup:insecure-bank:iast:Debugger better
[-54.122ms; -53.146ms] or [-90.484%; -88.852%]
6.180ms 59.814ms
scenario:startup:insecure-bank:iast:Remote Config worse
[+46.999µs; +96.529µs] or [+8.563%; +17.586%]
620.646µs 548.882µs
scenario:startup:insecure-bank:iast:Telemetry worse
[+347.715µs; +842.800µs] or [+4.562%; +11.057%]
8.218ms 7.622ms
scenario:startup:insecure-bank:tracing:Agent.start better
[-82.908ms; -42.343ms] or [-7.419%; -3.789%]
1.055s 1.117s
scenario:startup:insecure-bank:tracing:Debugger better
[-58.573ms; -56.535ms] or [-91.593%; -88.405%]
6.395ms 63.949ms
scenario:startup:petclinic:appsec:Agent.start better
[-58.467ms; -46.926ms] or [-4.558%; -3.658%]
1.230s 1.283s
scenario:startup:petclinic:appsec:Debugger better
[-56.138ms; -54.652ms] or [-91.002%; -88.593%]
6.294ms 61.689ms
scenario:startup:petclinic:iast:Debugger better
[-55.361ms; -54.210ms] or [-90.873%; -88.984%]
6.136ms 60.922ms
scenario:startup:petclinic:iast:Remote Config worse
[+40.636µs; +90.026µs] or [+7.381%; +16.351%]
615.913µs 550.582µs
scenario:startup:petclinic:iast:Telemetry worse
[+181.073µs; +657.178µs] or [+2.388%; +8.666%]
8.003ms 7.584ms
scenario:startup:petclinic:profiling:ProfilingAgent worse
[+11.201ms; +15.913ms] or [+11.470%; +16.295%]
111.210ms 97.653ms
scenario:startup:petclinic:profiling:Debugger better
[-57.265ms; -53.912ms] or [-90.504%; -85.205%]
7.685ms 63.273ms
scenario:startup:petclinic:profiling:Flare Poller worse
[+242.822µs; +444.884µs] or [+6.450%; +11.817%]
4.109ms 3.765ms
scenario:startup:petclinic:profiling:Profiling worse
[+11.254ms; +16.003ms] or [+11.455%; +16.288%]
111.877ms 98.248ms
scenario:startup:petclinic:tracing:Agent.start better
[-73.954ms; -46.241ms] or [-6.644%; -4.154%]
1.053s 1.113s
scenario:startup:petclinic:tracing:Debugger better
[-58.808ms; -57.378ms] or [-91.155%; -88.938%]
6.421ms 64.514ms
scenario:startup:petclinic:tracing:Remote Config worse
[+19.522µs; +52.281µs] or [+3.048%; +8.162%]
676.430µs 640.528µs
scenario:startup:petclinic:tracing:Telemetry worse
[+7.526ms; +8.259ms] or [+89.538%; +98.252%]
16.299ms 8.406ms
scenario:startup:petclinic:tracing:Flare Poller worse
[+180.794µs; +371.952µs] or [+4.727%; +9.725%]
4.101ms 3.825ms
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~181e8892a9, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.113 s) : 0, 1113078
Total [baseline] (10.772 s) : 0, 10771907
Agent [candidate] (1.053 s) : 0, 1052981
Total [candidate] (10.834 s) : 0, 10833676
section appsec
Agent [baseline] (1.283 s) : 0, 1282814
Total [baseline] (11.008 s) : 0, 11008137
Agent [candidate] (1.23 s) : 0, 1230118
Total [candidate] (10.979 s) : 0, 10978951
section iast
Agent [baseline] (1.24 s) : 0, 1240253
Total [baseline] (11.19 s) : 0, 11189533
Agent [candidate] (1.2 s) : 0, 1200388
Total [candidate] (11.231 s) : 0, 11231406
section profiling
Agent [baseline] (1.236 s) : 0, 1236092
Total [baseline] (11.097 s) : 0, 11096542
Agent [candidate] (1.204 s) : 0, 1204009
Total [candidate] (10.916 s) : 0, 10916368
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.113 s -
Agent appsec 1.283 s 169.736 ms (15.2%)
Agent iast 1.24 s 127.175 ms (11.4%)
Agent profiling 1.236 s 123.014 ms (11.1%)
Total tracing 10.772 s -
Total appsec 11.008 s 236.229 ms (2.2%)
Total iast 11.19 s 417.625 ms (3.9%)
Total profiling 11.097 s 324.635 ms (3.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent appsec 1.23 s 177.137 ms (16.8%)
Agent iast 1.2 s 147.408 ms (14.0%)
Agent profiling 1.204 s 151.028 ms (14.3%)
Total tracing 10.834 s -
Total appsec 10.979 s 145.275 ms (1.3%)
Total iast 11.231 s 397.73 ms (3.7%)
Total profiling 10.916 s 82.692 ms (0.8%)
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~181e8892a9, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.491 ms) : 0, 1491
crashtracking [candidate] (1.475 ms) : 0, 1475
BytebuddyAgent [baseline] (714.948 ms) : 0, 714948
BytebuddyAgent [candidate] (707.105 ms) : 0, 707105
GlobalTracer [baseline] (251.707 ms) : 0, 251707
GlobalTracer [candidate] (249.868 ms) : 0, 249868
AppSec [baseline] (32.372 ms) : 0, 32372
AppSec [candidate] (32.192 ms) : 0, 32192
Debugger [baseline] (64.514 ms) : 0, 64514
Debugger [candidate] (6.421 ms) : 0, 6421
Remote Config [baseline] (640.528 µs) : 0, 641
Remote Config [candidate] (676.43 µs) : 0, 676
Telemetry [baseline] (8.406 ms) : 0, 8406
Telemetry [candidate] (16.299 ms) : 0, 16299
Flare Poller [baseline] (3.825 ms) : 0, 3825
Flare Poller [candidate] (4.101 ms) : 0, 4101
section appsec
crashtracking [baseline] (1.458 ms) : 0, 1458
crashtracking [candidate] (1.445 ms) : 0, 1445
BytebuddyAgent [baseline] (732.095 ms) : 0, 732095
BytebuddyAgent [candidate] (733.673 ms) : 0, 733673
GlobalTracer [baseline] (240.607 ms) : 0, 240607
GlobalTracer [candidate] (241.03 ms) : 0, 241030
IAST [baseline] (24.502 ms) : 0, 24502
IAST [candidate] (24.814 ms) : 0, 24814
AppSec [baseline] (174.688 ms) : 0, 174688
AppSec [candidate] (174.857 ms) : 0, 174857
Debugger [baseline] (61.689 ms) : 0, 61689
Debugger [candidate] (6.294 ms) : 0, 6294
Remote Config [baseline] (677.321 µs) : 0, 677
Remote Config [candidate] (702.869 µs) : 0, 703
Telemetry [baseline] (8.229 ms) : 0, 8229
Telemetry [candidate] (8.212 ms) : 0, 8212
Flare Poller [baseline] (3.93 ms) : 0, 3930
Flare Poller [candidate] (3.999 ms) : 0, 3999
section iast
crashtracking [baseline] (1.449 ms) : 0, 1449
crashtracking [candidate] (1.464 ms) : 0, 1464
BytebuddyAgent [baseline] (832.032 ms) : 0, 832032
BytebuddyAgent [candidate] (837.663 ms) : 0, 837663
GlobalTracer [baseline] (237.811 ms) : 0, 237811
GlobalTracer [candidate] (238.928 ms) : 0, 238928
IAST [baseline] (27.604 ms) : 0, 27604
IAST [candidate] (31.44 ms) : 0, 31440
AppSec [baseline] (33.884 ms) : 0, 33884
AppSec [candidate] (30.185 ms) : 0, 30185
Debugger [baseline] (60.922 ms) : 0, 60922
Debugger [candidate] (6.136 ms) : 0, 6136
Remote Config [baseline] (550.581 µs) : 0, 551
Remote Config [candidate] (615.913 µs) : 0, 616
Telemetry [baseline] (7.584 ms) : 0, 7584
Telemetry [candidate] (8.003 ms) : 0, 8003
Flare Poller [baseline] (3.48 ms) : 0, 3480
Flare Poller [candidate] (10.804 ms) : 0, 10804
section profiling
crashtracking [baseline] (1.437 ms) : 0, 1437
crashtracking [candidate] (1.46 ms) : 0, 1460
BytebuddyAgent [baseline] (735.99 ms) : 0, 735990
BytebuddyAgent [candidate] (737.57 ms) : 0, 737570
GlobalTracer [baseline] (223.281 ms) : 0, 223281
GlobalTracer [candidate] (223.466 ms) : 0, 223466
AppSec [baseline] (32.259 ms) : 0, 32259
AppSec [candidate] (32.242 ms) : 0, 32242
Debugger [baseline] (63.273 ms) : 0, 63273
Debugger [candidate] (7.685 ms) : 0, 7685
Remote Config [baseline] (661.187 µs) : 0, 661
Remote Config [candidate] (698.399 µs) : 0, 698
Telemetry [baseline] (7.97 ms) : 0, 7970
Telemetry [candidate] (15.48 ms) : 0, 15480
Flare Poller [baseline] (3.765 ms) : 0, 3765
Flare Poller [candidate] (4.109 ms) : 0, 4109
ProfilingAgent [baseline] (97.653 ms) : 0, 97653
ProfilingAgent [candidate] (111.21 ms) : 0, 111210
Profiling [baseline] (98.248 ms) : 0, 98248
Profiling [candidate] (111.877 ms) : 0, 111877
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~181e8892a9, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.117 s) : 0, 1117462
Total [baseline] (8.849 s) : 0, 8849324
Agent [candidate] (1.055 s) : 0, 1054836
Total [candidate] (8.649 s) : 0, 8648760
section iast
Agent [baseline] (1.241 s) : 0, 1241046
Total [baseline] (9.565 s) : 0, 9564702
Agent [candidate] (1.201 s) : 0, 1200851
Total [candidate] (9.302 s) : 0, 9302198
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.117 s -
Agent iast 1.241 s 123.584 ms (11.1%)
Total tracing 8.849 s -
Total iast 9.565 s 715.378 ms (8.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.201 s 146.015 ms (13.8%)
Total tracing 8.649 s -
Total iast 9.302 s 653.438 ms (7.6%)
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~181e8892a9, baseline=1.56.0~c05874d84e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.486 ms) : 0, 1486
crashtracking [candidate] (1.454 ms) : 0, 1454
BytebuddyAgent [baseline] (718.749 ms) : 0, 718749
BytebuddyAgent [candidate] (709.176 ms) : 0, 709176
GlobalTracer [baseline] (252.597 ms) : 0, 252597
GlobalTracer [candidate] (249.683 ms) : 0, 249683
AppSec [baseline] (32.643 ms) : 0, 32643
AppSec [candidate] (32.086 ms) : 0, 32086
Debugger [baseline] (63.949 ms) : 0, 63949
Debugger [candidate] (6.395 ms) : 0, 6395
Remote Config [baseline] (644.848 µs) : 0, 645
Remote Config [candidate] (669.334 µs) : 0, 669
Telemetry [baseline] (8.457 ms) : 0, 8457
Telemetry [candidate] (14.792 ms) : 0, 14792
Flare Poller [baseline] (3.846 ms) : 0, 3846
Flare Poller [candidate] (4.989 ms) : 0, 4989
section iast
crashtracking [baseline] (1.453 ms) : 0, 1453
crashtracking [candidate] (1.474 ms) : 0, 1474
BytebuddyAgent [baseline] (833.738 ms) : 0, 833738
BytebuddyAgent [candidate] (838.064 ms) : 0, 838064
GlobalTracer [baseline] (237.595 ms) : 0, 237595
GlobalTracer [candidate] (238.245 ms) : 0, 238245
AppSec [baseline] (34.169 ms) : 0, 34169
AppSec [candidate] (33.32 ms) : 0, 33320
Debugger [baseline] (59.814 ms) : 0, 59814
Debugger [candidate] (6.18 ms) : 0, 6180
Remote Config [baseline] (548.882 µs) : 0, 549
Remote Config [candidate] (620.646 µs) : 0, 621
Telemetry [baseline] (7.622 ms) : 0, 7622
Telemetry [candidate] (8.218 ms) : 0, 8218
Flare Poller [baseline] (3.437 ms) : 0, 3437
Flare Poller [candidate] (10.986 ms) : 0, 10986
IAST [baseline] (27.672 ms) : 0, 27672
IAST [candidate] (28.652 ms) : 0, 28652
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarah.chen/backport-pr-9774
git_commit_date 1763637994 1765395097
git_commit_sha c05874d 181e889
release_version 1.56.0~c05874d84e 1.57.0-SNAPSHOT~181e8892a9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765397562 1765397562
ci_job_id 1285221715 1285221715
ci_pipeline_id 86043316 86043316
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-m58gfmcp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-m58gfmcp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 5 performance improvements and 3 performance regressions! Performance is the same for 13 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+89.577µs; +183.058µs] or [+3.297%; +6.737%]
unsure
[+147.038µs; +450.836µs] or [+1.902%; +5.833%]
unstable
[-195.515op/s; +72.327op/s] or [-14.744%; +5.454%]
2.854ms 8.028ms 1264.500op/s 2.717ms 7.729ms 1326.094op/s
scenario:load:petclinic:profiling:high_load better
[-2.544ms; -1.921ms] or [-12.337%; -9.313%]
better
[-3.396ms; -2.146ms] or [-10.498%; -6.633%]
unstable
[-0.348op/s; +51.535op/s] or [-0.155%; +22.920%]
18.391ms 29.579ms 250.438op/s 20.624ms 32.350ms 224.844op/s
scenario:load:petclinic:iast:high_load worse
[+0.729ms; +1.775ms] or [+4.183%; +10.188%]
worse
[+0.666ms; +2.541ms] or [+2.326%; +8.877%]
unstable
[-43.113op/s; +13.238op/s] or [-16.438%; +5.047%]
18.670ms 30.225ms 247.344op/s 17.419ms 28.622ms 262.281op/s
scenario:load:petclinic:appsec:high_load better
[-1.495ms; -0.572ms] or [-7.741%; -2.960%]
unsure
[-2.061ms; -0.397ms] or [-6.640%; -1.279%]
unstable
[-13.114op/s; +40.801op/s] or [-5.501%; +17.116%]
18.282ms 29.803ms 252.219op/s 19.316ms 31.031ms 238.375op/s
scenario:load:petclinic:no_agent:high_load better
[-3.024ms; -1.555ms] or [-15.993%; -8.225%]
better
[-4.635ms; -1.922ms] or [-14.836%; -6.153%]
unstable
[-1.231op/s; +57.606op/s] or [-0.505%; +23.618%]
16.620ms 27.962ms 272.094op/s 18.910ms 31.241ms 243.906op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~181e8892a9, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.205 ms) : 1194, 1216
.   : milestone, 1205,
iast (3.381 ms) : 3335, 3426
.   : milestone, 3381,
iast_FULL (5.89 ms) : 5830, 5949
.   : milestone, 5890,
iast_GLOBAL (3.456 ms) : 3410, 3503
.   : milestone, 3456,
profiling (2.101 ms) : 2083, 2119
.   : milestone, 2101,
tracing (1.843 ms) : 1827, 1860
.   : milestone, 1843,
section candidate
no_agent (1.215 ms) : 1203, 1227
.   : milestone, 1215,
iast (3.361 ms) : 3315, 3406
.   : milestone, 3361,
iast_FULL (5.865 ms) : 5805, 5924
.   : milestone, 5865,
iast_GLOBAL (3.627 ms) : 3568, 3687
.   : milestone, 3627,
profiling (2.133 ms) : 2113, 2152
.   : milestone, 2133,
tracing (1.83 ms) : 1814, 1846
.   : milestone, 1830,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.205 ms [1.194 ms, 1.216 ms] -
iast 3.381 ms [3.335 ms, 3.426 ms] 2.176 ms (180.5%)
iast_FULL 5.89 ms [5.83 ms, 5.949 ms] 4.684 ms (388.7%)
iast_GLOBAL 3.456 ms [3.41 ms, 3.503 ms] 2.251 ms (186.8%)
profiling 2.101 ms [2.083 ms, 2.119 ms] 895.776 µs (74.3%)
tracing 1.843 ms [1.827 ms, 1.86 ms] 638.01 µs (52.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.215 ms [1.203 ms, 1.227 ms] -
iast 3.361 ms [3.315 ms, 3.406 ms] 2.145 ms (176.6%)
iast_FULL 5.865 ms [5.805 ms, 5.924 ms] 4.649 ms (382.7%)
iast_GLOBAL 3.627 ms [3.568 ms, 3.687 ms] 2.412 ms (198.5%)
profiling 2.133 ms [2.113 ms, 2.152 ms] 917.737 µs (75.5%)
tracing 1.83 ms [1.814 ms, 1.846 ms] 614.746 µs (50.6%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~181e8892a9, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.139 ms) : 18947, 19330
.   : milestone, 19139,
appsec (19.581 ms) : 19381, 19781
.   : milestone, 19581,
code_origins (17.895 ms) : 17721, 18070
.   : milestone, 17895,
iast (17.788 ms) : 17611, 17964
.   : milestone, 17788,
profiling (20.763 ms) : 20553, 20972
.   : milestone, 20763,
tracing (17.726 ms) : 17547, 17905
.   : milestone, 17726,
section candidate
no_agent (17.146 ms) : 16976, 17316
.   : milestone, 17146,
appsec (18.503 ms) : 18313, 18692
.   : milestone, 18503,
code_origins (18.102 ms) : 17922, 18281
.   : milestone, 18102,
iast (18.869 ms) : 18676, 19063
.   : milestone, 18869,
profiling (18.632 ms) : 18450, 18815
.   : milestone, 18632,
tracing (17.697 ms) : 17522, 17873
.   : milestone, 17697,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.139 ms [18.947 ms, 19.33 ms] -
appsec 19.581 ms [19.381 ms, 19.781 ms] 442.572 µs (2.3%)
code_origins 17.895 ms [17.721 ms, 18.07 ms] -1.243 ms (-6.5%)
iast 17.788 ms [17.611 ms, 17.964 ms] -1.351 ms (-7.1%)
profiling 20.763 ms [20.553 ms, 20.972 ms] 1.624 ms (8.5%)
tracing 17.726 ms [17.547 ms, 17.905 ms] -1.413 ms (-7.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.146 ms [16.976 ms, 17.316 ms] -
appsec 18.503 ms [18.313 ms, 18.692 ms] 1.357 ms (7.9%)
code_origins 18.102 ms [17.922 ms, 18.281 ms] 955.802 µs (5.6%)
iast 18.869 ms [18.676 ms, 19.063 ms] 1.723 ms (10.1%)
profiling 18.632 ms [18.45 ms, 18.815 ms] 1.487 ms (8.7%)
tracing 17.697 ms [17.522 ms, 17.873 ms] 551.537 µs (3.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarah.chen/backport-pr-9774
git_commit_date 1763637994 1765395097
git_commit_sha c05874d 181e889
release_version 1.56.0~c05874d84e 1.57.0-SNAPSHOT~181e8892a9
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1765397294 1765397294
ci_job_id 1285221719 1285221719
ci_pipeline_id 86043316 86043316
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-7qgotx54 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-7qgotx54 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~181e8892a9, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (3.709 ms) : 3490, 3928
.   : milestone, 3709,
iast (2.213 ms) : 2148, 2278
.   : milestone, 2213,
iast_GLOBAL (2.26 ms) : 2194, 2325
.   : milestone, 2260,
profiling (2.073 ms) : 2020, 2127
.   : milestone, 2073,
tracing (2.048 ms) : 1997, 2100
.   : milestone, 2048,
section candidate
no_agent (1.475 ms) : 1464, 1487
.   : milestone, 1475,
appsec (3.698 ms) : 3480, 3916
.   : milestone, 3698,
iast (2.212 ms) : 2148, 2277
.   : milestone, 2212,
iast_GLOBAL (2.251 ms) : 2186, 2316
.   : milestone, 2251,
profiling (2.092 ms) : 2038, 2146
.   : milestone, 2092,
tracing (2.04 ms) : 1989, 2091
.   : milestone, 2040,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.488 ms] -
appsec 3.709 ms [3.49 ms, 3.928 ms] 2.232 ms (151.2%)
iast 2.213 ms [2.148 ms, 2.278 ms] 736.145 µs (49.9%)
iast_GLOBAL 2.26 ms [2.194 ms, 2.325 ms] 783.12 µs (53.0%)
profiling 2.073 ms [2.02 ms, 2.127 ms] 596.704 µs (40.4%)
tracing 2.048 ms [1.997 ms, 2.1 ms] 571.703 µs (38.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.464 ms, 1.487 ms] -
appsec 3.698 ms [3.48 ms, 3.916 ms] 2.222 ms (150.6%)
iast 2.212 ms [2.148 ms, 2.277 ms] 736.855 µs (49.9%)
iast_GLOBAL 2.251 ms [2.186 ms, 2.316 ms] 775.184 µs (52.5%)
profiling 2.092 ms [2.038 ms, 2.146 ms] 616.642 µs (41.8%)
tracing 2.04 ms [1.989 ms, 2.091 ms] 564.601 µs (38.3%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~181e8892a9, baseline=1.56.0~c05874d84e
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.921 s) : 14921000, 14921000
.   : milestone, 14921000,
appsec (15.145 s) : 15145000, 15145000
.   : milestone, 15145000,
iast (17.922 s) : 17922000, 17922000
.   : milestone, 17922000,
iast_GLOBAL (17.97 s) : 17970000, 17970000
.   : milestone, 17970000,
profiling (14.61 s) : 14610000, 14610000
.   : milestone, 14610000,
tracing (14.739 s) : 14739000, 14739000
.   : milestone, 14739000,
section candidate
no_agent (15.089 s) : 15089000, 15089000
.   : milestone, 15089000,
appsec (15.138 s) : 15138000, 15138000
.   : milestone, 15138000,
iast (18.573 s) : 18573000, 18573000
.   : milestone, 18573000,
iast_GLOBAL (18.122 s) : 18122000, 18122000
.   : milestone, 18122000,
profiling (14.701 s) : 14701000, 14701000
.   : milestone, 14701000,
tracing (14.93 s) : 14930000, 14930000
.   : milestone, 14930000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.921 s [14.921 s, 14.921 s] -
appsec 15.145 s [15.145 s, 15.145 s] 224.0 ms (1.5%)
iast 17.922 s [17.922 s, 17.922 s] 3.001 s (20.1%)
iast_GLOBAL 17.97 s [17.97 s, 17.97 s] 3.049 s (20.4%)
profiling 14.61 s [14.61 s, 14.61 s] -311.0 ms (-2.1%)
tracing 14.739 s [14.739 s, 14.739 s] -182.0 ms (-1.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.089 s [15.089 s, 15.089 s] -
appsec 15.138 s [15.138 s, 15.138 s] 49.0 ms (0.3%)
iast 18.573 s [18.573 s, 18.573 s] 3.484 s (23.1%)
iast_GLOBAL 18.122 s [18.122 s, 18.122 s] 3.033 s (20.1%)
profiling 14.701 s [14.701 s, 14.701 s] -388.0 ms (-2.6%)
tracing 14.93 s [14.93 s, 14.93 s] -159.0 ms (-1.1%)

@sarahchen6 sarahchen6 enabled auto-merge (squash) December 10, 2025 20:44
@sarahchen6 sarahchen6 merged commit 0e5412e into release/v1.56.x Dec 10, 2025
547 checks passed
@sarahchen6 sarahchen6 deleted the sarah.chen/backport-pr-9774 branch December 10, 2025 21:17
@PerfectSlayer PerfectSlayer added this to the 1.56.3 milestone Dec 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants