Skip to content

Remove load and add dacapo benchmarks to check-big-regressions#9924

Merged
sarahchen6 merged 2 commits intomasterfrom
sarahchen6/edit-check-big-regressions
Nov 10, 2025
Merged

Remove load and add dacapo benchmarks to check-big-regressions#9924
sarahchen6 merged 2 commits intomasterfrom
sarahchen6/edit-check-big-regressions

Conversation

@sarahchen6
Copy link
Copy Markdown
Contributor

@sarahchen6 sarahchen6 commented Nov 10, 2025

What Does This Do

Removes the load benchmarks and adds dacapo benchmarks to the check-big-regressions PR gate.

Motivation

The load benchmarks are very unstable, causing false positives and PRs to be blocked on check-big-regressions even when the changes are un-related to these benchmarks.

On the contrary, it seems like dacapo benchmarks are very stable, so we can add those in.

Additional Notes

We're currently looking into stabilizing the load benchmarks. We will add load benchmarks back in ASAP once this is achieved.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@sarahchen6 sarahchen6 added the tag: no release notes Changes to exclude from release notes label Nov 10, 2025
@sarahchen6 sarahchen6 requested a review from a team as a code owner November 10, 2025 15:22
@sarahchen6 sarahchen6 added the comp: tooling Build & Tooling label Nov 10, 2025
@sarahchen6 sarahchen6 requested review from TonyCTHsu and removed request for a team November 10, 2025 15:22
@datadog-datadog-prod-us1
Copy link
Copy Markdown
Contributor

datadog-datadog-prod-us1 Bot commented Nov 10, 2025 •
edited
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.60% (-0.01%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 73612ba | Docs | Datadog PR Page | Was this helpful? Give us feedback!

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Nov 10, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/edit-check-big-regressions
git_commit_date 1762797252 1762798963
git_commit_sha 4a54f5a 73612ba
release_version 1.56.0-SNAPSHOT~4a54f5ae55 1.56.0-SNAPSHOT~73612ba8fa
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1762801026 1762801026
ci_job_id 1226154671 1226154671
ci_pipeline_id 81854498 81854498
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-irytwxsb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-irytwxsb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 11 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~73612ba8fa, baseline=1.56.0-SNAPSHOT~4a54f5ae55

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.049 s) : 0, 1049247
Total [baseline] (10.816 s) : 0, 10815880
Agent [candidate] (1.051 s) : 0, 1051380
Total [candidate] (10.919 s) : 0, 10919331
section appsec
Agent [baseline] (1.233 s) : 0, 1232999
Total [baseline] (10.97 s) : 0, 10969554
Agent [candidate] (1.223 s) : 0, 1223201
Total [candidate] (10.869 s) : 0, 10869396
section iast
Agent [baseline] (1.19 s) : 0, 1190069
Total [baseline] (11.165 s) : 0, 11165248
Agent [candidate] (1.181 s) : 0, 1181488
Total [candidate] (11.215 s) : 0, 11214623
section profiling
Agent [baseline] (1.199 s) : 0, 1199176
Total [baseline] (10.909 s) : 0, 10908728
Agent [candidate] (1.198 s) : 0, 1198353
Total [candidate] (10.902 s) : 0, 10901792
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent appsec 1.233 s 183.751 ms (17.5%)
Agent iast 1.19 s 140.821 ms (13.4%)
Agent profiling 1.199 s 149.928 ms (14.3%)
Total tracing 10.816 s -
Total appsec 10.97 s 153.675 ms (1.4%)
Total iast 11.165 s 349.369 ms (3.2%)
Total profiling 10.909 s 92.848 ms (0.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent appsec 1.223 s 171.821 ms (16.3%)
Agent iast 1.181 s 130.108 ms (12.4%)
Agent profiling 1.198 s 146.972 ms (14.0%)
Total tracing 10.919 s -
Total appsec 10.869 s -49.935 ms (-0.5%)
Total iast 11.215 s 295.292 ms (2.7%)
Total profiling 10.902 s -17.539 ms (-0.2%) 
gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~73612ba8fa, baseline=1.56.0-SNAPSHOT~4a54f5ae55

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.454 ms) : 0, 1454
crashtracking [candidate] (1.466 ms) : 0, 1466
BytebuddyAgent [baseline] (706.292 ms) : 0, 706292
BytebuddyAgent [candidate] (707.535 ms) : 0, 707535
GlobalTracer [baseline] (246.104 ms) : 0, 246104
GlobalTracer [candidate] (246.855 ms) : 0, 246855
AppSec [baseline] (32.518 ms) : 0, 32518
AppSec [candidate] (32.554 ms) : 0, 32554
Debugger [baseline] (6.388 ms) : 0, 6388
Debugger [candidate] (6.429 ms) : 0, 6429
Remote Config [baseline] (714.883 µs) : 0, 715
Remote Config [candidate] (718.852 µs) : 0, 719
Telemetry [baseline] (14.412 ms) : 0, 14412
Telemetry [candidate] (13.817 ms) : 0, 13817
Flare Poller [baseline] (6.473 ms) : 0, 6473
Flare Poller [candidate] (7.224 ms) : 0, 7224
section appsec
crashtracking [baseline] (1.485 ms) : 0, 1485
crashtracking [candidate] (1.457 ms) : 0, 1457
BytebuddyAgent [baseline] (736.426 ms) : 0, 736426
BytebuddyAgent [candidate] (730.279 ms) : 0, 730279
GlobalTracer [baseline] (239.658 ms) : 0, 239658
GlobalTracer [candidate] (237.942 ms) : 0, 237942
IAST [baseline] (25.153 ms) : 0, 25153
IAST [candidate] (24.878 ms) : 0, 24878
AppSec [baseline] (175.684 ms) : 0, 175684
AppSec [candidate] (174.644 ms) : 0, 174644
Debugger [baseline] (6.114 ms) : 0, 6114
Debugger [candidate] (5.952 ms) : 0, 5952
Remote Config [baseline] (659.251 µs) : 0, 659
Remote Config [candidate] (651.407 µs) : 0, 651
Telemetry [baseline] (8.773 ms) : 0, 8773
Telemetry [candidate] (8.5 ms) : 0, 8500
Flare Poller [baseline] (4.02 ms) : 0, 4020
Flare Poller [candidate] (4.025 ms) : 0, 4025
section iast
crashtracking [baseline] (1.479 ms) : 0, 1479
crashtracking [candidate] (1.458 ms) : 0, 1458
BytebuddyAgent [baseline] (836.663 ms) : 0, 836663
BytebuddyAgent [candidate] (829.552 ms) : 0, 829552
GlobalTracer [baseline] (236.825 ms) : 0, 236825
GlobalTracer [candidate] (235.201 ms) : 0, 235201
IAST [baseline] (34.087 ms) : 0, 34087
IAST [candidate] (31.661 ms) : 0, 31661
AppSec [baseline] (27.066 ms) : 0, 27066
AppSec [candidate] (29.616 ms) : 0, 29616
Debugger [baseline] (5.949 ms) : 0, 5949
Debugger [candidate] (5.961 ms) : 0, 5961
Remote Config [baseline] (594.069 µs) : 0, 594
Remote Config [candidate] (601.447 µs) : 0, 601
Telemetry [baseline] (8.3 ms) : 0, 8300
Telemetry [candidate] (8.534 ms) : 0, 8534
Flare Poller [baseline] (4.163 ms) : 0, 4163
Flare Poller [candidate] (4.153 ms) : 0, 4153
section profiling
crashtracking [baseline] (1.456 ms) : 0, 1456
crashtracking [candidate] (1.455 ms) : 0, 1455
BytebuddyAgent [baseline] (734.421 ms) : 0, 734421
BytebuddyAgent [candidate] (732.799 ms) : 0, 732799
GlobalTracer [baseline] (222.408 ms) : 0, 222408
GlobalTracer [candidate] (222.923 ms) : 0, 222923
AppSec [baseline] (32.06 ms) : 0, 32060
AppSec [candidate] (32.233 ms) : 0, 32233
Debugger [baseline] (6.738 ms) : 0, 6738
Debugger [candidate] (9.046 ms) : 0, 9046
Remote Config [baseline] (702.31 µs) : 0, 702
Remote Config [candidate] (696.451 µs) : 0, 696
Telemetry [baseline] (16.563 ms) : 0, 16563
Telemetry [candidate] (13.867 ms) : 0, 13867
Flare Poller [baseline] (4.105 ms) : 0, 4105
Flare Poller [candidate] (4.14 ms) : 0, 4140
ProfilingAgent [baseline] (110.41 ms) : 0, 110410
ProfilingAgent [candidate] (111.126 ms) : 0, 111126
Profiling [baseline] (111.093 ms) : 0, 111093
Profiling [candidate] (111.797 ms) : 0, 111797
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~73612ba8fa, baseline=1.56.0-SNAPSHOT~4a54f5ae55

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.048 s) : 0, 1047791
Total [baseline] (8.677 s) : 0, 8676734
Agent [candidate] (1.066 s) : 0, 1065693
Total [candidate] (8.672 s) : 0, 8671595
section iast
Agent [baseline] (1.182 s) : 0, 1181511
Total [baseline] (9.281 s) : 0, 9280932
Agent [candidate] (1.185 s) : 0, 1185032
Total [candidate] (9.275 s) : 0, 9274847
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.048 s -
Agent iast 1.182 s 133.72 ms (12.8%)
Total tracing 8.677 s -
Total iast 9.281 s 604.199 ms (7.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent iast 1.185 s 119.339 ms (11.2%)
Total tracing 8.672 s -
Total iast 9.275 s 603.252 ms (7.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~73612ba8fa, baseline=1.56.0-SNAPSHOT~4a54f5ae55

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.461 ms) : 0, 1461
crashtracking [candidate] (1.487 ms) : 0, 1487
BytebuddyAgent [baseline] (705.624 ms) : 0, 705624
BytebuddyAgent [candidate] (717.17 ms) : 0, 717170
GlobalTracer [baseline] (245.663 ms) : 0, 245663
GlobalTracer [candidate] (250.35 ms) : 0, 250350
AppSec [baseline] (32.203 ms) : 0, 32203
AppSec [candidate] (32.965 ms) : 0, 32965
Debugger [baseline] (6.423 ms) : 0, 6423
Debugger [candidate] (6.551 ms) : 0, 6551
Remote Config [baseline] (718.042 µs) : 0, 718
Remote Config [candidate] (726.3 µs) : 0, 726
Telemetry [baseline] (15.191 ms) : 0, 15191
Telemetry [candidate] (15.37 ms) : 0, 15370
Flare Poller [baseline] (5.827 ms) : 0, 5827
Flare Poller [candidate] (5.922 ms) : 0, 5922
section iast
crashtracking [baseline] (1.466 ms) : 0, 1466
crashtracking [candidate] (1.471 ms) : 0, 1471
BytebuddyAgent [baseline] (829.589 ms) : 0, 829589
BytebuddyAgent [candidate] (833.353 ms) : 0, 833353
GlobalTracer [baseline] (235.299 ms) : 0, 235299
GlobalTracer [candidate] (235.057 ms) : 0, 235057
AppSec [baseline] (26.884 ms) : 0, 26884
AppSec [candidate] (29.704 ms) : 0, 29704
Debugger [baseline] (5.997 ms) : 0, 5997
Debugger [candidate] (6.017 ms) : 0, 6017
Remote Config [baseline] (596.822 µs) : 0, 597
Remote Config [candidate] (598.053 µs) : 0, 598
Telemetry [baseline] (8.358 ms) : 0, 8358
Telemetry [candidate] (8.417 ms) : 0, 8417
Flare Poller [baseline] (4.116 ms) : 0, 4116
Flare Poller [candidate] (4.109 ms) : 0, 4109
IAST [baseline] (34.377 ms) : 0, 34377
IAST [candidate] (31.389 ms) : 0, 31389
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/edit-check-big-regressions
git_commit_date 1762797252 1762798963
git_commit_sha 4a54f5a 73612ba
release_version 1.56.0-SNAPSHOT~4a54f5ae55 1.56.0-SNAPSHOT~73612ba8fa
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1762801517 1762801517
ci_job_id 1226154675 1226154675
ci_pipeline_id 81854498 81854498
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-uu8i8zrh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-uu8i8zrh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 9 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:tracing:high_load worse
[+133.306µs; +167.857µs] or [+7.605%; +9.576%]		 unstable
[-474.984op/s; +87.047op/s] or [-18.547%; +3.399%]		 1.903ms 2367.000op/s 1.753ms 2560.969op/s
scenario:load:petclinic:no_agent:high_load worse
[+776.579µs; +1191.305µs] or [+4.290%; +6.580%]		 unstable
[-42.739op/s; +16.364op/s] or [-16.584%; +6.350%]		 19.088ms 244.531op/s 18.104ms 257.719op/s
scenario:load:petclinic:code_origins:high_load better
[-924.494µs; -536.694µs] or [-4.994%; -2.899%]		 unstable
[-17.503op/s; +38.316op/s] or [-6.943%; +15.199%]		 17.780ms 262.500op/s 18.510ms 252.094op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~73612ba8fa, baseline=1.56.0-SNAPSHOT~4a54f5ae55
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.104 ms) : 17917, 18291
.   : milestone, 18104,
appsec (18.508 ms) : 18321, 18696
.   : milestone, 18508,
code_origins (18.51 ms) : 18324, 18696
.   : milestone, 18510,
iast (17.601 ms) : 17426, 17776
.   : milestone, 17601,
profiling (18.499 ms) : 18314, 18683
.   : milestone, 18499,
tracing (18.01 ms) : 17834, 18187
.   : milestone, 18010,
section candidate
no_agent (19.088 ms) : 18890, 19286
.   : milestone, 19088,
appsec (18.511 ms) : 18322, 18699
.   : milestone, 18511,
code_origins (17.78 ms) : 17606, 17954
.   : milestone, 17780,
iast (17.691 ms) : 17515, 17866
.   : milestone, 17691,
profiling (18.583 ms) : 18395, 18770
.   : milestone, 18583,
tracing (17.794 ms) : 17613, 17975
.   : milestone, 17794,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.104 ms [17.917 ms, 18.291 ms] -
appsec 18.508 ms [18.321 ms, 18.696 ms] 404.382 µs (2.2%)
code_origins 18.51 ms [18.324 ms, 18.696 ms] 406.307 µs (2.2%)
iast 17.601 ms [17.426 ms, 17.776 ms] -502.595 µs (-2.8%)
profiling 18.499 ms [18.314 ms, 18.683 ms] 394.58 µs (2.2%)
tracing 18.01 ms [17.834 ms, 18.187 ms] -93.621 µs (-0.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.088 ms [18.89 ms, 19.286 ms] -
appsec 18.511 ms [18.322 ms, 18.699 ms] -577.369 µs (-3.0%)
code_origins 17.78 ms [17.606 ms, 17.954 ms] -1.308 ms (-6.9%)
iast 17.691 ms [17.515 ms, 17.866 ms] -1.397 ms (-7.3%)
profiling 18.583 ms [18.395 ms, 18.77 ms] -505.398 µs (-2.6%)
tracing 17.794 ms [17.613 ms, 17.975 ms] -1.294 ms (-6.8%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~73612ba8fa, baseline=1.56.0-SNAPSHOT~4a54f5ae55
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.198 ms) : 1186, 1209
.   : milestone, 1198,
iast (3.145 ms) : 3102, 3189
.   : milestone, 3145,
iast_FULL (5.742 ms) : 5684, 5800
.   : milestone, 5742,
iast_GLOBAL (3.661 ms) : 3603, 3720
.   : milestone, 3661,
profiling (2.076 ms) : 2058, 2095
.   : milestone, 2076,
tracing (1.753 ms) : 1739, 1767
.   : milestone, 1753,
section candidate
no_agent (1.172 ms) : 1160, 1183
.   : milestone, 1172,
iast (3.126 ms) : 3086, 3166
.   : milestone, 3126,
iast_FULL (5.867 ms) : 5808, 5926
.   : milestone, 5867,
iast_GLOBAL (3.647 ms) : 3594, 3700
.   : milestone, 3647,
profiling (2.018 ms) : 2001, 2036
.   : milestone, 2018,
tracing (1.903 ms) : 1885, 1922
.   : milestone, 1903,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.198 ms [1.186 ms, 1.209 ms] -
iast 3.145 ms [3.102 ms, 3.189 ms] 1.948 ms (162.7%)
iast_FULL 5.742 ms [5.684 ms, 5.8 ms] 4.544 ms (379.5%)
iast_GLOBAL 3.661 ms [3.603 ms, 3.72 ms] 2.464 ms (205.7%)
profiling 2.076 ms [2.058 ms, 2.095 ms] 878.836 µs (73.4%)
tracing 1.753 ms [1.739 ms, 1.767 ms] 555.381 µs (46.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.172 ms [1.16 ms, 1.183 ms] -
iast 3.126 ms [3.086 ms, 3.166 ms] 1.954 ms (166.8%)
iast_FULL 5.867 ms [5.808 ms, 5.926 ms] 4.695 ms (400.7%)
iast_GLOBAL 3.647 ms [3.594 ms, 3.7 ms] 2.475 ms (211.2%)
profiling 2.018 ms [2.001 ms, 2.036 ms] 846.705 µs (72.3%)
tracing 1.903 ms [1.885 ms, 1.922 ms] 731.827 µs (62.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/edit-check-big-regressions
git_commit_date 1762797252 1762798963
git_commit_sha 4a54f5a 73612ba
release_version 1.56.0-SNAPSHOT~4a54f5ae55 1.56.0-SNAPSHOT~73612ba8fa
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1762801182 1762801182
ci_job_id 1226154680 1226154680
ci_pipeline_id 81854498 81854498
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-d0s0dmu8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-d0s0dmu8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.267ms; -0.936ms] or [-35.041%; -25.890%]		 2.514ms 3.616ms
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~73612ba8fa, baseline=1.56.0-SNAPSHOT~4a54f5ae55
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (3.616 ms) : 3405, 3827
.   : milestone, 3616,
iast (2.227 ms) : 2163, 2291
.   : milestone, 2227,
iast_GLOBAL (2.268 ms) : 2204, 2332
.   : milestone, 2268,
profiling (2.051 ms) : 2000, 2102
.   : milestone, 2051,
tracing (2.038 ms) : 1988, 2088
.   : milestone, 2038,
section candidate
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (2.514 ms) : 2460, 2568
.   : milestone, 2514,
iast (2.221 ms) : 2157, 2285
.   : milestone, 2221,
iast_GLOBAL (2.259 ms) : 2195, 2323
.   : milestone, 2259,
profiling (2.06 ms) : 2009, 2111
.   : milestone, 2060,
tracing (2.025 ms) : 1976, 2075
.   : milestone, 2025,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.468 ms, 1.491 ms] -
appsec 3.616 ms [3.405 ms, 3.827 ms] 2.136 ms (144.4%)
iast 2.227 ms [2.163 ms, 2.291 ms] 747.45 µs (50.5%)
iast_GLOBAL 2.268 ms [2.204 ms, 2.332 ms] 788.509 µs (53.3%)
profiling 2.051 ms [2.0 ms, 2.102 ms] 571.395 µs (38.6%)
tracing 2.038 ms [1.988 ms, 2.088 ms] 558.805 µs (37.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 2.514 ms [2.46 ms, 2.568 ms] 1.04 ms (70.5%)
iast 2.221 ms [2.157 ms, 2.285 ms] 746.92 µs (50.7%)
iast_GLOBAL 2.259 ms [2.195 ms, 2.323 ms] 784.575 µs (53.2%)
profiling 2.06 ms [2.009 ms, 2.111 ms] 585.696 µs (39.7%)
tracing 2.025 ms [1.976 ms, 2.075 ms] 550.839 µs (37.4%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~73612ba8fa, baseline=1.56.0-SNAPSHOT~4a54f5ae55
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.541 s) : 15541000, 15541000
.   : milestone, 15541000,
appsec (15.36 s) : 15360000, 15360000
.   : milestone, 15360000,
iast (18.353 s) : 18353000, 18353000
.   : milestone, 18353000,
iast_GLOBAL (17.849 s) : 17849000, 17849000
.   : milestone, 17849000,
profiling (14.956 s) : 14956000, 14956000
.   : milestone, 14956000,
tracing (14.624 s) : 14624000, 14624000
.   : milestone, 14624000,
section candidate
no_agent (15.01 s) : 15010000, 15010000
.   : milestone, 15010000,
appsec (14.65 s) : 14650000, 14650000
.   : milestone, 14650000,
iast (18.48 s) : 18480000, 18480000
.   : milestone, 18480000,
iast_GLOBAL (17.977 s) : 17977000, 17977000
.   : milestone, 17977000,
profiling (15.468 s) : 15468000, 15468000
.   : milestone, 15468000,
tracing (15.057 s) : 15057000, 15057000
.   : milestone, 15057000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.541 s [15.541 s, 15.541 s] -
appsec 15.36 s [15.36 s, 15.36 s] -181.0 ms (-1.2%)
iast 18.353 s [18.353 s, 18.353 s] 2.812 s (18.1%)
iast_GLOBAL 17.849 s [17.849 s, 17.849 s] 2.308 s (14.9%)
profiling 14.956 s [14.956 s, 14.956 s] -585.0 ms (-3.8%)
tracing 14.624 s [14.624 s, 14.624 s] -917.0 ms (-5.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.01 s [15.01 s, 15.01 s] -
appsec 14.65 s [14.65 s, 14.65 s] -360.0 ms (-2.4%)
iast 18.48 s [18.48 s, 18.48 s] 3.47 s (23.1%)
iast_GLOBAL 17.977 s [17.977 s, 17.977 s] 2.967 s (19.8%)
profiling 15.468 s [15.468 s, 15.468 s] 458.0 ms (3.1%)
tracing 15.057 s [15.057 s, 15.057 s] 47.0 ms (0.3%)

@sarahchen6 sarahchen6 merged commit 7aef6ed into master Nov 10, 2025
539 checks passed
@sarahchen6 sarahchen6 deleted the sarahchen6/edit-check-big-regressions branch November 10, 2025 19:55
@github-actions github-actions Bot added this to the 1.56.0 milestone Nov 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@bric3 bric3 bric3 approved these changes

@ddyurchenko ddyurchenko ddyurchenko approved these changes

@TonyCTHsu TonyCTHsu Awaiting requested review from TonyCTHsu TonyCTHsu is a code owner automatically assigned from DataDog/apm-release-platform

Assignees

No one assigned

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.56.0

Development

Successfully merging this pull request may close these issues.

3 participants

@sarahchen6 @bric3 @ddyurchenko