Skip to content

Removes flakes from mapper tests#9672

Merged
amarziali merged 1 commit intomasterfrom
andrea.marziali/flaky
Oct 6, 2025
Merged

Removes flakes from mapper tests#9672
amarziali merged 1 commit intomasterfrom
andrea.marziali/flaky

Conversation

@amarziali
Copy link
Copy Markdown
Contributor

@amarziali amarziali commented Oct 6, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@amarziali amarziali requested a review from a team as a code owner October 6, 2025 07:13
@amarziali amarziali added the type: enhancement Enhancements and improvements label Oct 6, 2025
@amarziali amarziali requested a review from ygree October 6, 2025 07:13
@amarziali amarziali added comp: testing Testing tag: no release notes Changes to exclude from release notes tag: flaky test Flaky tests labels Oct 6, 2025
@amarziali amarziali marked this pull request as draft October 6, 2025 07:30
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Oct 6, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/flaky
git_commit_date 1759657538 1759737760
git_commit_sha 02cae20 add2fda
release_version 1.54.0-SNAPSHOT~02cae20a94 1.54.0-SNAPSHOT~add2fda0c9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1759739585 1759739585
ci_job_id 1164003348 1164003348
ci_pipeline_id 78436934 78436934
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-klsofxnb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-klsofxnb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 4 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~add2fda0c9, baseline=1.54.0-SNAPSHOT~02cae20a94

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.018 s) : 0, 1018219
Total [baseline] (10.685 s) : 0, 10685428
Agent [candidate] (1.024 s) : 0, 1023679
Total [candidate] (10.769 s) : 0, 10768601
section appsec
Agent [baseline] (1.205 s) : 0, 1205397
Total [baseline] (10.974 s) : 0, 10973876
Agent [candidate] (1.193 s) : 0, 1193486
Total [candidate] (11.04 s) : 0, 11040241
section iast
Agent [baseline] (1.158 s) : 0, 1157539
Total [baseline] (10.973 s) : 0, 10972548
Agent [candidate] (1.154 s) : 0, 1154254
Total [candidate] (10.886 s) : 0, 10886177
section profiling
Agent [baseline] (1.164 s) : 0, 1164082
Total [baseline] (11.065 s) : 0, 11065140
Agent [candidate] (1.161 s) : 0, 1160751
Total [candidate] (11.037 s) : 0, 11037203
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.018 s -
Agent appsec 1.205 s 187.178 ms (18.4%)
Agent iast 1.158 s 139.321 ms (13.7%)
Agent profiling 1.164 s 145.864 ms (14.3%)
Total tracing 10.685 s -
Total appsec 10.974 s 288.448 ms (2.7%)
Total iast 10.973 s 287.12 ms (2.7%)
Total profiling 11.065 s 379.712 ms (3.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.024 s -
Agent appsec 1.193 s 169.807 ms (16.6%)
Agent iast 1.154 s 130.575 ms (12.8%)
Agent profiling 1.161 s 137.072 ms (13.4%)
Total tracing 10.769 s -
Total appsec 11.04 s 271.64 ms (2.5%)
Total iast 10.886 s 117.576 ms (1.1%)
Total profiling 11.037 s 268.602 ms (2.5%) 
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~add2fda0c9, baseline=1.54.0-SNAPSHOT~02cae20a94

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.482 ms) : 0, 1482
crashtracking [candidate] (1.465 ms) : 0, 1465
BytebuddyAgent [baseline] (694.523 ms) : 0, 694523
BytebuddyAgent [candidate] (698.686 ms) : 0, 698686
GlobalTracer [baseline] (242.522 ms) : 0, 242522
GlobalTracer [candidate] (242.332 ms) : 0, 242332
AppSec [baseline] (32.662 ms) : 0, 32662
AppSec [candidate] (32.711 ms) : 0, 32711
Debugger [baseline] (6.38 ms) : 0, 6380
Debugger [candidate] (6.392 ms) : 0, 6392
Remote Config [baseline] (701.274 µs) : 0, 701
Remote Config [candidate] (692.086 µs) : 0, 692
Telemetry [baseline] (9.202 ms) : 0, 9202
Telemetry [candidate] (9.167 ms) : 0, 9167
Flare Poller [baseline] (9.607 ms) : 0, 9607
Flare Poller [candidate] (10.996 ms) : 0, 10996
section appsec
crashtracking [baseline] (1.477 ms) : 0, 1477
crashtracking [candidate] (1.454 ms) : 0, 1454
BytebuddyAgent [baseline] (724.509 ms) : 0, 724509
BytebuddyAgent [candidate] (717.046 ms) : 0, 717046
GlobalTracer [baseline] (236.589 ms) : 0, 236589
GlobalTracer [candidate] (234.198 ms) : 0, 234198
AppSec [baseline] (176.232 ms) : 0, 176232
AppSec [candidate] (174.773 ms) : 0, 174773
Debugger [baseline] (6.146 ms) : 0, 6146
Debugger [candidate] (6.142 ms) : 0, 6142
Remote Config [baseline] (658.602 µs) : 0, 659
Remote Config [candidate] (642.397 µs) : 0, 642
Telemetry [baseline] (9.355 ms) : 0, 9355
Telemetry [candidate] (8.503 ms) : 0, 8503
Flare Poller [baseline] (4.047 ms) : 0, 4047
Flare Poller [candidate] (4.763 ms) : 0, 4763
IAST [baseline] (25.124 ms) : 0, 25124
IAST [candidate] (24.917 ms) : 0, 24917
section iast
crashtracking [baseline] (1.47 ms) : 0, 1470
crashtracking [candidate] (1.454 ms) : 0, 1454
BytebuddyAgent [baseline] (819.309 ms) : 0, 819309
BytebuddyAgent [candidate] (817.017 ms) : 0, 817017
GlobalTracer [baseline] (233.538 ms) : 0, 233538
GlobalTracer [candidate] (233.276 ms) : 0, 233276
AppSec [baseline] (35.56 ms) : 0, 35560
AppSec [candidate] (35.327 ms) : 0, 35327
Debugger [baseline] (6.076 ms) : 0, 6076
Debugger [candidate] (5.999 ms) : 0, 5999
Remote Config [baseline] (610.357 µs) : 0, 610
Remote Config [candidate] (603.783 µs) : 0, 604
Telemetry [baseline] (8.441 ms) : 0, 8441
Telemetry [candidate] (8.373 ms) : 0, 8373
Flare Poller [baseline] (4.215 ms) : 0, 4215
Flare Poller [candidate] (4.128 ms) : 0, 4128
IAST [baseline] (26.906 ms) : 0, 26906
IAST [candidate] (26.712 ms) : 0, 26712
section profiling
ProfilingAgent [baseline] (107.244 ms) : 0, 107244
ProfilingAgent [candidate] (107.061 ms) : 0, 107061
crashtracking [baseline] (1.437 ms) : 0, 1437
crashtracking [candidate] (1.426 ms) : 0, 1426
BytebuddyAgent [baseline] (722.933 ms) : 0, 722933
BytebuddyAgent [candidate] (720.766 ms) : 0, 720766
GlobalTracer [baseline] (218.434 ms) : 0, 218434
GlobalTracer [candidate] (217.425 ms) : 0, 217425
AppSec [baseline] (33.055 ms) : 0, 33055
AppSec [candidate] (33.073 ms) : 0, 33073
Debugger [baseline] (6.566 ms) : 0, 6566
Debugger [candidate] (6.483 ms) : 0, 6483
Remote Config [baseline] (700.586 µs) : 0, 701
Remote Config [candidate] (709.006 µs) : 0, 709
Telemetry [baseline] (16.496 ms) : 0, 16496
Telemetry [candidate] (16.716 ms) : 0, 16716
Flare Poller [baseline] (4.194 ms) : 0, 4194
Flare Poller [candidate] (4.18 ms) : 0, 4180
Profiling [baseline] (108.124 ms) : 0, 108124
Profiling [candidate] (108.077 ms) : 0, 108077
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~add2fda0c9, baseline=1.54.0-SNAPSHOT~02cae20a94

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.023 s) : 0, 1022558
Total [baseline] (8.688 s) : 0, 8687540
Agent [candidate] (1.02 s) : 0, 1019893
Total [candidate] (8.656 s) : 0, 8655697
section iast
Agent [baseline] (1.155 s) : 0, 1154976
Total [baseline] (9.285 s) : 0, 9284619
Agent [candidate] (1.159 s) : 0, 1159386
Total [candidate] (9.304 s) : 0, 9304329
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.023 s -
Agent iast 1.155 s 132.418 ms (12.9%)
Total tracing 8.688 s -
Total iast 9.285 s 597.078 ms (6.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.02 s -
Agent iast 1.159 s 139.494 ms (13.7%)
Total tracing 8.656 s -
Total iast 9.304 s 648.632 ms (7.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~add2fda0c9, baseline=1.54.0-SNAPSHOT~02cae20a94

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.473 ms) : 0, 1473
crashtracking [candidate] (1.46 ms) : 0, 1460
BytebuddyAgent [baseline] (696.149 ms) : 0, 696149
BytebuddyAgent [candidate] (695.21 ms) : 0, 695210
GlobalTracer [baseline] (242.632 ms) : 0, 242632
GlobalTracer [candidate] (242.246 ms) : 0, 242246
AppSec [baseline] (33.006 ms) : 0, 33006
AppSec [candidate] (32.744 ms) : 0, 32744
Debugger [baseline] (6.456 ms) : 0, 6456
Debugger [candidate] (6.452 ms) : 0, 6452
Remote Config [baseline] (702.833 µs) : 0, 703
Remote Config [candidate] (704.514 µs) : 0, 705
Telemetry [baseline] (9.258 ms) : 0, 9258
Telemetry [candidate] (9.158 ms) : 0, 9158
Flare Poller [baseline] (11.773 ms) : 0, 11773
Flare Poller [candidate] (10.877 ms) : 0, 10877
section iast
crashtracking [baseline] (1.476 ms) : 0, 1476
crashtracking [candidate] (1.471 ms) : 0, 1471
BytebuddyAgent [baseline] (817.507 ms) : 0, 817507
BytebuddyAgent [candidate] (820.168 ms) : 0, 820168
GlobalTracer [baseline] (233.178 ms) : 0, 233178
GlobalTracer [candidate] (234.251 ms) : 0, 234251
AppSec [baseline] (35.25 ms) : 0, 35250
AppSec [candidate] (35.588 ms) : 0, 35588
Debugger [baseline] (6.054 ms) : 0, 6054
Debugger [candidate] (6.116 ms) : 0, 6116
Remote Config [baseline] (603.715 µs) : 0, 604
Remote Config [candidate] (619.463 µs) : 0, 619
Telemetry [baseline] (8.461 ms) : 0, 8461
Telemetry [candidate] (8.583 ms) : 0, 8583
Flare Poller [baseline] (4.227 ms) : 0, 4227
Flare Poller [candidate] (4.241 ms) : 0, 4241
IAST [baseline] (26.913 ms) : 0, 26913
IAST [candidate] (27.099 ms) : 0, 27099
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/flaky
git_commit_date 1759657538 1759737760
git_commit_sha 02cae20 add2fda
release_version 1.54.0-SNAPSHOT~02cae20a94 1.54.0-SNAPSHOT~add2fda0c9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1759739341 1759739341
ci_job_id 1164003349 1164003349
ci_pipeline_id 78436934 78436934
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-hsvc3lo3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-hsvc3lo3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 5 performance regressions! Performance is the same for 4 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:no_agent:high_load worse
[+122.846µs; +226.773µs] or [+2.939%; +5.425%]		 unstable
[-165.345op/s; +78.908op/s] or [-15.076%; +7.195%]		 4.355ms 1053.562op/s 4.180ms 1096.781op/s
scenario:load:insecure-bank:profiling:high_load worse
[+258.775µs; +562.551µs] or [+2.986%; +6.492%]		 unstable
[-94.339op/s; +46.339op/s] or [-17.626%; +8.658%]		 9.076ms 511.219op/s 8.665ms 535.219op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+596.434µs; +1031.647µs] or [+5.517%; +9.542%]		 unstable
[-79.889op/s; +20.264op/s] or [-18.581%; +4.713%]		 11.625ms 400.125op/s 10.811ms 429.938op/s
scenario:load:insecure-bank:iast_FULL:high_load better
[-1261.362µs; -645.926µs] or [-8.624%; -4.416%]		 unstable
[-16.845op/s; +61.095op/s] or [-5.286%; +19.173%]		 13.672ms 340.781op/s 14.626ms 318.656op/s
scenario:load:petclinic:no_agent:high_load worse
[+0.869ms; +1.500ms] or [+2.375%; +4.099%]		 unstable
[-14.237op/s; +3.003op/s] or [-11.006%; +2.322%]		 37.778ms 123.737op/s 36.594ms 129.354op/s
scenario:load:petclinic:profiling:high_load better
[-2.713ms; -1.769ms] or [-5.555%; -3.622%]		 unstable
[-3.693op/s; +10.543op/s] or [-3.807%; +10.869%]		 46.600ms 100.425op/s 48.841ms 97.000op/s
scenario:load:petclinic:tracing:high_load worse
[+1.356ms; +2.231ms] or [+3.000%; +4.934%]		 unstable
[-11.464op/s; +3.514op/s] or [-11.075%; +3.395%]		 47.014ms 99.537op/s 45.220ms 103.513op/s
scenario:load:petclinic:iast:high_load better
[-2.495ms; -1.653ms] or [-5.362%; -3.552%]		 unstable
[-3.807op/s; +10.636op/s] or [-3.739%; +10.447%]		 44.458ms 105.225op/s 46.532ms 101.810op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~add2fda0c9, baseline=1.54.0-SNAPSHOT~02cae20a94
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.594 ms) : 36309, 36879
.   : milestone, 36594,
appsec (48.475 ms) : 48059, 48890
.   : milestone, 48475,
code_origins (44.778 ms) : 44403, 45152
.   : milestone, 44778,
iast (46.532 ms) : 46131, 46933
.   : milestone, 46532,
profiling (48.841 ms) : 48369, 49313
.   : milestone, 48841,
tracing (45.22 ms) : 44831, 45610
.   : milestone, 45220,
section candidate
no_agent (37.778 ms) : 37477, 38080
.   : milestone, 37778,
appsec (48.702 ms) : 48272, 49132
.   : milestone, 48702,
code_origins (43.93 ms) : 43547, 44313
.   : milestone, 43930,
iast (44.458 ms) : 44077, 44839
.   : milestone, 44458,
profiling (46.6 ms) : 46197, 47003
.   : milestone, 46600,
tracing (47.014 ms) : 46592, 47437
.   : milestone, 47014,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.594 ms [36.309 ms, 36.879 ms] -
appsec 48.475 ms [48.059 ms, 48.89 ms] 11.881 ms (32.5%)
code_origins 44.778 ms [44.403 ms, 45.152 ms] 8.184 ms (22.4%)
iast 46.532 ms [46.131 ms, 46.933 ms] 9.938 ms (27.2%)
profiling 48.841 ms [48.369 ms, 49.313 ms] 12.247 ms (33.5%)
tracing 45.22 ms [44.831 ms, 45.61 ms] 8.627 ms (23.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.778 ms [37.477 ms, 38.08 ms] -
appsec 48.702 ms [48.272 ms, 49.132 ms] 10.924 ms (28.9%)
code_origins 43.93 ms [43.547 ms, 44.313 ms] 6.151 ms (16.3%)
iast 44.458 ms [44.077 ms, 44.839 ms] 6.679 ms (17.7%)
profiling 46.6 ms [46.197 ms, 47.003 ms] 8.822 ms (23.4%)
tracing 47.014 ms [46.592 ms, 47.437 ms] 9.236 ms (24.4%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~add2fda0c9, baseline=1.54.0-SNAPSHOT~02cae20a94
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.18 ms) : 4133, 4227
.   : milestone, 4180,
iast (9.513 ms) : 9356, 9669
.   : milestone, 9513,
iast_FULL (14.626 ms) : 14326, 14926
.   : milestone, 14626,
iast_GLOBAL (10.811 ms) : 10618, 11005
.   : milestone, 10811,
profiling (8.665 ms) : 8531, 8798
.   : milestone, 8665,
tracing (8.098 ms) : 7979, 8217
.   : milestone, 8098,
section candidate
no_agent (4.355 ms) : 4305, 4405
.   : milestone, 4355,
iast (9.469 ms) : 9316, 9623
.   : milestone, 9469,
iast_FULL (13.672 ms) : 13401, 13943
.   : milestone, 13672,
iast_GLOBAL (11.625 ms) : 11415, 11836
.   : milestone, 11625,
profiling (9.076 ms) : 8927, 9224
.   : milestone, 9076,
tracing (7.809 ms) : 7691, 7926
.   : milestone, 7809,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.18 ms [4.133 ms, 4.227 ms] -
iast 9.513 ms [9.356 ms, 9.669 ms] 5.333 ms (127.6%)
iast_FULL 14.626 ms [14.326 ms, 14.926 ms] 10.446 ms (249.9%)
iast_GLOBAL 10.811 ms [10.618 ms, 11.005 ms] 6.631 ms (158.6%)
profiling 8.665 ms [8.531 ms, 8.798 ms] 4.485 ms (107.3%)
tracing 8.098 ms [7.979 ms, 8.217 ms] 3.918 ms (93.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.355 ms [4.305 ms, 4.405 ms] -
iast 9.469 ms [9.316 ms, 9.623 ms] 5.114 ms (117.4%)
iast_FULL 13.672 ms [13.401 ms, 13.943 ms] 9.317 ms (213.9%)
iast_GLOBAL 11.625 ms [11.415 ms, 11.836 ms] 7.27 ms (166.9%)
profiling 9.076 ms [8.927 ms, 9.224 ms] 4.72 ms (108.4%)
tracing 7.809 ms [7.691 ms, 7.926 ms] 3.454 ms (79.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/flaky
git_commit_date 1759657538 1759737760
git_commit_sha 02cae20 add2fda
release_version 1.54.0-SNAPSHOT~02cae20a94 1.54.0-SNAPSHOT~add2fda0c9
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1759739743 1759739743
ci_job_id 1164003350 1164003350
ci_pipeline_id 78436934 78436934
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-9v40ivb7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-9v40ivb7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 1 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.305ms; -0.973ms] or [-35.853%; -26.722%]		 2.501ms 3.639ms
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~add2fda0c9, baseline=1.54.0-SNAPSHOT~02cae20a94
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.468 ms) : 1456, 1479
.   : milestone, 1468,
appsec (3.639 ms) : 3428, 3851
.   : milestone, 3639,
iast (2.197 ms) : 2133, 2261
.   : milestone, 2197,
iast_GLOBAL (2.24 ms) : 2175, 2304
.   : milestone, 2240,
profiling (2.044 ms) : 1992, 2095
.   : milestone, 2044,
tracing (2.018 ms) : 1969, 2068
.   : milestone, 2018,
section candidate
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (2.501 ms) : 2447, 2555
.   : milestone, 2501,
iast (2.204 ms) : 2141, 2268
.   : milestone, 2204,
iast_GLOBAL (2.244 ms) : 2180, 2308
.   : milestone, 2244,
profiling (2.496 ms) : 2328, 2664
.   : milestone, 2496,
tracing (2.02 ms) : 1971, 2069
.   : milestone, 2020,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.456 ms, 1.479 ms] -
appsec 3.639 ms [3.428 ms, 3.851 ms] 2.172 ms (148.0%)
iast 2.197 ms [2.133 ms, 2.261 ms] 729.331 µs (49.7%)
iast_GLOBAL 2.24 ms [2.175 ms, 2.304 ms] 771.837 µs (52.6%)
profiling 2.044 ms [1.992 ms, 2.095 ms] 576.233 µs (39.3%)
tracing 2.018 ms [1.969 ms, 2.068 ms] 550.693 µs (37.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 2.501 ms [2.447 ms, 2.555 ms] 1.029 ms (70.0%)
iast 2.204 ms [2.141 ms, 2.268 ms] 733.024 µs (49.8%)
iast_GLOBAL 2.244 ms [2.18 ms, 2.308 ms] 772.654 µs (52.5%)
profiling 2.496 ms [2.328 ms, 2.664 ms] 1.025 ms (69.6%)
tracing 2.02 ms [1.971 ms, 2.069 ms] 548.707 µs (37.3%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~add2fda0c9, baseline=1.54.0-SNAPSHOT~02cae20a94
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.259 s) : 15259000, 15259000
.   : milestone, 15259000,
appsec (15.059 s) : 15059000, 15059000
.   : milestone, 15059000,
iast (18.643 s) : 18643000, 18643000
.   : milestone, 18643000,
iast_GLOBAL (18.045 s) : 18045000, 18045000
.   : milestone, 18045000,
profiling (15.279 s) : 15279000, 15279000
.   : milestone, 15279000,
tracing (15.415 s) : 15415000, 15415000
.   : milestone, 15415000,
section candidate
no_agent (14.934 s) : 14934000, 14934000
.   : milestone, 14934000,
appsec (15.095 s) : 15095000, 15095000
.   : milestone, 15095000,
iast (18.451 s) : 18451000, 18451000
.   : milestone, 18451000,
iast_GLOBAL (17.992 s) : 17992000, 17992000
.   : milestone, 17992000,
profiling (15.597 s) : 15597000, 15597000
.   : milestone, 15597000,
tracing (15.274 s) : 15274000, 15274000
.   : milestone, 15274000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.259 s [15.259 s, 15.259 s] -
appsec 15.059 s [15.059 s, 15.059 s] -200.0 ms (-1.3%)
iast 18.643 s [18.643 s, 18.643 s] 3.384 s (22.2%)
iast_GLOBAL 18.045 s [18.045 s, 18.045 s] 2.786 s (18.3%)
profiling 15.279 s [15.279 s, 15.279 s] 20.0 ms (0.1%)
tracing 15.415 s [15.415 s, 15.415 s] 156.0 ms (1.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.934 s [14.934 s, 14.934 s] -
appsec 15.095 s [15.095 s, 15.095 s] 161.0 ms (1.1%)
iast 18.451 s [18.451 s, 18.451 s] 3.517 s (23.6%)
iast_GLOBAL 17.992 s [17.992 s, 17.992 s] 3.058 s (20.5%)
profiling 15.597 s [15.597 s, 15.597 s] 663.0 ms (4.4%)
tracing 15.274 s [15.274 s, 15.274 s] 340.0 ms (2.3%)

@amarziali amarziali force-pushed the andrea.marziali/flaky branch from e1832c4 to add2fda Compare October 6, 2025 08:02
@amarziali amarziali marked this pull request as ready for review October 6, 2025 08:03
@amarziali amarziali requested a review from a team as a code owner October 6, 2025 08:03
@datadog-datadog-prod-us1
Copy link
Copy Markdown
Contributor

datadog-datadog-prod-us1 Bot commented Oct 6, 2025

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 81.75% (+23.64%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: add2fda | Docs | Was this helpful? Give us feedback!

@amarziali amarziali merged commit 4386dc4 into master Oct 6, 2025
536 checks passed
@amarziali amarziali deleted the andrea.marziali/flaky branch October 6, 2025 08:45
@github-actions github-actions Bot added this to the 1.54.0 milestone Oct 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@bric3 bric3 bric3 approved these changes

@ygree ygree Awaiting requested review from ygree ygree is a code owner automatically assigned from DataDog/apm-java

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD Awaiting requested review from AlexeyKuznetsov-DD

Assignees

No one assigned

Labels

comp: testing Testing tag: flaky test Flaky tests tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.54.0

Development

Successfully merging this pull request may close these issues.

2 participants

@amarziali @bric3