Skip to content

Bump flare smoke test duration by 5s to fix rare timeouts causing flakes#9469

Merged
MattAlp merged 1 commit intomasterfrom
mattalp/whats-another-5-seconds
Sep 4, 2025
Merged

Bump flare smoke test duration by 5s to fix rare timeouts causing flakes#9469
MattAlp merged 1 commit intomasterfrom
mattalp/whats-another-5-seconds

Conversation

@MattAlp
Copy link
Copy Markdown

@MattAlp MattAlp commented Sep 4, 2025 •
edited
Loading

What Does This Do

20s -> 25s

Motivation

image

Flakes ~1x/4h, would consistently fail when the timeout was 15s

Additional Notes

Contributor Checklist

Jira ticket: PROF-12422

@MattAlp MattAlp requested a review from a team as a code owner September 4, 2025 19:54
@MattAlp MattAlp added the type: enhancement Enhancements and improvements label Sep 4, 2025
@MattAlp MattAlp requested a review from smola September 4, 2025 19:54
@MattAlp MattAlp added comp: testing Testing tag: flaky test Flaky tests run-tests: oracle8 Run tests using Oracle 8 JDK labels Sep 4, 2025
@MattAlp MattAlp enabled auto-merge (squash) September 4, 2025 20:01
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD added the tag: no release notes Changes to exclude from release notes label Sep 4, 2025
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Sep 4, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/whats-another-5-seconds
git_commit_date 1757007896 1757015391
git_commit_sha 9c70b0c 5d8db88
release_version 1.54.0-SNAPSHOT~9c70b0c71b 1.54.0-SNAPSHOT~5d8db8858c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1757017315 1757017315
ci_job_id 1114542283 1114542283
ci_pipeline_id 75594749 75594749
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-izutlmc0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-izutlmc0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 11 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~5d8db8858c, baseline=1.54.0-SNAPSHOT~9c70b0c71b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.048 s) : 0, 1047735
Total [baseline] (10.767 s) : 0, 10767336
Agent [candidate] (1.066 s) : 0, 1066222
Total [candidate] (10.834 s) : 0, 10834418
section appsec
Agent [baseline] (1.223 s) : 0, 1223397
Total [baseline] (10.941 s) : 0, 10941137
Agent [candidate] (1.224 s) : 0, 1224020
Total [candidate] (10.85 s) : 0, 10849915
section iast
Agent [baseline] (1.179 s) : 0, 1179325
Total [baseline] (10.935 s) : 0, 10935136
Agent [candidate] (1.183 s) : 0, 1182768
Total [candidate] (10.982 s) : 0, 10981980
section profiling
Agent [baseline] (1.213 s) : 0, 1213371
Total [baseline] (11.018 s) : 0, 11017523
Agent [candidate] (1.207 s) : 0, 1206573
Total [candidate] (10.977 s) : 0, 10976806
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.048 s -
Agent appsec 1.223 s 175.663 ms (16.8%)
Agent iast 1.179 s 131.591 ms (12.6%)
Agent profiling 1.213 s 165.636 ms (15.8%)
Total tracing 10.767 s -
Total appsec 10.941 s 173.801 ms (1.6%)
Total iast 10.935 s 167.8 ms (1.6%)
Total profiling 11.018 s 250.188 ms (2.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.224 s 157.798 ms (14.8%)
Agent iast 1.183 s 116.546 ms (10.9%)
Agent profiling 1.207 s 140.351 ms (13.2%)
Total tracing 10.834 s -
Total appsec 10.85 s 15.498 ms (0.1%)
Total iast 10.982 s 147.562 ms (1.4%)
Total profiling 10.977 s 142.388 ms (1.3%) 
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~5d8db8858c, baseline=1.54.0-SNAPSHOT~9c70b0c71b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.457 ms) : 0, 1457
crashtracking [candidate] (1.481 ms) : 0, 1481
BytebuddyAgent [baseline] (732.732 ms) : 0, 732732
BytebuddyAgent [candidate] (746.51 ms) : 0, 746510
GlobalTracer [baseline] (242.834 ms) : 0, 242834
GlobalTracer [candidate] (247.041 ms) : 0, 247041
AppSec [baseline] (30.236 ms) : 0, 30236
AppSec [candidate] (31.032 ms) : 0, 31032
Debugger [baseline] (6.111 ms) : 0, 6111
Debugger [candidate] (6.18 ms) : 0, 6180
Remote Config [baseline] (690.131 µs) : 0, 690
Remote Config [candidate] (718.444 µs) : 0, 718
Telemetry [baseline] (12.463 ms) : 0, 12463
Telemetry [candidate] (11.743 ms) : 0, 11743
section appsec
crashtracking [baseline] (1.453 ms) : 0, 1453
crashtracking [candidate] (1.45 ms) : 0, 1450
BytebuddyAgent [baseline] (755.76 ms) : 0, 755760
BytebuddyAgent [candidate] (756.05 ms) : 0, 756050
GlobalTracer [baseline] (235.012 ms) : 0, 235012
GlobalTracer [candidate] (235.395 ms) : 0, 235395
IAST [baseline] (23.673 ms) : 0, 23673
IAST [candidate] (23.638 ms) : 0, 23638
AppSec [baseline] (169.196 ms) : 0, 169196
AppSec [candidate] (168.424 ms) : 0, 168424
Debugger [baseline] (8.073 ms) : 0, 8073
Debugger [candidate] (8.907 ms) : 0, 8907
Remote Config [baseline] (645.313 µs) : 0, 645
Remote Config [candidate] (617.966 µs) : 0, 618
Telemetry [baseline] (8.443 ms) : 0, 8443
Telemetry [candidate] (8.485 ms) : 0, 8485
section iast
crashtracking [baseline] (1.443 ms) : 0, 1443
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (850.84 ms) : 0, 850840
BytebuddyAgent [candidate] (853.118 ms) : 0, 853118
GlobalTracer [baseline] (233.169 ms) : 0, 233169
GlobalTracer [candidate] (234.336 ms) : 0, 234336
IAST [baseline] (29.49 ms) : 0, 29490
IAST [candidate] (32.718 ms) : 0, 32718
AppSec [baseline] (27.736 ms) : 0, 27736
AppSec [candidate] (25.334 ms) : 0, 25334
Debugger [baseline] (6.573 ms) : 0, 6573
Debugger [candidate] (5.824 ms) : 0, 5824
Remote Config [baseline] (600.198 µs) : 0, 600
Remote Config [candidate] (599.621 µs) : 0, 600
Telemetry [baseline] (8.282 ms) : 0, 8282
Telemetry [candidate] (8.292 ms) : 0, 8292
section profiling
crashtracking [baseline] (1.466 ms) : 0, 1466
crashtracking [candidate] (1.438 ms) : 0, 1438
BytebuddyAgent [baseline] (773.657 ms) : 0, 773657
BytebuddyAgent [candidate] (767.142 ms) : 0, 767142
GlobalTracer [baseline] (223.775 ms) : 0, 223775
GlobalTracer [candidate] (224.033 ms) : 0, 224033
AppSec [baseline] (30.69 ms) : 0, 30690
AppSec [candidate] (30.742 ms) : 0, 30742
Debugger [baseline] (6.299 ms) : 0, 6299
Debugger [candidate] (6.31 ms) : 0, 6310
Remote Config [baseline] (704.007 µs) : 0, 704
Remote Config [candidate] (726.328 µs) : 0, 726
Telemetry [baseline] (16.513 ms) : 0, 16513
Telemetry [candidate] (16.486 ms) : 0, 16486
ProfilingAgent [baseline] (109.022 ms) : 0, 109022
ProfilingAgent [candidate] (108.814 ms) : 0, 108814
Profiling [baseline] (109.682 ms) : 0, 109682
Profiling [candidate] (109.503 ms) : 0, 109503
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~5d8db8858c, baseline=1.54.0-SNAPSHOT~9c70b0c71b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.047 s) : 0, 1046600
Total [baseline] (8.611 s) : 0, 8611065
Agent [candidate] (1.046 s) : 0, 1045582
Total [candidate] (8.626 s) : 0, 8626310
section iast
Agent [baseline] (1.188 s) : 0, 1187594
Total [baseline] (9.423 s) : 0, 9423274
Agent [candidate] (1.179 s) : 0, 1179499
Total [candidate] (9.329 s) : 0, 9329368
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent iast 1.188 s 140.995 ms (13.5%)
Total tracing 8.611 s -
Total iast 9.423 s 812.209 ms (9.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.046 s -
Agent iast 1.179 s 133.916 ms (12.8%)
Total tracing 8.626 s -
Total iast 9.329 s 703.057 ms (8.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~5d8db8858c, baseline=1.54.0-SNAPSHOT~9c70b0c71b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.467 ms) : 0, 1467
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (732.47 ms) : 0, 732470
BytebuddyAgent [candidate] (732.118 ms) : 0, 732118
GlobalTracer [baseline] (241.631 ms) : 0, 241631
GlobalTracer [candidate] (242.448 ms) : 0, 242448
AppSec [baseline] (30.086 ms) : 0, 30086
AppSec [candidate] (30.062 ms) : 0, 30062
Debugger [baseline] (6.074 ms) : 0, 6074
Debugger [candidate] (6.121 ms) : 0, 6121
Remote Config [baseline] (692.139 µs) : 0, 692
Remote Config [candidate] (702.076 µs) : 0, 702
Telemetry [baseline] (13.108 ms) : 0, 13108
Telemetry [candidate] (11.589 ms) : 0, 11589
section iast
crashtracking [baseline] (1.476 ms) : 0, 1476
crashtracking [candidate] (1.448 ms) : 0, 1448
BytebuddyAgent [baseline] (857.018 ms) : 0, 857018
BytebuddyAgent [candidate] (851.621 ms) : 0, 851621
GlobalTracer [baseline] (235.307 ms) : 0, 235307
GlobalTracer [candidate] (233.15 ms) : 0, 233150
AppSec [baseline] (26.406 ms) : 0, 26406
AppSec [candidate] (26.718 ms) : 0, 26718
Debugger [baseline] (7.666 ms) : 0, 7666
Debugger [candidate] (5.707 ms) : 0, 5707
Remote Config [baseline] (604.867 µs) : 0, 605
Remote Config [candidate] (609.992 µs) : 0, 610
Telemetry [baseline] (8.351 ms) : 0, 8351
Telemetry [candidate] (8.143 ms) : 0, 8143
IAST [baseline] (29.621 ms) : 0, 29621
IAST [candidate] (31.042 ms) : 0, 31042
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/whats-another-5-seconds
git_commit_date 1757007896 1757015391
git_commit_sha 9c70b0c 5d8db88
release_version 1.54.0-SNAPSHOT~9c70b0c71b 1.54.0-SNAPSHOT~5d8db8858c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1757016897 1757016897
ci_job_id 1114542284 1114542284
ci_pipeline_id 75594749 75594749
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-5b3rn9qv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-5b3rn9qv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:no_agent:high_load worse
[+1.887ms; +2.529ms] or [+5.258%; +7.045%]		 unstable
[-16.517op/s; +1.442op/s] or [-12.681%; +1.107%]		 38.103ms 122.713op/s 35.894ms 130.250op/s
scenario:load:petclinic:appsec:high_load better
[-2.027ms; -1.050ms] or [-4.070%; -2.109%]		 unstable
[-4.371op/s; +10.396op/s] or [-4.651%; +11.061%]		 48.257ms 97.000op/s 49.796ms 93.987op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~5d8db8858c, baseline=1.54.0-SNAPSHOT~9c70b0c71b
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.308 ms) : 4252, 4364
.   : milestone, 4308,
iast (9.088 ms) : 8927, 9250
.   : milestone, 9088,
iast_FULL (14.149 ms) : 13865, 14433
.   : milestone, 14149,
iast_GLOBAL (10.41 ms) : 10228, 10592
.   : milestone, 10410,
profiling (8.799 ms) : 8644, 8953
.   : milestone, 8799,
tracing (7.673 ms) : 7552, 7795
.   : milestone, 7673,
section candidate
no_agent (4.32 ms) : 4270, 4370
.   : milestone, 4320,
iast (9.301 ms) : 9143, 9460
.   : milestone, 9301,
iast_FULL (13.753 ms) : 13473, 14032
.   : milestone, 13753,
iast_GLOBAL (10.102 ms) : 9927, 10277
.   : milestone, 10102,
profiling (8.596 ms) : 8465, 8727
.   : milestone, 8596,
tracing (7.869 ms) : 7742, 7996
.   : milestone, 7869,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.308 ms [4.252 ms, 4.364 ms] -
iast 9.088 ms [8.927 ms, 9.25 ms] 4.781 ms (111.0%)
iast_FULL 14.149 ms [13.865 ms, 14.433 ms] 9.841 ms (228.5%)
iast_GLOBAL 10.41 ms [10.228 ms, 10.592 ms] 6.102 ms (141.7%)
profiling 8.799 ms [8.644 ms, 8.953 ms] 4.491 ms (104.3%)
tracing 7.673 ms [7.552 ms, 7.795 ms] 3.366 ms (78.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.32 ms [4.27 ms, 4.37 ms] -
iast 9.301 ms [9.143 ms, 9.46 ms] 4.981 ms (115.3%)
iast_FULL 13.753 ms [13.473 ms, 14.032 ms] 9.433 ms (218.3%)
iast_GLOBAL 10.102 ms [9.927 ms, 10.277 ms] 5.782 ms (133.8%)
profiling 8.596 ms [8.465 ms, 8.727 ms] 4.276 ms (99.0%)
tracing 7.869 ms [7.742 ms, 7.996 ms] 3.549 ms (82.1%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~5d8db8858c, baseline=1.54.0-SNAPSHOT~9c70b0c71b
    dateFormat X
    axisFormat %s
section baseline
no_agent (35.894 ms) : 35605, 36184
.   : milestone, 35894,
appsec (49.796 ms) : 49334, 50257
.   : milestone, 49796,
code_origins (44.915 ms) : 44523, 45308
.   : milestone, 44915,
iast (44.06 ms) : 43666, 44454
.   : milestone, 44060,
profiling (46.078 ms) : 45657, 46499
.   : milestone, 46078,
tracing (43.424 ms) : 43063, 43785
.   : milestone, 43424,
section candidate
no_agent (38.103 ms) : 37796, 38409
.   : milestone, 38103,
appsec (48.257 ms) : 47811, 48703
.   : milestone, 48257,
code_origins (44.728 ms) : 44343, 45113
.   : milestone, 44728,
iast (44.503 ms) : 44124, 44881
.   : milestone, 44503,
profiling (47.338 ms) : 46911, 47765
.   : milestone, 47338,
tracing (44.454 ms) : 44089, 44820
.   : milestone, 44454,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 35.894 ms [35.605 ms, 36.184 ms] -
appsec 49.796 ms [49.334 ms, 50.257 ms] 13.901 ms (38.7%)
code_origins 44.915 ms [44.523 ms, 45.308 ms] 9.021 ms (25.1%)
iast 44.06 ms [43.666 ms, 44.454 ms] 8.166 ms (22.7%)
profiling 46.078 ms [45.657 ms, 46.499 ms] 10.184 ms (28.4%)
tracing 43.424 ms [43.063 ms, 43.785 ms] 7.53 ms (21.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 38.103 ms [37.796 ms, 38.409 ms] -
appsec 48.257 ms [47.811 ms, 48.703 ms] 10.155 ms (26.7%)
code_origins 44.728 ms [44.343 ms, 45.113 ms] 6.626 ms (17.4%)
iast 44.503 ms [44.124 ms, 44.881 ms] 6.4 ms (16.8%)
profiling 47.338 ms [46.911 ms, 47.765 ms] 9.235 ms (24.2%)
tracing 44.454 ms [44.089 ms, 44.82 ms] 6.352 ms (16.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/whats-another-5-seconds
git_commit_date 1757007896 1757015391
git_commit_sha 9c70b0c 5d8db88
release_version 1.54.0-SNAPSHOT~9c70b0c71b 1.54.0-SNAPSHOT~5d8db8858c
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1757017523 1757017523
ci_job_id 1114542285 1114542285
ci_pipeline_id 75594749 75594749
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-dryhwhaq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-dryhwhaq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~5d8db8858c, baseline=1.54.0-SNAPSHOT~9c70b0c71b
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.738 s) : 14738000, 14738000
.   : milestone, 14738000,
appsec (14.888 s) : 14888000, 14888000
.   : milestone, 14888000,
iast (18.64 s) : 18640000, 18640000
.   : milestone, 18640000,
iast_GLOBAL (18.106 s) : 18106000, 18106000
.   : milestone, 18106000,
profiling (15.607 s) : 15607000, 15607000
.   : milestone, 15607000,
tracing (15.037 s) : 15037000, 15037000
.   : milestone, 15037000,
section candidate
no_agent (14.797 s) : 14797000, 14797000
.   : milestone, 14797000,
appsec (15.041 s) : 15041000, 15041000
.   : milestone, 15041000,
iast (18.8 s) : 18800000, 18800000
.   : milestone, 18800000,
iast_GLOBAL (17.906 s) : 17906000, 17906000
.   : milestone, 17906000,
profiling (15.536 s) : 15536000, 15536000
.   : milestone, 15536000,
tracing (14.956 s) : 14956000, 14956000
.   : milestone, 14956000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.738 s [14.738 s, 14.738 s] -
appsec 14.888 s [14.888 s, 14.888 s] 150.0 ms (1.0%)
iast 18.64 s [18.64 s, 18.64 s] 3.902 s (26.5%)
iast_GLOBAL 18.106 s [18.106 s, 18.106 s] 3.368 s (22.9%)
profiling 15.607 s [15.607 s, 15.607 s] 869.0 ms (5.9%)
tracing 15.037 s [15.037 s, 15.037 s] 299.0 ms (2.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.797 s [14.797 s, 14.797 s] -
appsec 15.041 s [15.041 s, 15.041 s] 244.0 ms (1.6%)
iast 18.8 s [18.8 s, 18.8 s] 4.003 s (27.1%)
iast_GLOBAL 17.906 s [17.906 s, 17.906 s] 3.109 s (21.0%)
profiling 15.536 s [15.536 s, 15.536 s] 739.0 ms (5.0%)
tracing 14.956 s [14.956 s, 14.956 s] 159.0 ms (1.1%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~5d8db8858c, baseline=1.54.0-SNAPSHOT~9c70b0c71b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (3.681 ms) : 3464, 3899
.   : milestone, 3681,
iast (2.197 ms) : 2134, 2260
.   : milestone, 2197,
iast_GLOBAL (2.265 ms) : 2201, 2329
.   : milestone, 2265,
profiling (2.057 ms) : 2005, 2109
.   : milestone, 2057,
tracing (2.019 ms) : 1971, 2068
.   : milestone, 2019,
section candidate
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (3.695 ms) : 3476, 3913
.   : milestone, 3695,
iast (2.194 ms) : 2132, 2256
.   : milestone, 2194,
iast_GLOBAL (2.244 ms) : 2180, 2307
.   : milestone, 2244,
profiling (2.065 ms) : 2014, 2117
.   : milestone, 2065,
tracing (2.027 ms) : 1978, 2076
.   : milestone, 2027,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.488 ms] -
appsec 3.681 ms [3.464 ms, 3.899 ms] 2.205 ms (149.3%)
iast 2.197 ms [2.134 ms, 2.26 ms] 720.646 µs (48.8%)
iast_GLOBAL 2.265 ms [2.201 ms, 2.329 ms] 788.403 µs (53.4%)
profiling 2.057 ms [2.005 ms, 2.109 ms] 580.36 µs (39.3%)
tracing 2.019 ms [1.971 ms, 2.068 ms] 542.841 µs (36.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 3.695 ms [3.476 ms, 3.913 ms] 2.221 ms (150.7%)
iast 2.194 ms [2.132 ms, 2.256 ms] 720.392 µs (48.9%)
iast_GLOBAL 2.244 ms [2.18 ms, 2.307 ms] 770.189 µs (52.3%)
profiling 2.065 ms [2.014 ms, 2.117 ms] 591.779 µs (40.2%)
tracing 2.027 ms [1.978 ms, 2.076 ms] 553.188 µs (37.5%)

@MattAlp MattAlp merged commit c4c1019 into master Sep 4, 2025
509 checks passed
@MattAlp MattAlp deleted the mattalp/whats-another-5-seconds branch September 4, 2025 20:29
@github-actions github-actions Bot added this to the 1.54.0 milestone Sep 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

@smola smola Awaiting requested review from smola smola was automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

comp: testing Testing run-tests: oracle8 Run tests using Oracle 8 JDK tag: flaky test Flaky tests tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.54.0

Development

Successfully merging this pull request may close these issues.

2 participants

@MattAlp @AlexeyKuznetsov-DD