Skip to content

Test PekkoHttpServerInstrumentationAsyncHttp2Test.test exception marked as flaky.#9397

Merged
AlexeyKuznetsov-DD merged 1 commit intomasterfrom
alexeyk/mark-pekko-test-as-flaky
Aug 20, 2025
Merged

Test PekkoHttpServerInstrumentationAsyncHttp2Test.test exception marked as flaky.#9397
AlexeyKuznetsov-DD merged 1 commit intomasterfrom
alexeyk/mark-pekko-test-as-flaky

Conversation

@AlexeyKuznetsov-DD
Copy link
Copy Markdown
Contributor

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD commented Aug 20, 2025

What Does This Do

Test PekkoHttpServerInstrumentationAsyncHttp2Test.test exception marked as flaky.

Motivation

Green CI.

Additional Notes

Test failed more than 200 times during last month on GitLab CI.

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD self-assigned this Aug 20, 2025
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Aug 20, 2025
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD marked this pull request as ready for review August 20, 2025 19:52
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD requested a review from a team as a code owner August 20, 2025 19:52
@datadog-datadog-prod-us1
Copy link
Copy Markdown
Contributor

datadog-datadog-prod-us1 Bot commented Aug 20, 2025 •
edited by datadog-official Bot
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 57.60% (+0.06%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 10c83a6 | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Aug 20, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/mark-pekko-test-as-flaky
git_commit_date 1755718248 1755719441
git_commit_sha c2e8852 10c83a6
release_version 1.53.0-SNAPSHOT~c2e8852e57 1.53.0-SNAPSHOT~10c83a65bb
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1755721456 1755721456
ci_job_id 1090738973 1090738973
ci_pipeline_id 74301550 74301550
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-u2cacc6e 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-u2cacc6e 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 11 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~10c83a65bb, baseline=1.53.0-SNAPSHOT~c2e8852e57

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.051 s) : 0, 1050815
Total [baseline] (10.729 s) : 0, 10728547
Agent [candidate] (1.052 s) : 0, 1052139
Total [candidate] (10.743 s) : 0, 10743213
section appsec
Agent [baseline] (1.223 s) : 0, 1223263
Total [baseline] (10.775 s) : 0, 10774917
Agent [candidate] (1.225 s) : 0, 1224992
Total [candidate] (10.811 s) : 0, 10811475
section iast
Agent [baseline] (1.193 s) : 0, 1192790
Total [baseline] (10.949 s) : 0, 10949396
Agent [candidate] (1.189 s) : 0, 1189271
Total [candidate] (10.971 s) : 0, 10970726
section profiling
Agent [baseline] (1.203 s) : 0, 1202580
Total [baseline] (10.906 s) : 0, 10905522
Agent [candidate] (1.197 s) : 0, 1197361
Total [candidate] (10.874 s) : 0, 10874166
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent appsec 1.223 s 172.449 ms (16.4%)
Agent iast 1.193 s 141.975 ms (13.5%)
Agent profiling 1.203 s 151.766 ms (14.4%)
Total tracing 10.729 s -
Total appsec 10.775 s 46.371 ms (0.4%)
Total iast 10.949 s 220.85 ms (2.1%)
Total profiling 10.906 s 176.975 ms (1.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent appsec 1.225 s 172.853 ms (16.4%)
Agent iast 1.189 s 137.132 ms (13.0%)
Agent profiling 1.197 s 145.222 ms (13.8%)
Total tracing 10.743 s -
Total appsec 10.811 s 68.262 ms (0.6%)
Total iast 10.971 s 227.513 ms (2.1%)
Total profiling 10.874 s 130.954 ms (1.2%) 
gantt
    title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~10c83a65bb, baseline=1.53.0-SNAPSHOT~c2e8852e57

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.449 ms) : 0, 1449
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (734.615 ms) : 0, 734615
BytebuddyAgent [candidate] (737.452 ms) : 0, 737452
GlobalTracer [baseline] (244.724 ms) : 0, 244724
GlobalTracer [candidate] (244.633 ms) : 0, 244633
AppSec [baseline] (30.524 ms) : 0, 30524
AppSec [candidate] (30.441 ms) : 0, 30441
Debugger [baseline] (6.075 ms) : 0, 6075
Debugger [candidate] (6.129 ms) : 0, 6129
Remote Config [baseline] (679.281 µs) : 0, 679
Remote Config [candidate] (686.251 µs) : 0, 686
Telemetry [baseline] (11.591 ms) : 0, 11591
Telemetry [candidate] (10.132 ms) : 0, 10132
section appsec
crashtracking [baseline] (1.461 ms) : 0, 1461
crashtracking [candidate] (1.439 ms) : 0, 1439
BytebuddyAgent [baseline] (755.708 ms) : 0, 755708
BytebuddyAgent [candidate] (756.435 ms) : 0, 756435
GlobalTracer [baseline] (235.464 ms) : 0, 235464
GlobalTracer [candidate] (235.302 ms) : 0, 235302
AppSec [baseline] (170.387 ms) : 0, 170387
AppSec [candidate] (170.405 ms) : 0, 170405
Debugger [baseline] (6.496 ms) : 0, 6496
Debugger [candidate] (5.908 ms) : 0, 5908
Remote Config [baseline] (645.97 µs) : 0, 646
Remote Config [candidate] (649.308 µs) : 0, 649
Telemetry [baseline] (8.438 ms) : 0, 8438
Telemetry [candidate] (9.992 ms) : 0, 9992
IAST [baseline] (23.546 ms) : 0, 23546
IAST [candidate] (23.732 ms) : 0, 23732
section iast
crashtracking [baseline] (1.477 ms) : 0, 1477
crashtracking [candidate] (1.451 ms) : 0, 1451
BytebuddyAgent [baseline] (861.457 ms) : 0, 861457
BytebuddyAgent [candidate] (859.113 ms) : 0, 859113
GlobalTracer [baseline] (235.913 ms) : 0, 235913
GlobalTracer [candidate] (235.022 ms) : 0, 235022
AppSec [baseline] (27.102 ms) : 0, 27102
AppSec [candidate] (28.977 ms) : 0, 28977
Debugger [baseline] (6.634 ms) : 0, 6634
Debugger [candidate] (6.566 ms) : 0, 6566
Remote Config [baseline] (606.254 µs) : 0, 606
Remote Config [candidate] (596.931 µs) : 0, 597
Telemetry [baseline] (8.41 ms) : 0, 8410
Telemetry [candidate] (8.417 ms) : 0, 8417
IAST [baseline] (29.919 ms) : 0, 29919
IAST [candidate] (27.824 ms) : 0, 27824
section profiling
ProfilingAgent [baseline] (109.727 ms) : 0, 109727
ProfilingAgent [candidate] (107.502 ms) : 0, 107502
crashtracking [baseline] (1.42 ms) : 0, 1420
crashtracking [candidate] (1.425 ms) : 0, 1425
BytebuddyAgent [baseline] (764.558 ms) : 0, 764558
BytebuddyAgent [candidate] (762.642 ms) : 0, 762642
GlobalTracer [baseline] (223.569 ms) : 0, 223569
GlobalTracer [candidate] (222.637 ms) : 0, 222637
AppSec [baseline] (30.569 ms) : 0, 30569
AppSec [candidate] (30.155 ms) : 0, 30155
Debugger [baseline] (6.332 ms) : 0, 6332
Debugger [candidate] (6.332 ms) : 0, 6332
Remote Config [baseline] (705.056 µs) : 0, 705
Remote Config [candidate] (705.355 µs) : 0, 705
Telemetry [baseline] (15.957 ms) : 0, 15957
Telemetry [candidate] (16.385 ms) : 0, 16385
Profiling [baseline] (110.382 ms) : 0, 110382
Profiling [candidate] (108.155 ms) : 0, 108155
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~10c83a65bb, baseline=1.53.0-SNAPSHOT~c2e8852e57

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.051 s) : 0, 1050587
Total [baseline] (8.609 s) : 0, 8609248
Agent [candidate] (1.05 s) : 0, 1049733
Total [candidate] (8.628 s) : 0, 8627649
section iast
Agent [baseline] (1.184 s) : 0, 1183512
Total [baseline] (9.348 s) : 0, 9347653
Agent [candidate] (1.18 s) : 0, 1179624
Total [candidate] (9.359 s) : 0, 9359064
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent iast 1.184 s 132.925 ms (12.7%)
Total tracing 8.609 s -
Total iast 9.348 s 738.405 ms (8.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.05 s -
Agent iast 1.18 s 129.892 ms (12.4%)
Total tracing 8.628 s -
Total iast 9.359 s 731.416 ms (8.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~10c83a65bb, baseline=1.53.0-SNAPSHOT~c2e8852e57

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.449 ms) : 0, 1449
BytebuddyAgent [baseline] (734.91 ms) : 0, 734910
BytebuddyAgent [candidate] (732.314 ms) : 0, 732314
GlobalTracer [baseline] (243.172 ms) : 0, 243172
GlobalTracer [candidate] (243.571 ms) : 0, 243571
AppSec [baseline] (30.233 ms) : 0, 30233
AppSec [candidate] (30.257 ms) : 0, 30257
Debugger [baseline] (6.099 ms) : 0, 6099
Debugger [candidate] (6.077 ms) : 0, 6077
Remote Config [baseline] (668.359 µs) : 0, 668
Remote Config [candidate] (669.445 µs) : 0, 669
Telemetry [baseline] (13.04 ms) : 0, 13040
Telemetry [candidate] (14.463 ms) : 0, 14463
section iast
crashtracking [baseline] (1.461 ms) : 0, 1461
crashtracking [candidate] (1.449 ms) : 0, 1449
BytebuddyAgent [baseline] (853.988 ms) : 0, 853988
BytebuddyAgent [candidate] (850.789 ms) : 0, 850789
GlobalTracer [baseline] (234.246 ms) : 0, 234246
GlobalTracer [candidate] (233.432 ms) : 0, 233432
AppSec [baseline] (28.546 ms) : 0, 28546
AppSec [candidate] (26.838 ms) : 0, 26838
Debugger [baseline] (7.54 ms) : 0, 7540
Debugger [candidate] (5.771 ms) : 0, 5771
Remote Config [baseline] (602.571 µs) : 0, 603
Remote Config [candidate] (601.79 µs) : 0, 602
Telemetry [baseline] (8.249 ms) : 0, 8249
Telemetry [candidate] (8.406 ms) : 0, 8406
IAST [baseline] (27.846 ms) : 0, 27846
IAST [candidate] (31.341 ms) : 0, 31341
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/mark-pekko-test-as-flaky
git_commit_date 1755718248 1755719441
git_commit_sha c2e8852 10c83a6
release_version 1.53.0-SNAPSHOT~c2e8852e57 1.53.0-SNAPSHOT~10c83a65bb
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1755721059 1755721059
ci_job_id 1090738974 1090738974
ci_pipeline_id 74301550 74301550
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-8c8whcce 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-8c8whcce 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:no_agent:high_load worse
[+114.132µs; +222.286µs] or [+2.641%; +5.144%]		 unstable
[-156.121op/s; +78.684op/s] or [-14.702%; +7.410%]		 4.489ms 1023.188op/s 4.321ms 1061.906op/s
scenario:load:petclinic:iast:high_load better
[-2.218ms; -1.388ms] or [-4.895%; -3.063%]		 unstable
[-4.058op/s; +9.919op/s] or [-3.880%; +9.483%]		 43.505ms 107.525op/s 45.308ms 104.595op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~10c83a65bb, baseline=1.53.0-SNAPSHOT~c2e8852e57
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.321 ms) : 4272, 4370
.   : milestone, 4321,
iast (9.51 ms) : 9345, 9675
.   : milestone, 9510,
iast_FULL (14.135 ms) : 13854, 14416
.   : milestone, 14135,
iast_GLOBAL (9.974 ms) : 9789, 10158
.   : milestone, 9974,
profiling (8.646 ms) : 8499, 8792
.   : milestone, 8646,
tracing (7.582 ms) : 7473, 7692
.   : milestone, 7582,
section candidate
no_agent (4.489 ms) : 4438, 4541
.   : milestone, 4489,
iast (9.308 ms) : 9148, 9468
.   : milestone, 9308,
iast_FULL (13.735 ms) : 13463, 14006
.   : milestone, 13735,
iast_GLOBAL (10.353 ms) : 10172, 10534
.   : milestone, 10353,
profiling (8.762 ms) : 8618, 8905
.   : milestone, 8762,
tracing (7.757 ms) : 7648, 7865
.   : milestone, 7757,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.321 ms [4.272 ms, 4.37 ms] -
iast 9.51 ms [9.345 ms, 9.675 ms] 5.189 ms (120.1%)
iast_FULL 14.135 ms [13.854 ms, 14.416 ms] 9.814 ms (227.1%)
iast_GLOBAL 9.974 ms [9.789 ms, 10.158 ms] 5.653 ms (130.8%)
profiling 8.646 ms [8.499 ms, 8.792 ms] 4.325 ms (100.1%)
tracing 7.582 ms [7.473 ms, 7.692 ms] 3.261 ms (75.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.489 ms [4.438 ms, 4.541 ms] -
iast 9.308 ms [9.148 ms, 9.468 ms] 4.818 ms (107.3%)
iast_FULL 13.735 ms [13.463 ms, 14.006 ms] 9.245 ms (205.9%)
iast_GLOBAL 10.353 ms [10.172 ms, 10.534 ms] 5.864 ms (130.6%)
profiling 8.762 ms [8.618 ms, 8.905 ms] 4.272 ms (95.2%)
tracing 7.757 ms [7.648 ms, 7.865 ms] 3.267 ms (72.8%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~10c83a65bb, baseline=1.53.0-SNAPSHOT~c2e8852e57
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.707 ms) : 36416, 36997
.   : milestone, 36707,
appsec (48.834 ms) : 48395, 49273
.   : milestone, 48834,
code_origins (45.151 ms) : 44764, 45538
.   : milestone, 45151,
iast (45.308 ms) : 44914, 45703
.   : milestone, 45308,
profiling (48.717 ms) : 48277, 49157
.   : milestone, 48717,
tracing (44.251 ms) : 43884, 44617
.   : milestone, 44251,
section candidate
no_agent (37.619 ms) : 37317, 37922
.   : milestone, 37619,
appsec (47.5 ms) : 47070, 47930
.   : milestone, 47500,
code_origins (45.329 ms) : 44926, 45733
.   : milestone, 45329,
iast (43.505 ms) : 43129, 43882
.   : milestone, 43505,
profiling (49.407 ms) : 48883, 49931
.   : milestone, 49407,
tracing (43.42 ms) : 43048, 43792
.   : milestone, 43420,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.707 ms [36.416 ms, 36.997 ms] -
appsec 48.834 ms [48.395 ms, 49.273 ms] 12.127 ms (33.0%)
code_origins 45.151 ms [44.764 ms, 45.538 ms] 8.444 ms (23.0%)
iast 45.308 ms [44.914 ms, 45.703 ms] 8.602 ms (23.4%)
profiling 48.717 ms [48.277 ms, 49.157 ms] 12.011 ms (32.7%)
tracing 44.251 ms [43.884 ms, 44.617 ms] 7.544 ms (20.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.619 ms [37.317 ms, 37.922 ms] -
appsec 47.5 ms [47.07 ms, 47.93 ms] 9.881 ms (26.3%)
code_origins 45.329 ms [44.926 ms, 45.733 ms] 7.71 ms (20.5%)
iast 43.505 ms [43.129 ms, 43.882 ms] 5.886 ms (15.6%)
profiling 49.407 ms [48.883 ms, 49.931 ms] 11.787 ms (31.3%)
tracing 43.42 ms [43.048 ms, 43.792 ms] 5.801 ms (15.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/mark-pekko-test-as-flaky
git_commit_date 1755718248 1755719441
git_commit_sha c2e8852 10c83a6
release_version 1.53.0-SNAPSHOT~c2e8852e57 1.53.0-SNAPSHOT~10c83a65bb
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1755721601 1755721601
ci_job_id 1090738975 1090738975
ci_pipeline_id 74301550 74301550
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-pyrzjqae 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-pyrzjqae 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~10c83a65bb, baseline=1.53.0-SNAPSHOT~c2e8852e57
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1471, 1494
.   : milestone, 1482,
appsec (3.608 ms) : 3393, 3823
.   : milestone, 3608,
iast (2.216 ms) : 2153, 2279
.   : milestone, 2216,
iast_GLOBAL (2.246 ms) : 2183, 2309
.   : milestone, 2246,
profiling (2.063 ms) : 2011, 2115
.   : milestone, 2063,
tracing (2.032 ms) : 1983, 2080
.   : milestone, 2032,
section candidate
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (3.648 ms) : 3431, 3866
.   : milestone, 3648,
iast (2.193 ms) : 2131, 2256
.   : milestone, 2193,
iast_GLOBAL (2.25 ms) : 2187, 2313
.   : milestone, 2250,
profiling (2.067 ms) : 2015, 2119
.   : milestone, 2067,
tracing (2.023 ms) : 1974, 2072
.   : milestone, 2023,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.471 ms, 1.494 ms] -
appsec 3.608 ms [3.393 ms, 3.823 ms] 2.126 ms (143.4%)
iast 2.216 ms [2.153 ms, 2.279 ms] 733.63 µs (49.5%)
iast_GLOBAL 2.246 ms [2.183 ms, 2.309 ms] 763.506 µs (51.5%)
profiling 2.063 ms [2.011 ms, 2.115 ms] 580.972 µs (39.2%)
tracing 2.032 ms [1.983 ms, 2.08 ms] 549.276 µs (37.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 3.648 ms [3.431 ms, 3.866 ms] 2.173 ms (147.2%)
iast 2.193 ms [2.131 ms, 2.256 ms] 717.757 µs (48.6%)
iast_GLOBAL 2.25 ms [2.187 ms, 2.313 ms] 774.046 µs (52.5%)
profiling 2.067 ms [2.015 ms, 2.119 ms] 591.197 µs (40.1%)
tracing 2.023 ms [1.974 ms, 2.072 ms] 547.031 µs (37.1%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~10c83a65bb, baseline=1.53.0-SNAPSHOT~c2e8852e57
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.948 s) : 14948000, 14948000
.   : milestone, 14948000,
appsec (14.725 s) : 14725000, 14725000
.   : milestone, 14725000,
iast (18.582 s) : 18582000, 18582000
.   : milestone, 18582000,
iast_GLOBAL (17.948 s) : 17948000, 17948000
.   : milestone, 17948000,
profiling (15.177 s) : 15177000, 15177000
.   : milestone, 15177000,
tracing (14.72 s) : 14720000, 14720000
.   : milestone, 14720000,
section candidate
no_agent (14.881 s) : 14881000, 14881000
.   : milestone, 14881000,
appsec (14.986 s) : 14986000, 14986000
.   : milestone, 14986000,
iast (18.296 s) : 18296000, 18296000
.   : milestone, 18296000,
iast_GLOBAL (18.108 s) : 18108000, 18108000
.   : milestone, 18108000,
profiling (15.084 s) : 15084000, 15084000
.   : milestone, 15084000,
tracing (14.815 s) : 14815000, 14815000
.   : milestone, 14815000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.948 s [14.948 s, 14.948 s] -
appsec 14.725 s [14.725 s, 14.725 s] -223.0 ms (-1.5%)
iast 18.582 s [18.582 s, 18.582 s] 3.634 s (24.3%)
iast_GLOBAL 17.948 s [17.948 s, 17.948 s] 3.0 s (20.1%)
profiling 15.177 s [15.177 s, 15.177 s] 229.0 ms (1.5%)
tracing 14.72 s [14.72 s, 14.72 s] -228.0 ms (-1.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.881 s [14.881 s, 14.881 s] -
appsec 14.986 s [14.986 s, 14.986 s] 105.0 ms (0.7%)
iast 18.296 s [18.296 s, 18.296 s] 3.415 s (22.9%)
iast_GLOBAL 18.108 s [18.108 s, 18.108 s] 3.227 s (21.7%)
profiling 15.084 s [15.084 s, 15.084 s] 203.0 ms (1.4%)
tracing 14.815 s [14.815 s, 14.815 s] -66.0 ms (-0.4%)

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD merged commit 5aa25ba into master Aug 20, 2025
505 of 506 checks passed
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD deleted the alexeyk/mark-pekko-test-as-flaky branch August 20, 2025 20:55
@github-actions github-actions Bot added this to the 1.53.0 milestone Aug 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@sarahchen6 sarahchen6 sarahchen6 approved these changes

@ygree ygree Awaiting requested review from ygree ygree is a code owner automatically assigned from DataDog/apm-java

@PerfectSlayer PerfectSlayer Awaiting requested review from PerfectSlayer

Assignees

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.53.0

Development

Successfully merging this pull request may close these issues.

2 participants

@AlexeyKuznetsov-DD @sarahchen6