Updated flaky tests. by AlexeyKuznetsov-DD · Pull Request #9366 · DataDog/dd-trace-java

AlexeyKuznetsov-DD · 2025-08-14T19:15:53Z

What Does This Do

Removed references toApacheHttpAsyncClient5Test - it is an abstract class now.
Marked couple of tests as flaky for ApacheHttpAsyncClient5NamingV0Test.

Motivation

Green CI.

Additional Notes

Task ':dd-java-agent:instrumentation:apache-httpclient:apache-httpclient-5.0:test' is failing on CI quite often.

pr-commenter · 2025-08-14T19:46:52Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/apache-http-5-flaky-tests
git_commit_date	1755193125	1755198645
git_commit_sha	`fa0bdff`	`a1fae6a`
release_version	1.53.0-SNAPSHOT~fa0bdff580	1.53.0-SNAPSHOT~a1fae6ac4f

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1755200646	1755200646
ci_job_id	1081403369	1081403369
ci_pipeline_id	73731233	73731233
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-w50vyyd6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-w50vyyd6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 47 metrics, 12 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~a1fae6ac4f, baseline=1.53.0-SNAPSHOT~fa0bdff580

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.045 s) : 0, 1044633
Total [baseline] (10.717 s) : 0, 10717356
Agent [candidate] (1.044 s) : 0, 1044153
Total [candidate] (10.643 s) : 0, 10642726
section appsec
Agent [baseline] (1.219 s) : 0, 1218720
Total [baseline] (10.797 s) : 0, 10796822
Agent [candidate] (1.219 s) : 0, 1218574
Total [candidate] (10.77 s) : 0, 10770370
section iast
Agent [baseline] (1.178 s) : 0, 1177818
Total [baseline] (10.913 s) : 0, 10913285
Agent [candidate] (1.179 s) : 0, 1178702
Total [candidate] (10.912 s) : 0, 10912013
section profiling
Agent [baseline] (1.21 s) : 0, 1209940
Total [baseline] (11.045 s) : 0, 11044721
Agent [candidate] (1.191 s) : 0, 1190842
Total [candidate] (10.793 s) : 0, 10793256

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.045 s	-
Agent	appsec	1.219 s	174.087 ms (16.7%)
Agent	iast	1.178 s	133.185 ms (12.7%)
Agent	profiling	1.21 s	165.307 ms (15.8%)
Total	tracing	10.717 s	-
Total	appsec	10.797 s	79.467 ms (0.7%)
Total	iast	10.913 s	195.929 ms (1.8%)
Total	profiling	11.045 s	327.365 ms (3.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.044 s	-
Agent	appsec	1.219 s	174.421 ms (16.7%)
Agent	iast	1.179 s	134.549 ms (12.9%)
Agent	profiling	1.191 s	146.689 ms (14.0%)
Total	tracing	10.643 s	-
Total	appsec	10.77 s	127.644 ms (1.2%)
Total	iast	10.912 s	269.286 ms (2.5%)
Total	profiling	10.793 s	150.529 ms (1.4%)

gantt
    title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~a1fae6ac4f, baseline=1.53.0-SNAPSHOT~fa0bdff580

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.418 ms) : 0, 1418
crashtracking [candidate] (1.417 ms) : 0, 1417
BytebuddyAgent [baseline] (730.468 ms) : 0, 730468
BytebuddyAgent [candidate] (730.577 ms) : 0, 730577
GlobalTracer [baseline] (241.711 ms) : 0, 241711
GlobalTracer [candidate] (241.19 ms) : 0, 241190
AppSec [baseline] (30.05 ms) : 0, 30050
AppSec [candidate] (29.954 ms) : 0, 29954
Debugger [baseline] (6.0 ms) : 0, 6000
Debugger [candidate] (6.011 ms) : 0, 6011
Remote Config [baseline] (643.068 µs) : 0, 643
Remote Config [candidate] (642.936 µs) : 0, 643
Telemetry [baseline] (13.382 ms) : 0, 13382
Telemetry [candidate] (13.381 ms) : 0, 13381
section appsec
crashtracking [baseline] (1.429 ms) : 0, 1429
crashtracking [candidate] (1.419 ms) : 0, 1419
BytebuddyAgent [baseline] (753.005 ms) : 0, 753005
BytebuddyAgent [candidate] (752.549 ms) : 0, 752549
GlobalTracer [baseline] (234.497 ms) : 0, 234497
GlobalTracer [candidate] (234.448 ms) : 0, 234448
AppSec [baseline] (169.808 ms) : 0, 169808
AppSec [candidate] (168.066 ms) : 0, 168066
Debugger [baseline] (5.76 ms) : 0, 5760
Debugger [candidate] (7.173 ms) : 0, 7173
Remote Config [baseline] (626.348 µs) : 0, 626
Remote Config [candidate] (622.698 µs) : 0, 623
Telemetry [baseline] (9.137 ms) : 0, 9137
Telemetry [candidate] (9.836 ms) : 0, 9836
IAST [baseline] (23.421 ms) : 0, 23421
IAST [candidate] (23.483 ms) : 0, 23483
section iast
crashtracking [baseline] (1.425 ms) : 0, 1425
crashtracking [candidate] (1.43 ms) : 0, 1430
BytebuddyAgent [baseline] (850.317 ms) : 0, 850317
BytebuddyAgent [candidate] (850.554 ms) : 0, 850554
GlobalTracer [baseline] (233.062 ms) : 0, 233062
GlobalTracer [candidate] (233.056 ms) : 0, 233056
AppSec [baseline] (27.364 ms) : 0, 27364
AppSec [candidate] (27.553 ms) : 0, 27553
Debugger [baseline] (6.598 ms) : 0, 6598
Debugger [candidate] (9.196 ms) : 0, 9196
Remote Config [baseline] (576.435 µs) : 0, 576
Remote Config [candidate] (582.984 µs) : 0, 583
Telemetry [baseline] (8.335 ms) : 0, 8335
Telemetry [candidate] (9.153 ms) : 0, 9153
IAST [baseline] (29.109 ms) : 0, 29109
IAST [candidate] (26.068 ms) : 0, 26068
section profiling
ProfilingAgent [baseline] (109.81 ms) : 0, 109810
ProfilingAgent [candidate] (107.394 ms) : 0, 107394
crashtracking [baseline] (1.412 ms) : 0, 1412
crashtracking [candidate] (1.389 ms) : 0, 1389
BytebuddyAgent [baseline] (771.8 ms) : 0, 771800
BytebuddyAgent [candidate] (759.416 ms) : 0, 759416
GlobalTracer [baseline] (224.43 ms) : 0, 224430
GlobalTracer [candidate] (220.865 ms) : 0, 220865
AppSec [baseline] (30.43 ms) : 0, 30430
AppSec [candidate] (29.821 ms) : 0, 29821
Debugger [baseline] (6.346 ms) : 0, 6346
Debugger [candidate] (6.262 ms) : 0, 6262
Remote Config [baseline] (679.151 µs) : 0, 679
Remote Config [candidate] (665.426 µs) : 0, 665
Telemetry [baseline] (15.336 ms) : 0, 15336
Telemetry [candidate] (15.738 ms) : 0, 15738
Profiling [baseline] (110.479 ms) : 0, 110479
Profiling [candidate] (108.032 ms) : 0, 108032

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~a1fae6ac4f, baseline=1.53.0-SNAPSHOT~fa0bdff580

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.044 s) : 0, 1043738
Total [baseline] (8.594 s) : 0, 8594438
Agent [candidate] (1.05 s) : 0, 1050372
Total [candidate] (8.598 s) : 0, 8597755
section iast
Agent [baseline] (1.187 s) : 0, 1186512
Total [baseline] (9.326 s) : 0, 9325651
Agent [candidate] (1.179 s) : 0, 1178503
Total [candidate] (9.294 s) : 0, 9293610

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.044 s	-
Agent	iast	1.187 s	142.774 ms (13.7%)
Total	tracing	8.594 s	-
Total	iast	9.326 s	731.213 ms (8.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.05 s	-
Agent	iast	1.179 s	128.131 ms (12.2%)
Total	tracing	8.598 s	-
Total	iast	9.294 s	695.855 ms (8.1%)

gantt
    title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~a1fae6ac4f, baseline=1.53.0-SNAPSHOT~fa0bdff580

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.424 ms) : 0, 1424
crashtracking [candidate] (1.425 ms) : 0, 1425
BytebuddyAgent [baseline] (730.366 ms) : 0, 730366
BytebuddyAgent [candidate] (735.06 ms) : 0, 735060
GlobalTracer [baseline] (241.558 ms) : 0, 241558
GlobalTracer [candidate] (243.052 ms) : 0, 243052
AppSec [baseline] (30.09 ms) : 0, 30090
AppSec [candidate] (30.166 ms) : 0, 30166
Debugger [baseline] (6.036 ms) : 0, 6036
Debugger [candidate] (6.067 ms) : 0, 6067
Remote Config [baseline] (650.191 µs) : 0, 650
Remote Config [candidate] (663.702 µs) : 0, 664
Telemetry [baseline] (12.712 ms) : 0, 12712
Telemetry [candidate] (12.954 ms) : 0, 12954
section iast
crashtracking [baseline] (1.439 ms) : 0, 1439
crashtracking [candidate] (1.421 ms) : 0, 1421
BytebuddyAgent [baseline] (857.377 ms) : 0, 857377
BytebuddyAgent [candidate] (851.175 ms) : 0, 851175
GlobalTracer [baseline] (234.553 ms) : 0, 234553
GlobalTracer [candidate] (233.876 ms) : 0, 233876
AppSec [baseline] (30.224 ms) : 0, 30224
AppSec [candidate] (28.22 ms) : 0, 28220
Debugger [baseline] (7.317 ms) : 0, 7317
Debugger [candidate] (6.586 ms) : 0, 6586
Remote Config [baseline] (584.375 µs) : 0, 584
Remote Config [candidate] (584.566 µs) : 0, 585
Telemetry [baseline] (8.354 ms) : 0, 8354
Telemetry [candidate] (8.24 ms) : 0, 8240
IAST [baseline] (25.5 ms) : 0, 25500
IAST [candidate] (27.45 ms) : 0, 27450

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/apache-http-5-flaky-tests
git_commit_date	1755193125	1755198645
git_commit_sha	`fa0bdff`	`a1fae6a`
release_version	1.53.0-SNAPSHOT~fa0bdff580	1.53.0-SNAPSHOT~a1fae6ac4f

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1755200319	1755200319
ci_job_id	1081403370	1081403370
ci_pipeline_id	73731233	73731233
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-hal1oai0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-hal1oai0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 3 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:iast:high_load	worse [+297.220µs; +638.616µs] or [+3.225%; +6.929%]	unstable [-84.639op/s; +36.639op/s] or [-16.806%; +7.275%]	9.685ms	479.625op/s	9.217ms	503.625op/s
scenario:load:petclinic:no_agent:high_load	better [-2.116ms; -1.461ms] or [-5.525%; -3.815%]	unstable [-2.248op/s; +14.223op/s] or [-1.841%; +11.647%]	36.508ms	128.100op/s	38.297ms	122.112op/s
scenario:load:petclinic:tracing:high_load	better [-2.397ms; -1.590ms] or [-5.249%; -3.482%]	unstable [-2.568op/s; +11.868op/s] or [-2.505%; +11.576%]	43.664ms	107.175op/s	45.657ms	102.525op/s
scenario:load:petclinic:code_origins:high_load	worse [+2.174ms; +3.055ms] or [+4.872%; +6.845%]	unstable [-12.692op/s; +1.042op/s] or [-12.102%; +0.993%]	47.242ms	99.050op/s	44.627ms	104.875op/s
scenario:load:petclinic:profiling:high_load	worse [+2.583ms; +3.590ms] or [+5.592%; +7.770%]	unstable [-13.562op/s; +0.912op/s] or [-13.386%; +0.900%]	49.284ms	94.987op/s	46.198ms	101.312op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~a1fae6ac4f, baseline=1.53.0-SNAPSHOT~fa0bdff580
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.367 ms) : 4313, 4421
.   : milestone, 4367,
iast (9.217 ms) : 9068, 9366
.   : milestone, 9217,
iast_FULL (14.086 ms) : 13798, 14374
.   : milestone, 14086,
iast_GLOBAL (10.149 ms) : 9974, 10323
.   : milestone, 10149,
profiling (8.68 ms) : 8546, 8815
.   : milestone, 8680,
tracing (7.596 ms) : 7488, 7704
.   : milestone, 7596,
section candidate
no_agent (4.5 ms) : 4443, 4557
.   : milestone, 4500,
iast (9.685 ms) : 9518, 9852
.   : milestone, 9685,
iast_FULL (13.865 ms) : 13593, 14137
.   : milestone, 13865,
iast_GLOBAL (10.442 ms) : 10258, 10627
.   : milestone, 10442,
profiling (8.9 ms) : 8752, 9048
.   : milestone, 8900,
tracing (7.338 ms) : 7229, 7446
.   : milestone, 7338,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.367 ms [4.313 ms, 4.421 ms]	-
iast	9.217 ms [9.068 ms, 9.366 ms]	4.85 ms (111.0%)
iast_FULL	14.086 ms [13.798 ms, 14.374 ms]	9.718 ms (222.5%)
iast_GLOBAL	10.149 ms [9.974 ms, 10.323 ms]	5.781 ms (132.4%)
profiling	8.68 ms [8.546 ms, 8.815 ms]	4.313 ms (98.8%)
tracing	7.596 ms [7.488 ms, 7.704 ms]	3.228 ms (73.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.5 ms [4.443 ms, 4.557 ms]	-
iast	9.685 ms [9.518 ms, 9.852 ms]	5.185 ms (115.2%)
iast_FULL	13.865 ms [13.593 ms, 14.137 ms]	9.365 ms (208.1%)
iast_GLOBAL	10.442 ms [10.258 ms, 10.627 ms]	5.942 ms (132.0%)
profiling	8.9 ms [8.752 ms, 9.048 ms]	4.4 ms (97.8%)
tracing	7.338 ms [7.229 ms, 7.446 ms]	2.837 ms (63.1%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~a1fae6ac4f, baseline=1.53.0-SNAPSHOT~fa0bdff580
    dateFormat X
    axisFormat %s
section baseline
no_agent (38.297 ms) : 37984, 38610
.   : milestone, 38297,
appsec (50.2 ms) : 49748, 50653
.   : milestone, 50200,
code_origins (44.627 ms) : 44226, 45028
.   : milestone, 44627,
iast (44.346 ms) : 43955, 44738
.   : milestone, 44346,
profiling (46.198 ms) : 45759, 46636
.   : milestone, 46198,
tracing (45.657 ms) : 45272, 46043
.   : milestone, 45657,
section candidate
no_agent (36.508 ms) : 36213, 36803
.   : milestone, 36508,
appsec (49.867 ms) : 49434, 50300
.   : milestone, 49867,
code_origins (47.242 ms) : 46825, 47659
.   : milestone, 47242,
iast (45.011 ms) : 44620, 45403
.   : milestone, 45011,
profiling (49.284 ms) : 48790, 49779
.   : milestone, 49284,
tracing (43.664 ms) : 43300, 44028
.   : milestone, 43664,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	38.297 ms [37.984 ms, 38.61 ms]	-
appsec	50.2 ms [49.748 ms, 50.653 ms]	11.903 ms (31.1%)
code_origins	44.627 ms [44.226 ms, 45.028 ms]	6.331 ms (16.5%)
iast	44.346 ms [43.955 ms, 44.738 ms]	6.05 ms (15.8%)
profiling	46.198 ms [45.759 ms, 46.636 ms]	7.901 ms (20.6%)
tracing	45.657 ms [45.272 ms, 46.043 ms]	7.361 ms (19.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.508 ms [36.213 ms, 36.803 ms]	-
appsec	49.867 ms [49.434 ms, 50.3 ms]	13.359 ms (36.6%)
code_origins	47.242 ms [46.825 ms, 47.659 ms]	10.733 ms (29.4%)
iast	45.011 ms [44.62 ms, 45.403 ms]	8.503 ms (23.3%)
profiling	49.284 ms [48.79 ms, 49.779 ms]	12.776 ms (35.0%)
tracing	43.664 ms [43.3 ms, 44.028 ms]	7.156 ms (19.6%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/apache-http-5-flaky-tests
git_commit_date	1755193125	1755198645
git_commit_sha	`fa0bdff`	`a1fae6a`
release_version	1.53.0-SNAPSHOT~fa0bdff580	1.53.0-SNAPSHOT~a1fae6ac4f

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1755200719	1755200719
ci_job_id	1081403371	1081403371
ci_pipeline_id	73731233	73731233
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-jps3tut9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-jps3tut9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~a1fae6ac4f, baseline=1.53.0-SNAPSHOT~fa0bdff580
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (3.668 ms) : 3446, 3890
.   : milestone, 3668,
iast (2.198 ms) : 2134, 2261
.   : milestone, 2198,
iast_GLOBAL (2.237 ms) : 2174, 2301
.   : milestone, 2237,
profiling (2.479 ms) : 2311, 2648
.   : milestone, 2479,
tracing (2.022 ms) : 1972, 2072
.   : milestone, 2022,
section candidate
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (3.654 ms) : 3438, 3871
.   : milestone, 3654,
iast (2.202 ms) : 2139, 2265
.   : milestone, 2202,
iast_GLOBAL (2.248 ms) : 2185, 2312
.   : milestone, 2248,
profiling (2.046 ms) : 1994, 2097
.   : milestone, 2046,
tracing (2.017 ms) : 1968, 2066
.   : milestone, 2017,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.463 ms, 1.486 ms]	-
appsec	3.668 ms [3.446 ms, 3.89 ms]	2.194 ms (148.8%)
iast	2.198 ms [2.134 ms, 2.261 ms]	723.33 µs (49.1%)
iast_GLOBAL	2.237 ms [2.174 ms, 2.301 ms]	763.042 µs (51.8%)
profiling	2.479 ms [2.311 ms, 2.648 ms]	1.005 ms (68.2%)
tracing	2.022 ms [1.972 ms, 2.072 ms]	547.612 µs (37.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.463 ms, 1.486 ms]	-
appsec	3.654 ms [3.438 ms, 3.871 ms]	2.18 ms (147.8%)
iast	2.202 ms [2.139 ms, 2.265 ms]	727.43 µs (49.3%)
iast_GLOBAL	2.248 ms [2.185 ms, 2.312 ms]	773.974 µs (52.5%)
profiling	2.046 ms [1.994 ms, 2.097 ms]	571.267 µs (38.7%)
tracing	2.017 ms [1.968 ms, 2.066 ms]	542.629 µs (36.8%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~a1fae6ac4f, baseline=1.53.0-SNAPSHOT~fa0bdff580
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.917 s) : 14917000, 14917000
.   : milestone, 14917000,
appsec (15.008 s) : 15008000, 15008000
.   : milestone, 15008000,
iast (18.116 s) : 18116000, 18116000
.   : milestone, 18116000,
iast_GLOBAL (17.942 s) : 17942000, 17942000
.   : milestone, 17942000,
profiling (15.465 s) : 15465000, 15465000
.   : milestone, 15465000,
tracing (15.092 s) : 15092000, 15092000
.   : milestone, 15092000,
section candidate
no_agent (14.726 s) : 14726000, 14726000
.   : milestone, 14726000,
appsec (15.064 s) : 15064000, 15064000
.   : milestone, 15064000,
iast (17.947 s) : 17947000, 17947000
.   : milestone, 17947000,
iast_GLOBAL (17.933 s) : 17933000, 17933000
.   : milestone, 17933000,
profiling (15.325 s) : 15325000, 15325000
.   : milestone, 15325000,
tracing (15.06 s) : 15060000, 15060000
.   : milestone, 15060000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.917 s [14.917 s, 14.917 s]	-
appsec	15.008 s [15.008 s, 15.008 s]	91.0 ms (0.6%)
iast	18.116 s [18.116 s, 18.116 s]	3.199 s (21.4%)
iast_GLOBAL	17.942 s [17.942 s, 17.942 s]	3.025 s (20.3%)
profiling	15.465 s [15.465 s, 15.465 s]	548.0 ms (3.7%)
tracing	15.092 s [15.092 s, 15.092 s]	175.0 ms (1.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.726 s [14.726 s, 14.726 s]	-
appsec	15.064 s [15.064 s, 15.064 s]	338.0 ms (2.3%)
iast	17.947 s [17.947 s, 17.947 s]	3.221 s (21.9%)
iast_GLOBAL	17.933 s [17.933 s, 17.933 s]	3.207 s (21.8%)
profiling	15.325 s [15.325 s, 15.325 s]	599.0 ms (4.1%)
tracing	15.06 s [15.06 s, 15.06 s]	334.0 ms (2.3%)

datadog-official · 2025-08-14T19:52:19Z

Code coverage: total 53.54%, base diff -3.77%, patch 100.00% (view details)

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: a1fae6a | Docs | Was this helpful? Give us feedback!}

Updated flaky tests.

a1fae6a

AlexeyKuznetsov-DD self-assigned this Aug 14, 2025

AlexeyKuznetsov-DD added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Aug 14, 2025

AlexeyKuznetsov-DD marked this pull request as ready for review August 14, 2025 19:16

AlexeyKuznetsov-DD requested a review from a team as a code owner August 14, 2025 19:16

AlexeyKuznetsov-DD requested review from PerfectSlayer, bric3, manuel-alvarez-alvarez and sarahchen6 August 14, 2025 19:16

sarahchen6 approved these changes Aug 14, 2025

View reviewed changes

AlexeyKuznetsov-DD merged commit 65b2349 into master Aug 14, 2025
1173 of 1181 checks passed

AlexeyKuznetsov-DD deleted the alexeyk/apache-http-5-flaky-tests branch August 14, 2025 23:03

github-actions Bot added this to the 1.53.0 milestone Aug 14, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Updated flaky tests.#9366

Updated flaky tests.#9366
AlexeyKuznetsov-DD merged 1 commit intomasterfrom
alexeyk/apache-http-5-flaky-tests

AlexeyKuznetsov-DD commented Aug 14, 2025

Uh oh!

pr-commenter Bot commented Aug 14, 2025

Uh oh!

datadog-official Bot commented Aug 14, 2025 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

AlexeyKuznetsov-DD commented Aug 14, 2025

What Does This Do

Motivation

Additional Notes

Uh oh!

pr-commenter Bot commented Aug 14, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

datadog-official Bot commented Aug 14, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

datadog-official Bot commented Aug 14, 2025 •

edited

Loading