Fix Flaky SecurityResponseIdSmokeTest by jandro996 · Pull Request #10391 · DataDog/dd-trace-java

jandro996 · 2026-01-16T09:28:03Z

What Does This Do

The main fix is that test 4 now waits for its two traces before finishing. This prevents those traces from leaking into test 5. With that in place

Motivation

test security_response_id is not present in trace when request is not blocked is flaky on master (see dashboard):

Condition not satisfied:
normalSpan != null
|          |
null       false
Root span for /custom-headers endpoint not found in trace. Available spans: [null, null, null]
Condition not satisfied:
normalSpan != null
|          |
null       false
Root span for /custom-headers endpoint not found in trace. Available spans: [null, null, null]
	at datadog.smoketest.appsec.SecurityResponseIdSmokeTest.test security_response_id is not present in trace when request is not blocked(SecurityResponseIdSmokeTest.groovy:317)

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: APPSEC-60650

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 33ea6db7ff

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

pr-commenter · 2026-01-16T10:18:05Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alejandro.gonzalez/security-response-id-flaky-test
git_commit_date	1768498580	1768555355
git_commit_sha	`340e03e`	`33ea6db`
release_version	1.59.0-SNAPSHOT~340e03e23d	1.59.0-SNAPSHOT~33ea6db7ff

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1768557342	1768557342
ci_job_id	1355030583	1355030583
ci_pipeline_id	91043083	91043083
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-49h1uk4i 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-49h1uk4i 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 8 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~33ea6db7ff, baseline=1.59.0-SNAPSHOT~340e03e23d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.088 s) : 0, 1088088
Total [baseline] (10.893 s) : 0, 10892573
Agent [candidate] (1.094 s) : 0, 1094423
Total [candidate] (10.777 s) : 0, 10777490
section appsec
Agent [baseline] (1.267 s) : 0, 1267358
Total [baseline] (11.081 s) : 0, 11081207
Agent [candidate] (1.269 s) : 0, 1268628
Total [candidate] (11.024 s) : 0, 11024459
section iast
Agent [baseline] (1.231 s) : 0, 1231116
Total [baseline] (11.228 s) : 0, 11228152
Agent [candidate] (1.232 s) : 0, 1232443
Total [candidate] (11.256 s) : 0, 11256375
section profiling
Agent [baseline] (1.206 s) : 0, 1205982
Total [baseline] (10.978 s) : 0, 10978421
Agent [candidate] (1.208 s) : 0, 1208382
Total [candidate] (10.901 s) : 0, 10901228

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.088 s	-
Agent	appsec	1.267 s	179.27 ms (16.5%)
Agent	iast	1.231 s	143.028 ms (13.1%)
Agent	profiling	1.206 s	117.894 ms (10.8%)
Total	tracing	10.893 s	-
Total	appsec	11.081 s	188.633 ms (1.7%)
Total	iast	11.228 s	335.578 ms (3.1%)
Total	profiling	10.978 s	85.847 ms (0.8%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.094 s	-
Agent	appsec	1.269 s	174.205 ms (15.9%)
Agent	iast	1.232 s	138.02 ms (12.6%)
Agent	profiling	1.208 s	113.959 ms (10.4%)
Total	tracing	10.777 s	-
Total	appsec	11.024 s	246.969 ms (2.3%)
Total	iast	11.256 s	478.885 ms (4.4%)
Total	profiling	10.901 s	123.738 ms (1.1%)

gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~33ea6db7ff, baseline=1.59.0-SNAPSHOT~340e03e23d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (653.383 ms) : 0, 653383
BytebuddyAgent [candidate] (656.946 ms) : 0, 656946
GlobalTracer [baseline] (283.642 ms) : 0, 283642
GlobalTracer [candidate] (285.122 ms) : 0, 285122
AppSec [baseline] (32.796 ms) : 0, 32796
AppSec [candidate] (32.864 ms) : 0, 32864
Debugger [baseline] (68.071 ms) : 0, 68071
Debugger [candidate] (69.057 ms) : 0, 69057
Remote Config [baseline] (644.107 µs) : 0, 644
Remote Config [candidate] (638.163 µs) : 0, 638
Telemetry [baseline] (8.981 ms) : 0, 8981
Telemetry [candidate] (9.041 ms) : 0, 9041
Flare Poller [baseline] (3.809 ms) : 0, 3809
Flare Poller [candidate] (3.907 ms) : 0, 3907
section appsec
crashtracking [baseline] (1.179 ms) : 0, 1179
crashtracking [candidate] (1.176 ms) : 0, 1176
BytebuddyAgent [baseline] (692.231 ms) : 0, 692231
BytebuddyAgent [candidate] (693.387 ms) : 0, 693387
GlobalTracer [baseline] (258.914 ms) : 0, 258914
GlobalTracer [candidate] (259.161 ms) : 0, 259161
IAST [baseline] (24.615 ms) : 0, 24615
IAST [candidate] (24.79 ms) : 0, 24790
AppSec [baseline] (173.623 ms) : 0, 173623
AppSec [candidate] (174.178 ms) : 0, 174178
Debugger [baseline] (67.57 ms) : 0, 67570
Debugger [candidate] (66.793 ms) : 0, 66793
Remote Config [baseline] (787.931 µs) : 0, 788
Remote Config [candidate] (755.351 µs) : 0, 755
Telemetry [baseline] (9.264 ms) : 0, 9264
Telemetry [candidate] (9.207 ms) : 0, 9207
Flare Poller [baseline] (3.752 ms) : 0, 3752
Flare Poller [candidate] (3.725 ms) : 0, 3725
section iast
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (796.625 ms) : 0, 796625
BytebuddyAgent [candidate] (797.184 ms) : 0, 797184
GlobalTracer [baseline] (257.647 ms) : 0, 257647
GlobalTracer [candidate] (257.938 ms) : 0, 257938
IAST [baseline] (27.09 ms) : 0, 27090
IAST [candidate] (27.162 ms) : 0, 27162
AppSec [baseline] (35.348 ms) : 0, 35348
AppSec [candidate] (34.614 ms) : 0, 34614
Debugger [baseline] (65.03 ms) : 0, 65030
Debugger [candidate] (66.161 ms) : 0, 66161
Remote Config [baseline] (568.556 µs) : 0, 569
Remote Config [candidate] (585.375 µs) : 0, 585
Telemetry [baseline] (8.52 ms) : 0, 8520
Telemetry [candidate] (8.522 ms) : 0, 8522
Flare Poller [baseline] (3.612 ms) : 0, 3612
Flare Poller [candidate] (3.581 ms) : 0, 3581
section profiling
crashtracking [baseline] (1.208 ms) : 0, 1208
crashtracking [candidate] (1.219 ms) : 0, 1219
BytebuddyAgent [baseline] (703.565 ms) : 0, 703565
BytebuddyAgent [candidate] (704.62 ms) : 0, 704620
GlobalTracer [baseline] (221.447 ms) : 0, 221447
GlobalTracer [candidate] (221.616 ms) : 0, 221616
AppSec [baseline] (32.043 ms) : 0, 32043
AppSec [candidate] (32.094 ms) : 0, 32094
Debugger [baseline] (67.859 ms) : 0, 67859
Debugger [candidate] (68.547 ms) : 0, 68547
Remote Config [baseline] (663.411 µs) : 0, 663
Remote Config [candidate] (639.581 µs) : 0, 640
Telemetry [baseline] (8.965 ms) : 0, 8965
Telemetry [candidate] (8.92 ms) : 0, 8920
Flare Poller [baseline] (3.774 ms) : 0, 3774
Flare Poller [candidate] (3.71 ms) : 0, 3710
ProfilingAgent [baseline] (96.632 ms) : 0, 96632
ProfilingAgent [candidate] (97.072 ms) : 0, 97072
Profiling [baseline] (97.209 ms) : 0, 97209
Profiling [candidate] (97.674 ms) : 0, 97674

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~33ea6db7ff, baseline=1.59.0-SNAPSHOT~340e03e23d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.087 s) : 0, 1086931
Total [baseline] (8.771 s) : 0, 8770501
Agent [candidate] (1.086 s) : 0, 1086168
Total [candidate] (8.736 s) : 0, 8735803
section iast
Agent [baseline] (1.231 s) : 0, 1230863
Total [baseline] (9.368 s) : 0, 9367510
Agent [candidate] (1.225 s) : 0, 1225464
Total [candidate] (9.333 s) : 0, 9332972

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.087 s	-
Agent	iast	1.231 s	143.932 ms (13.2%)
Total	tracing	8.771 s	-
Total	iast	9.368 s	597.009 ms (6.8%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.086 s	-
Agent	iast	1.225 s	139.295 ms (12.8%)
Total	tracing	8.736 s	-
Total	iast	9.333 s	597.169 ms (6.8%)

gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~33ea6db7ff, baseline=1.59.0-SNAPSHOT~340e03e23d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.198 ms) : 0, 1198
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (653.244 ms) : 0, 653244
BytebuddyAgent [candidate] (653.109 ms) : 0, 653109
GlobalTracer [baseline] (283.595 ms) : 0, 283595
GlobalTracer [candidate] (283.256 ms) : 0, 283256
AppSec [baseline] (32.892 ms) : 0, 32892
AppSec [candidate] (32.626 ms) : 0, 32626
Debugger [baseline] (67.084 ms) : 0, 67084
Debugger [candidate] (67.117 ms) : 0, 67117
Remote Config [baseline] (646.953 µs) : 0, 647
Remote Config [candidate] (642.165 µs) : 0, 642
Telemetry [baseline] (8.976 ms) : 0, 8976
Telemetry [candidate] (8.841 ms) : 0, 8841
Flare Poller [baseline] (3.815 ms) : 0, 3815
Flare Poller [candidate] (3.818 ms) : 0, 3818
section iast
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (796.116 ms) : 0, 796116
BytebuddyAgent [candidate] (792.841 ms) : 0, 792841
GlobalTracer [baseline] (258.125 ms) : 0, 258125
GlobalTracer [candidate] (257.583 ms) : 0, 257583
IAST [baseline] (27.195 ms) : 0, 27195
IAST [candidate] (27.052 ms) : 0, 27052
AppSec [baseline] (32.914 ms) : 0, 32914
AppSec [candidate] (33.493 ms) : 0, 33493
Debugger [baseline] (67.168 ms) : 0, 67168
Debugger [candidate] (65.396 ms) : 0, 65396
Remote Config [baseline] (569.378 µs) : 0, 569
Remote Config [candidate] (590.491 µs) : 0, 590
Telemetry [baseline] (8.539 ms) : 0, 8539
Telemetry [candidate] (8.466 ms) : 0, 8466
Flare Poller [baseline] (3.602 ms) : 0, 3602
Flare Poller [candidate] (3.537 ms) : 0, 3537

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alejandro.gonzalez/security-response-id-flaky-test
git_commit_date	1768498580	1768555355
git_commit_sha	`340e03e`	`33ea6db`
release_version	1.59.0-SNAPSHOT~340e03e23d	1.59.0-SNAPSHOT~33ea6db7ff

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1768557968	1768557968
ci_job_id	1355030584	1355030584
ci_pipeline_id	91043083	91043083
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-fmvzgepy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-fmvzgepy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 17 metrics, 17 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load	worse [+201.961µs; +515.897µs] or [+4.051%; +10.349%]	worse [+0.681ms; +1.516ms] or [+5.723%; +12.741%]	unstable [-136.778op/s; +30.090op/s] or [-16.699%; +3.674%]	5.344ms	12.996ms	765.750op/s	4.985ms	11.898ms	819.094op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~33ea6db7ff, baseline=1.59.0-SNAPSHOT~340e03e23d
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.144 ms) : 17960, 18327
.   : milestone, 18144,
appsec (19.685 ms) : 19481, 19888
.   : milestone, 19685,
code_origins (17.575 ms) : 17400, 17750
.   : milestone, 17575,
iast (17.344 ms) : 17171, 17518
.   : milestone, 17344,
profiling (19.376 ms) : 19180, 19571
.   : milestone, 19376,
tracing (18.425 ms) : 18241, 18609
.   : milestone, 18425,
section candidate
no_agent (18.185 ms) : 17997, 18373
.   : milestone, 18185,
appsec (19.73 ms) : 19528, 19932
.   : milestone, 19730,
code_origins (17.735 ms) : 17555, 17914
.   : milestone, 17735,
iast (17.739 ms) : 17563, 17916
.   : milestone, 17739,
profiling (18.738 ms) : 18551, 18926
.   : milestone, 18738,
tracing (17.784 ms) : 17607, 17960
.   : milestone, 17784,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.144 ms [17.96 ms, 18.327 ms]	-
appsec	19.685 ms [19.481 ms, 19.888 ms]	1.541 ms (8.5%)
code_origins	17.575 ms [17.4 ms, 17.75 ms]	-568.59 µs (-3.1%)
iast	17.344 ms [17.171 ms, 17.518 ms]	-799.564 µs (-4.4%)
profiling	19.376 ms [19.18 ms, 19.571 ms]	1.232 ms (6.8%)
tracing	18.425 ms [18.241 ms, 18.609 ms]	280.783 µs (1.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.185 ms [17.997 ms, 18.373 ms]	-
appsec	19.73 ms [19.528 ms, 19.932 ms]	1.545 ms (8.5%)
code_origins	17.735 ms [17.555 ms, 17.914 ms]	-450.532 µs (-2.5%)
iast	17.739 ms [17.563 ms, 17.916 ms]	-445.822 µs (-2.5%)
profiling	18.738 ms [18.551 ms, 18.926 ms]	553.165 µs (3.0%)
tracing	17.784 ms [17.607 ms, 17.96 ms]	-401.775 µs (-2.2%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~33ea6db7ff, baseline=1.59.0-SNAPSHOT~340e03e23d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.173 ms) : 1162, 1185
.   : milestone, 1173,
iast (3.1 ms) : 3062, 3138
.   : milestone, 3100,
iast_FULL (5.644 ms) : 5589, 5700
.   : milestone, 5644,
iast_GLOBAL (3.472 ms) : 3421, 3522
.   : milestone, 3472,
profiling (1.907 ms) : 1891, 1924
.   : milestone, 1907,
tracing (1.806 ms) : 1789, 1823
.   : milestone, 1806,
section candidate
no_agent (1.196 ms) : 1184, 1209
.   : milestone, 1196,
iast (3.083 ms) : 3046, 3121
.   : milestone, 3083,
iast_FULL (6.042 ms) : 5981, 6104
.   : milestone, 6042,
iast_GLOBAL (3.503 ms) : 3452, 3553
.   : milestone, 3503,
profiling (1.961 ms) : 1945, 1978
.   : milestone, 1961,
tracing (1.79 ms) : 1774, 1805
.   : milestone, 1790,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.173 ms [1.162 ms, 1.185 ms]	-
iast	3.1 ms [3.062 ms, 3.138 ms]	1.927 ms (164.2%)
iast_FULL	5.644 ms [5.589 ms, 5.7 ms]	4.471 ms (381.0%)
iast_GLOBAL	3.472 ms [3.421 ms, 3.522 ms]	2.298 ms (195.9%)
profiling	1.907 ms [1.891 ms, 1.924 ms]	733.896 µs (62.5%)
tracing	1.806 ms [1.789 ms, 1.823 ms]	632.587 µs (53.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.196 ms [1.184 ms, 1.209 ms]	-
iast	3.083 ms [3.046 ms, 3.121 ms]	1.887 ms (157.7%)
iast_FULL	6.042 ms [5.981 ms, 6.104 ms]	4.846 ms (405.0%)
iast_GLOBAL	3.503 ms [3.452 ms, 3.553 ms]	2.306 ms (192.8%)
profiling	1.961 ms [1.945 ms, 1.978 ms]	764.83 µs (63.9%)
tracing	1.79 ms [1.774 ms, 1.805 ms]	593.345 µs (49.6%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alejandro.gonzalez/security-response-id-flaky-test
git_commit_date	1768498580	1768555355
git_commit_sha	`340e03e`	`33ea6db`
release_version	1.59.0-SNAPSHOT~340e03e23d	1.59.0-SNAPSHOT~33ea6db7ff

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1768557567	1768557567
ci_job_id	1355030585	1355030585
ci_pipeline_id	91043083	91043083
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-5eg3poe0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-5eg3poe0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~33ea6db7ff, baseline=1.59.0-SNAPSHOT~340e03e23d
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.018 s) : 15018000, 15018000
.   : milestone, 15018000,
appsec (15.011 s) : 15011000, 15011000
.   : milestone, 15011000,
iast (18.026 s) : 18026000, 18026000
.   : milestone, 18026000,
iast_GLOBAL (18.008 s) : 18008000, 18008000
.   : milestone, 18008000,
profiling (14.737 s) : 14737000, 14737000
.   : milestone, 14737000,
tracing (15.385 s) : 15385000, 15385000
.   : milestone, 15385000,
section candidate
no_agent (15.718 s) : 15718000, 15718000
.   : milestone, 15718000,
appsec (15.056 s) : 15056000, 15056000
.   : milestone, 15056000,
iast (18.379 s) : 18379000, 18379000
.   : milestone, 18379000,
iast_GLOBAL (17.802 s) : 17802000, 17802000
.   : milestone, 17802000,
profiling (15.004 s) : 15004000, 15004000
.   : milestone, 15004000,
tracing (14.833 s) : 14833000, 14833000
.   : milestone, 14833000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.018 s [15.018 s, 15.018 s]	-
appsec	15.011 s [15.011 s, 15.011 s]	-7.0 ms (-0.0%)
iast	18.026 s [18.026 s, 18.026 s]	3.008 s (20.0%)
iast_GLOBAL	18.008 s [18.008 s, 18.008 s]	2.99 s (19.9%)
profiling	14.737 s [14.737 s, 14.737 s]	-281.0 ms (-1.9%)
tracing	15.385 s [15.385 s, 15.385 s]	367.0 ms (2.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.718 s [15.718 s, 15.718 s]	-
appsec	15.056 s [15.056 s, 15.056 s]	-662.0 ms (-4.2%)
iast	18.379 s [18.379 s, 18.379 s]	2.661 s (16.9%)
iast_GLOBAL	17.802 s [17.802 s, 17.802 s]	2.084 s (13.3%)
profiling	15.004 s [15.004 s, 15.004 s]	-714.0 ms (-4.5%)
tracing	14.833 s [14.833 s, 14.833 s]	-885.0 ms (-5.6%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~33ea6db7ff, baseline=1.59.0-SNAPSHOT~340e03e23d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (2.472 ms) : 2420, 2524
.   : milestone, 2472,
iast (2.217 ms) : 2151, 2282
.   : milestone, 2217,
iast_GLOBAL (2.253 ms) : 2188, 2318
.   : milestone, 2253,
profiling (2.056 ms) : 2004, 2109
.   : milestone, 2056,
tracing (2.05 ms) : 1999, 2102
.   : milestone, 2050,
section candidate
no_agent (1.479 ms) : 1467, 1490
.   : milestone, 1479,
appsec (3.733 ms) : 3514, 3953
.   : milestone, 3733,
iast (2.212 ms) : 2147, 2277
.   : milestone, 2212,
iast_GLOBAL (2.261 ms) : 2196, 2327
.   : milestone, 2261,
profiling (2.09 ms) : 2035, 2144
.   : milestone, 2090,
tracing (2.044 ms) : 1993, 2095
.   : milestone, 2044,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.473 ms [1.461 ms, 1.484 ms]	-
appsec	2.472 ms [2.42 ms, 2.524 ms]	999.445 µs (67.9%)
iast	2.217 ms [2.151 ms, 2.282 ms]	744.189 µs (50.5%)
iast_GLOBAL	2.253 ms [2.188 ms, 2.318 ms]	780.387 µs (53.0%)
profiling	2.056 ms [2.004 ms, 2.109 ms]	583.878 µs (39.6%)
tracing	2.05 ms [1.999 ms, 2.102 ms]	577.81 µs (39.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.479 ms [1.467 ms, 1.49 ms]	-
appsec	3.733 ms [3.514 ms, 3.953 ms]	2.254 ms (152.4%)
iast	2.212 ms [2.147 ms, 2.277 ms]	733.05 µs (49.6%)
iast_GLOBAL	2.261 ms [2.196 ms, 2.327 ms]	782.491 µs (52.9%)
profiling	2.09 ms [2.035 ms, 2.144 ms]	610.736 µs (41.3%)
tracing	2.044 ms [1.993 ms, 2.095 ms]	565.118 µs (38.2%)

daniel-romano-DD

TY!

WIP

33ea6db

jandro996 added this to the 1.59.0 milestone Jan 16, 2026

jandro996 requested a review from AlexeyKuznetsov-DD January 16, 2026 09:28

jandro996 requested a review from a team as a code owner January 16, 2026 09:28

jandro996 requested a review from manuel-alvarez-alvarez January 16, 2026 09:28

jandro996 added the type: bug Bug report and fix label Jan 16, 2026

jandro996 requested a review from claponcet January 16, 2026 09:28

jandro996 added tag: no release notes Changes to exclude from release notes comp: asm waf Application Security Management (WAF) labels Jan 16, 2026

chatgpt-codex-connector Bot reviewed Jan 16, 2026

View reviewed changes

Comment thread ...ppsec/springboot/src/test/groovy/datadog/smoketest/appsec/SecurityResponseIdSmokeTest.groovy

jandro996 enabled auto-merge (squash) January 16, 2026 11:33

PerfectSlayer added the tag: flaky test Flaky tests label Jan 16, 2026

jandro996 requested a review from daniel-romano-DD January 16, 2026 13:22

daniel-romano-DD approved these changes Jan 16, 2026

View reviewed changes

jandro996 merged commit a08b93a into master Jan 16, 2026
578 of 580 checks passed

jandro996 deleted the alejandro.gonzalez/security-response-id-flaky-test branch January 16, 2026 13:50

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Fix Flaky SecurityResponseIdSmokeTest#10391

Fix Flaky SecurityResponseIdSmokeTest#10391
jandro996 merged 1 commit intomasterfrom
alejandro.gonzalez/security-response-id-flaky-test

jandro996 commented Jan 16, 2026 •

edited by atlassian Bot

Loading

Uh oh!

chatgpt-codex-connector Bot left a comment

Uh oh!

Uh oh!

pr-commenter Bot commented Jan 16, 2026

Uh oh!

daniel-romano-DD left a comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

jandro996 commented Jan 16, 2026 • edited by atlassian Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

pr-commenter Bot commented Jan 16, 2026

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

daniel-romano-DD left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

jandro996 commented Jan 16, 2026 •

edited by atlassian Bot

Loading