Update CI Visibility test fixtures by nikita-tkachenko-datadog · Pull Request #8266 · DataDog/dd-trace-java

nikita-tkachenko-datadog · 2025-01-22T10:05:20Z

What Does This Do

Updates CI Visibility test fixtures:

JSON fields are now ordered alphabetically
some previously missing fields are added (source data and codeowners for test suites, thread ID and VCPU count for every CI Vis span)

Motivation

Future updates to the test fixtures will be easier to review, as fields order is now fixed.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-01-22T10:43:43Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/update-ci-vis-test-fixtures
git_commit_date	1737541621	1737545252
git_commit_sha	`3900e56`	`7ce319a`
release_version	1.46.0-SNAPSHOT~3900e56b15	1.46.0-SNAPSHOT~7ce319acfa

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1737547702	1737547702
ci_job_id	775602103	775602103
ci_pipeline_id	53665569	53665569
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 4 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~7ce319acfa, baseline=1.46.0-SNAPSHOT~3900e56b15

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1058445
Total [baseline] (8.603 s) : 0, 8602687
Agent [candidate] (1.054 s) : 0, 1054380
Total [candidate] (8.63 s) : 0, 8630260
section iast
Agent [baseline] (1.183 s) : 0, 1182918
Total [baseline] (9.195 s) : 0, 9195161
Agent [candidate] (1.184 s) : 0, 1184184
Total [candidate] (9.183 s) : 0, 9183233
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.183 s) : 0, 1183128
Total [baseline] (9.151 s) : 0, 9151191
Agent [candidate] (1.192 s) : 0, 1192286
Total [candidate] (9.17 s) : 0, 9169515
section iast_TELEMETRY_OFF
Agent [baseline] (1.187 s) : 0, 1186913
Total [baseline] (9.229 s) : 0, 9229253
Agent [candidate] (1.18 s) : 0, 1179861
Total [candidate] (9.183 s) : 0, 9182761

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.058 s	-
Agent	iast	1.183 s	124.473 ms (11.8%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.183 s	124.682 ms (11.8%)
Agent	iast_TELEMETRY_OFF	1.187 s	128.468 ms (12.1%)
Total	tracing	8.603 s	-
Total	iast	9.195 s	592.474 ms (6.9%)
Total	iast_HARDCODED_SECRET_DISABLED	9.151 s	548.503 ms (6.4%)
Total	iast_TELEMETRY_OFF	9.229 s	626.566 ms (7.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.054 s	-
Agent	iast	1.184 s	129.804 ms (12.3%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.192 s	137.906 ms (13.1%)
Agent	iast_TELEMETRY_OFF	1.18 s	125.481 ms (11.9%)
Total	tracing	8.63 s	-
Total	iast	9.183 s	552.974 ms (6.4%)
Total	iast_HARDCODED_SECRET_DISABLED	9.17 s	539.255 ms (6.2%)
Total	iast_TELEMETRY_OFF	9.183 s	552.502 ms (6.4%)

gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~7ce319acfa, baseline=1.46.0-SNAPSHOT~3900e56b15

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (715.773 ms) : 0, 715773
BytebuddyAgent [candidate] (713.89 ms) : 0, 713890
GlobalTracer [baseline] (255.959 ms) : 0, 255959
GlobalTracer [candidate] (255.282 ms) : 0, 255282
AppSec [baseline] (56.671 ms) : 0, 56671
AppSec [candidate] (55.391 ms) : 0, 55391
Remote Config [baseline] (753.773 µs) : 0, 754
Remote Config [candidate] (731.979 µs) : 0, 732
Telemetry [baseline] (14.319 ms) : 0, 14319
Telemetry [candidate] (14.17 ms) : 0, 14170
section iast
BytebuddyAgent [baseline] (832.318 ms) : 0, 832318
BytebuddyAgent [candidate] (832.919 ms) : 0, 832919
GlobalTracer [baseline] (246.543 ms) : 0, 246543
GlobalTracer [candidate] (247.075 ms) : 0, 247075
AppSec [baseline] (58.021 ms) : 0, 58021
AppSec [candidate] (58.168 ms) : 0, 58168
Remote Config [baseline] (656.596 µs) : 0, 657
Remote Config [candidate] (671.423 µs) : 0, 671
Telemetry [baseline] (8.725 ms) : 0, 8725
Telemetry [candidate] (8.784 ms) : 0, 8784
IAST [baseline] (21.625 ms) : 0, 21625
IAST [candidate] (21.546 ms) : 0, 21546
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (832.473 ms) : 0, 832473
BytebuddyAgent [candidate] (839.237 ms) : 0, 839237
GlobalTracer [baseline] (246.498 ms) : 0, 246498
GlobalTracer [candidate] (248.386 ms) : 0, 248386
AppSec [baseline] (58.074 ms) : 0, 58074
AppSec [candidate] (58.264 ms) : 0, 58264
Remote Config [baseline] (657.795 µs) : 0, 658
Remote Config [candidate] (663.374 µs) : 0, 663
Telemetry [baseline] (8.81 ms) : 0, 8810
Telemetry [candidate] (8.918 ms) : 0, 8918
IAST [baseline] (21.594 ms) : 0, 21594
IAST [candidate] (21.614 ms) : 0, 21614
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (835.625 ms) : 0, 835625
BytebuddyAgent [candidate] (829.773 ms) : 0, 829773
GlobalTracer [baseline] (247.686 ms) : 0, 247686
GlobalTracer [candidate] (246.935 ms) : 0, 246935
AppSec [baseline] (58.058 ms) : 0, 58058
AppSec [candidate] (58.032 ms) : 0, 58032
Remote Config [baseline] (692.309 µs) : 0, 692
Remote Config [candidate] (649.151 µs) : 0, 649
Telemetry [baseline] (8.673 ms) : 0, 8673
Telemetry [candidate] (8.658 ms) : 0, 8658
IAST [baseline] (21.06 ms) : 0, 21060
IAST [candidate] (20.847 ms) : 0, 20847

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~7ce319acfa, baseline=1.46.0-SNAPSHOT~3900e56b15

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1059089
Total [baseline] (10.416 s) : 0, 10415980
Agent [candidate] (1.073 s) : 0, 1073134
Total [candidate] (10.473 s) : 0, 10473199
section appsec
Agent [baseline] (1.198 s) : 0, 1198074
Total [baseline] (10.797 s) : 0, 10796703
Agent [candidate] (1.195 s) : 0, 1194787
Total [candidate] (10.72 s) : 0, 10720325
section iast
Agent [baseline] (1.183 s) : 0, 1183364
Total [baseline] (11.054 s) : 0, 11054282
Agent [candidate] (1.193 s) : 0, 1192755
Total [candidate] (10.984 s) : 0, 10984218
section profiling
Agent [baseline] (1.256 s) : 0, 1256215
Total [baseline] (10.809 s) : 0, 10809388
Agent [candidate] (1.255 s) : 0, 1255000
Total [candidate] (10.777 s) : 0, 10777444

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.059 s	-
Agent	appsec	1.198 s	138.985 ms (13.1%)
Agent	iast	1.183 s	124.274 ms (11.7%)
Agent	profiling	1.256 s	197.126 ms (18.6%)
Total	tracing	10.416 s	-
Total	appsec	10.797 s	380.723 ms (3.7%)
Total	iast	11.054 s	638.302 ms (6.1%)
Total	profiling	10.809 s	393.407 ms (3.8%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.073 s	-
Agent	appsec	1.195 s	121.653 ms (11.3%)
Agent	iast	1.193 s	119.621 ms (11.1%)
Agent	profiling	1.255 s	181.867 ms (16.9%)
Total	tracing	10.473 s	-
Total	appsec	10.72 s	247.126 ms (2.4%)
Total	iast	10.984 s	511.019 ms (4.9%)
Total	profiling	10.777 s	304.245 ms (2.9%)

gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~7ce319acfa, baseline=1.46.0-SNAPSHOT~3900e56b15

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.545 ms) : 0, 717545
BytebuddyAgent [candidate] (727.245 ms) : 0, 727245
GlobalTracer [baseline] (255.567 ms) : 0, 255567
GlobalTracer [candidate] (258.553 ms) : 0, 258553
AppSec [baseline] (56.812 ms) : 0, 56812
AppSec [candidate] (56.193 ms) : 0, 56193
Remote Config [baseline] (737.132 µs) : 0, 737
Remote Config [candidate] (743.651 µs) : 0, 744
Telemetry [baseline] (13.442 ms) : 0, 13442
Telemetry [candidate] (15.002 ms) : 0, 15002
section appsec
BytebuddyAgent [baseline] (738.176 ms) : 0, 738176
BytebuddyAgent [candidate] (734.374 ms) : 0, 734374
GlobalTracer [baseline] (255.28 ms) : 0, 255280
GlobalTracer [candidate] (255.003 ms) : 0, 255003
AppSec [baseline] (170.66 ms) : 0, 170660
AppSec [candidate] (171.607 ms) : 0, 171607
Remote Config [baseline] (673.76 µs) : 0, 674
Remote Config [candidate] (670.101 µs) : 0, 670
Telemetry [baseline] (8.5 ms) : 0, 8500
Telemetry [candidate] (8.28 ms) : 0, 8280
IAST [baseline] (19.469 ms) : 0, 19469
IAST [candidate] (19.65 ms) : 0, 19650
section iast
BytebuddyAgent [baseline] (832.823 ms) : 0, 832823
BytebuddyAgent [candidate] (839.186 ms) : 0, 839186
GlobalTracer [baseline] (246.701 ms) : 0, 246701
GlobalTracer [candidate] (248.533 ms) : 0, 248533
AppSec [baseline] (57.98 ms) : 0, 57980
AppSec [candidate] (58.512 ms) : 0, 58512
Remote Config [baseline] (661.394 µs) : 0, 661
Remote Config [candidate] (679.524 µs) : 0, 680
Telemetry [baseline] (8.785 ms) : 0, 8785
Telemetry [candidate] (8.943 ms) : 0, 8943
IAST [baseline] (21.45 ms) : 0, 21450
IAST [candidate] (21.832 ms) : 0, 21832
section profiling
BytebuddyAgent [baseline] (704.454 ms) : 0, 704454
BytebuddyAgent [candidate] (704.508 ms) : 0, 704508
GlobalTracer [baseline] (349.699 ms) : 0, 349699
GlobalTracer [candidate] (349.57 ms) : 0, 349570
AppSec [baseline] (54.897 ms) : 0, 54897
AppSec [candidate] (53.978 ms) : 0, 53978
Remote Config [baseline] (715.524 µs) : 0, 716
Remote Config [candidate] (716.801 µs) : 0, 717
Telemetry [baseline] (8.802 ms) : 0, 8802
Telemetry [candidate] (8.812 ms) : 0, 8812
ProfilingAgent [baseline] (95.544 ms) : 0, 95544
ProfilingAgent [candidate] (95.458 ms) : 0, 95458
Profiling [baseline] (95.57 ms) : 0, 95570
Profiling [candidate] (95.485 ms) : 0, 95485

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-01-22T11:38:29	2025-01-22T11:45:34
git_branch	master	nikita-tkachenko/update-ci-vis-test-fixtures
git_commit_date	1737541621	1737545252
git_commit_sha	`3900e56`	`7ce319a`
release_version	1.46.0-SNAPSHOT~3900e56b15	1.46.0-SNAPSHOT~7ce319acfa
start_time	2025-01-22T11:38:15	2025-01-22T11:45:20

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1737546693	1737546693
ci_job_id	775602104	775602104
ci_pipeline_id	53665569	53665569
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~7ce319acfa, baseline=1.46.0-SNAPSHOT~3900e56b15
    dateFormat X
    axisFormat %s
section baseline
no_agent (378.494 µs) : 358, 399
.   : milestone, 378,
iast (504.114 µs) : 482, 526
.   : milestone, 504,
iast_FULL (744.145 µs) : 722, 766
.   : milestone, 744,
iast_GLOBAL (549.434 µs) : 528, 571
.   : milestone, 549,
iast_HARDCODED_SECRET_DISABLED (508.84 µs) : 487, 531
.   : milestone, 509,
iast_INACTIVE (458.047 µs) : 437, 479
.   : milestone, 458,
iast_TELEMETRY_OFF (498.385 µs) : 477, 520
.   : milestone, 498,
tracing (460.619 µs) : 439, 482
.   : milestone, 461,
section candidate
no_agent (382.991 µs) : 363, 403
.   : milestone, 383,
iast (510.234 µs) : 489, 532
.   : milestone, 510,
iast_FULL (738.813 µs) : 717, 761
.   : milestone, 739,
iast_GLOBAL (550.448 µs) : 528, 573
.   : milestone, 550,
iast_HARDCODED_SECRET_DISABLED (510.405 µs) : 488, 533
.   : milestone, 510,
iast_INACTIVE (460.464 µs) : 439, 482
.   : milestone, 460,
iast_TELEMETRY_OFF (497.281 µs) : 475, 519
.   : milestone, 497,
tracing (455.937 µs) : 435, 477
.   : milestone, 456,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	378.494 µs [358.329 µs, 398.658 µs]	-
iast	504.114 µs [482.388 µs, 525.84 µs]	125.621 µs (33.2%)
iast_FULL	744.145 µs [722.036 µs, 766.255 µs]	365.652 µs (96.6%)
iast_GLOBAL	549.434 µs [527.931 µs, 570.938 µs]	170.941 µs (45.2%)
iast_HARDCODED_SECRET_DISABLED	508.84 µs [487.173 µs, 530.508 µs]	130.347 µs (34.4%)
iast_INACTIVE	458.047 µs [436.959 µs, 479.135 µs]	79.554 µs (21.0%)
iast_TELEMETRY_OFF	498.385 µs [476.587 µs, 520.183 µs]	119.891 µs (31.7%)
tracing	460.619 µs [438.964 µs, 482.275 µs]	82.126 µs (21.7%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	382.991 µs [362.798 µs, 403.184 µs]	-
iast	510.234 µs [488.717 µs, 531.751 µs]	127.243 µs (33.2%)
iast_FULL	738.813 µs [717.119 µs, 760.507 µs]	355.822 µs (92.9%)
iast_GLOBAL	550.448 µs [528.098 µs, 572.798 µs]	167.457 µs (43.7%)
iast_HARDCODED_SECRET_DISABLED	510.405 µs [488.171 µs, 532.639 µs]	127.414 µs (33.3%)
iast_INACTIVE	460.464 µs [438.721 µs, 482.207 µs]	77.473 µs (20.2%)
iast_TELEMETRY_OFF	497.281 µs [475.271 µs, 519.292 µs]	114.29 µs (29.8%)
tracing	455.937 µs [434.791 µs, 477.083 µs]	72.946 µs (19.0%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~7ce319acfa, baseline=1.46.0-SNAPSHOT~3900e56b15
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.369 ms) : 1350, 1388
.   : milestone, 1369,
appsec (1.752 ms) : 1728, 1776
.   : milestone, 1752,
appsec_no_iast (1.76 ms) : 1737, 1783
.   : milestone, 1760,
iast (1.5 ms) : 1476, 1524
.   : milestone, 1500,
profiling (1.562 ms) : 1538, 1587
.   : milestone, 1562,
tracing (1.5 ms) : 1476, 1525
.   : milestone, 1500,
section candidate
no_agent (1.355 ms) : 1336, 1375
.   : milestone, 1355,
appsec (1.746 ms) : 1722, 1769
.   : milestone, 1746,
appsec_no_iast (1.772 ms) : 1748, 1797
.   : milestone, 1772,
iast (1.535 ms) : 1512, 1559
.   : milestone, 1535,
profiling (1.515 ms) : 1493, 1538
.   : milestone, 1515,
tracing (1.473 ms) : 1447, 1498
.   : milestone, 1473,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.369 ms [1.35 ms, 1.388 ms]	-
appsec	1.752 ms [1.728 ms, 1.776 ms]	383.193 µs (28.0%)
appsec_no_iast	1.76 ms [1.737 ms, 1.783 ms]	390.908 µs (28.6%)
iast	1.5 ms [1.476 ms, 1.524 ms]	131.394 µs (9.6%)
profiling	1.562 ms [1.538 ms, 1.587 ms]	193.526 µs (14.1%)
tracing	1.5 ms [1.476 ms, 1.525 ms]	131.281 µs (9.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.355 ms [1.336 ms, 1.375 ms]	-
appsec	1.746 ms [1.722 ms, 1.769 ms]	390.707 µs (28.8%)
appsec_no_iast	1.772 ms [1.748 ms, 1.797 ms]	417.265 µs (30.8%)
iast	1.535 ms [1.512 ms, 1.559 ms]	180.214 µs (13.3%)
profiling	1.515 ms [1.493 ms, 1.538 ms]	160.164 µs (11.8%)
tracing	1.473 ms [1.447 ms, 1.498 ms]	117.442 µs (8.7%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/update-ci-vis-test-fixtures
git_commit_date	1737541621	1737545252
git_commit_sha	`3900e56`	`7ce319a`
release_version	1.46.0-SNAPSHOT~3900e56b15	1.46.0-SNAPSHOT~7ce319acfa

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1737547240	1737547240
ci_job_id	775602105	775602105
ci_pipeline_id	53665569	53665569
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~7ce319acfa, baseline=1.46.0-SNAPSHOT~3900e56b15
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.475 ms) : 1463, 1486
.   : milestone, 1475,
appsec (2.353 ms) : 2310, 2396
.   : milestone, 2353,
iast (2.104 ms) : 2050, 2158
.   : milestone, 2104,
iast_GLOBAL (2.155 ms) : 2100, 2210
.   : milestone, 2155,
profiling (1.977 ms) : 1933, 2020
.   : milestone, 1977,
tracing (1.939 ms) : 1898, 1981
.   : milestone, 1939,
section candidate
no_agent (1.469 ms) : 1458, 1481
.   : milestone, 1469,
appsec (2.359 ms) : 2316, 2402
.   : milestone, 2359,
iast (2.099 ms) : 2045, 2154
.   : milestone, 2099,
iast_GLOBAL (2.145 ms) : 2091, 2200
.   : milestone, 2145,
profiling (2.446 ms) : 2268, 2624
.   : milestone, 2446,
tracing (1.949 ms) : 1907, 1991
.   : milestone, 1949,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.475 ms [1.463 ms, 1.486 ms]	-
appsec	2.353 ms [2.31 ms, 2.396 ms]	878.687 µs (59.6%)
iast	2.104 ms [2.05 ms, 2.158 ms]	629.261 µs (42.7%)
iast_GLOBAL	2.155 ms [2.1 ms, 2.21 ms]	680.02 µs (46.1%)
profiling	1.977 ms [1.933 ms, 2.02 ms]	502.073 µs (34.0%)
tracing	1.939 ms [1.898 ms, 1.981 ms]	464.634 µs (31.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.469 ms [1.458 ms, 1.481 ms]	-
appsec	2.359 ms [2.316 ms, 2.402 ms]	890.032 µs (60.6%)
iast	2.099 ms [2.045 ms, 2.154 ms]	630.183 µs (42.9%)
iast_GLOBAL	2.145 ms [2.091 ms, 2.2 ms]	676.054 µs (46.0%)
profiling	2.446 ms [2.268 ms, 2.624 ms]	976.744 µs (66.5%)
tracing	1.949 ms [1.907 ms, 1.991 ms]	479.958 µs (32.7%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~7ce319acfa, baseline=1.46.0-SNAPSHOT~3900e56b15
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.727 s) : 14727000, 14727000
.   : milestone, 14727000,
appsec (15.026 s) : 15026000, 15026000
.   : milestone, 15026000,
iast (18.628 s) : 18628000, 18628000
.   : milestone, 18628000,
iast_GLOBAL (17.975 s) : 17975000, 17975000
.   : milestone, 17975000,
profiling (15.073 s) : 15073000, 15073000
.   : milestone, 15073000,
tracing (14.927 s) : 14927000, 14927000
.   : milestone, 14927000,
section candidate
no_agent (15.353 s) : 15353000, 15353000
.   : milestone, 15353000,
appsec (15.147 s) : 15147000, 15147000
.   : milestone, 15147000,
iast (19.018 s) : 19018000, 19018000
.   : milestone, 19018000,
iast_GLOBAL (18.093 s) : 18093000, 18093000
.   : milestone, 18093000,
profiling (15.221 s) : 15221000, 15221000
.   : milestone, 15221000,
tracing (14.919 s) : 14919000, 14919000
.   : milestone, 14919000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.727 s [14.727 s, 14.727 s]	-
appsec	15.026 s [15.026 s, 15.026 s]	299.0 ms (2.0%)
iast	18.628 s [18.628 s, 18.628 s]	3.901 s (26.5%)
iast_GLOBAL	17.975 s [17.975 s, 17.975 s]	3.248 s (22.1%)
profiling	15.073 s [15.073 s, 15.073 s]	346.0 ms (2.3%)
tracing	14.927 s [14.927 s, 14.927 s]	200.0 ms (1.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.353 s [15.353 s, 15.353 s]	-
appsec	15.147 s [15.147 s, 15.147 s]	-206.0 ms (-1.3%)
iast	19.018 s [19.018 s, 19.018 s]	3.665 s (23.9%)
iast_GLOBAL	18.093 s [18.093 s, 18.093 s]	2.74 s (17.8%)
profiling	15.221 s [15.221 s, 15.221 s]	-132.0 ms (-0.9%)
tracing	14.919 s [14.919 s, 14.919 s]	-434.0 ms (-2.8%)

nikita-tkachenko-datadog added comp: testing Testing tag: no release notes Changes to exclude from release notes type: refactoring comp: ci visibility Continuous Integration Visibility labels Jan 22, 2025

nikita-tkachenko-datadog force-pushed the nikita-tkachenko/update-ci-vis-test-fixtures branch from e8b503f to 5d5488d Compare January 22, 2025 11:14

Update CI Visibility test fixtures

7ce319a

nikita-tkachenko-datadog force-pushed the nikita-tkachenko/update-ci-vis-test-fixtures branch from 5d5488d to 7ce319a Compare January 22, 2025 11:27

nikita-tkachenko-datadog marked this pull request as ready for review January 22, 2025 12:06

nikita-tkachenko-datadog requested a review from a team as a code owner January 22, 2025 12:06

nikita-tkachenko-datadog requested a review from anmarchenko January 22, 2025 12:06

daniel-mohedano approved these changes Jan 22, 2025

View reviewed changes

nikita-tkachenko-datadog merged commit 523df01 into master Jan 22, 2025

nikita-tkachenko-datadog deleted the nikita-tkachenko/update-ci-vis-test-fixtures branch January 22, 2025 12:21

github-actions Bot added this to the 1.46.0 milestone Jan 22, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update CI Visibility test fixtures#8266

Update CI Visibility test fixtures#8266
nikita-tkachenko-datadog merged 1 commit intomasterfrom
nikita-tkachenko/update-ci-vis-test-fixtures

nikita-tkachenko-datadog commented Jan 22, 2025

Uh oh!

pr-commenter Bot commented Jan 22, 2025 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

nikita-tkachenko-datadog commented Jan 22, 2025

What Does This Do

Motivation

Contributor Checklist

Uh oh!

pr-commenter Bot commented Jan 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

pr-commenter Bot commented Jan 22, 2025 •

edited

Loading