Exclude datadog.trace.api.Config from coverage verification by jandro996 · Pull Request #8454 · DataDog/dd-trace-java

jandro996 · 2025-02-26T13:51:55Z

What Does This Do

Motivation

task ':internal-api:jacocoTestCoverageVerification' is failing due to current datadog.trace.api.Config coverage it's lower than 0.8

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-02-26T14:29:28Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alejandro.gonzalez/exclude-config-coverage
git_commit_date	1740583553	1740587020
git_commit_sha	`9466d95`	`5bebee6`
release_version	1.47.0-SNAPSHOT~9466d9584d	1.47.0-SNAPSHOT~5bebee6f43

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1740589525	1740589525
ci_job_id	824334406	824334406
ci_pipeline_id	57077400	57077400
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-vtotqy1x-project-304-concurrent-2-mqwfwccg 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-vtotqy1x-project-304-concurrent-2-mqwfwccg 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 5 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~5bebee6f43, baseline=1.47.0-SNAPSHOT~9466d9584d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.054 s) : 0, 1053935
Total [baseline] (8.691 s) : 0, 8690579
Agent [candidate] (1.034 s) : 0, 1034277
Total [candidate] (8.666 s) : 0, 8665560
section iast
Agent [baseline] (1.173 s) : 0, 1172758
Total [baseline] (9.267 s) : 0, 9267338
Agent [candidate] (1.174 s) : 0, 1173743
Total [candidate] (9.269 s) : 0, 9269079
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.17 s) : 0, 1169659
Total [baseline] (9.229 s) : 0, 9229380
Agent [candidate] (1.17 s) : 0, 1169946
Total [candidate] (9.228 s) : 0, 9228042
section iast_TELEMETRY_OFF
Agent [baseline] (1.167 s) : 0, 1166837
Total [baseline] (9.227 s) : 0, 9226922
Agent [candidate] (1.174 s) : 0, 1174073
Total [candidate] (9.272 s) : 0, 9271750

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.054 s	-
Agent	iast	1.173 s	118.822 ms (11.3%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.17 s	115.724 ms (11.0%)
Agent	iast_TELEMETRY_OFF	1.167 s	112.901 ms (10.7%)
Total	tracing	8.691 s	-
Total	iast	9.267 s	576.759 ms (6.6%)
Total	iast_HARDCODED_SECRET_DISABLED	9.229 s	538.801 ms (6.2%)
Total	iast_TELEMETRY_OFF	9.227 s	536.343 ms (6.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.034 s	-
Agent	iast	1.174 s	139.466 ms (13.5%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.17 s	135.669 ms (13.1%)
Agent	iast_TELEMETRY_OFF	1.174 s	139.796 ms (13.5%)
Total	tracing	8.666 s	-
Total	iast	9.269 s	603.52 ms (7.0%)
Total	iast_HARDCODED_SECRET_DISABLED	9.228 s	562.483 ms (6.5%)
Total	iast_TELEMETRY_OFF	9.272 s	606.19 ms (7.0%)

gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~5bebee6f43, baseline=1.47.0-SNAPSHOT~9466d9584d

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (728.001 ms) : 0, 728001
BytebuddyAgent [candidate] (714.971 ms) : 0, 714971
GlobalTracer [baseline] (243.163 ms) : 0, 243163
GlobalTracer [candidate] (238.346 ms) : 0, 238346
AppSec [baseline] (56.655 ms) : 0, 56655
AppSec [candidate] (55.407 ms) : 0, 55407
Remote Config [baseline] (712.788 µs) : 0, 713
Remote Config [candidate] (694.743 µs) : 0, 695
Telemetry [baseline] (10.231 ms) : 0, 10231
Telemetry [candidate] (10.012 ms) : 0, 10012
section iast
BytebuddyAgent [baseline] (839.587 ms) : 0, 839587
BytebuddyAgent [candidate] (839.884 ms) : 0, 839884
GlobalTracer [baseline] (228.857 ms) : 0, 228857
GlobalTracer [candidate] (229.768 ms) : 0, 229768
IAST [baseline] (22.911 ms) : 0, 22911
IAST [candidate] (23.539 ms) : 0, 23539
AppSec [baseline] (57.064 ms) : 0, 57064
AppSec [candidate] (56.167 ms) : 0, 56167
Remote Config [baseline] (614.808 µs) : 0, 615
Remote Config [candidate] (611.596 µs) : 0, 612
Telemetry [baseline] (8.683 ms) : 0, 8683
Telemetry [candidate] (8.699 ms) : 0, 8699
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (835.47 ms) : 0, 835470
BytebuddyAgent [candidate] (836.356 ms) : 0, 836356
GlobalTracer [baseline] (229.454 ms) : 0, 229454
GlobalTracer [candidate] (229.84 ms) : 0, 229840
IAST [baseline] (22.998 ms) : 0, 22998
IAST [candidate] (22.679 ms) : 0, 22679
AppSec [baseline] (57.286 ms) : 0, 57286
AppSec [candidate] (56.73 ms) : 0, 56730
Remote Config [baseline] (627.006 µs) : 0, 627
Remote Config [candidate] (605.15 µs) : 0, 605
Telemetry [baseline] (8.858 ms) : 0, 8858
Telemetry [candidate] (8.748 ms) : 0, 8748
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (833.526 ms) : 0, 833526
BytebuddyAgent [candidate] (839.446 ms) : 0, 839446
GlobalTracer [baseline] (229.454 ms) : 0, 229454
GlobalTracer [candidate] (230.366 ms) : 0, 230366
IAST [baseline] (24.792 ms) : 0, 24792
IAST [candidate] (25.689 ms) : 0, 25689
AppSec [baseline] (54.898 ms) : 0, 54898
AppSec [candidate] (54.284 ms) : 0, 54284
Remote Config [baseline] (607.316 µs) : 0, 607
Remote Config [candidate] (613.791 µs) : 0, 614
Telemetry [baseline] (8.624 ms) : 0, 8624
Telemetry [candidate] (8.665 ms) : 0, 8665

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~5bebee6f43, baseline=1.47.0-SNAPSHOT~9466d9584d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.04 s) : 0, 1039684
Total [baseline] (10.41 s) : 0, 10409696
Agent [candidate] (1.046 s) : 0, 1045935
Total [candidate] (10.479 s) : 0, 10478637
section appsec
Agent [baseline] (1.183 s) : 0, 1183055
Total [baseline] (10.766 s) : 0, 10765929
Agent [candidate] (1.183 s) : 0, 1183181
Total [candidate] (10.761 s) : 0, 10761018
section iast
Agent [baseline] (1.171 s) : 0, 1171377
Total [baseline] (10.952 s) : 0, 10952139
Agent [candidate] (1.171 s) : 0, 1171440
Total [candidate] (11.049 s) : 0, 11048608
section profiling
Agent [baseline] (1.277 s) : 0, 1276597
Total [baseline] (10.885 s) : 0, 10885052
Agent [candidate] (1.259 s) : 0, 1259423
Total [candidate] (10.877 s) : 0, 10877045

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.04 s	-
Agent	appsec	1.183 s	143.371 ms (13.8%)
Agent	iast	1.171 s	131.694 ms (12.7%)
Agent	profiling	1.277 s	236.913 ms (22.8%)
Total	tracing	10.41 s	-
Total	appsec	10.766 s	356.233 ms (3.4%)
Total	iast	10.952 s	542.443 ms (5.2%)
Total	profiling	10.885 s	475.356 ms (4.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.046 s	-
Agent	appsec	1.183 s	137.246 ms (13.1%)
Agent	iast	1.171 s	125.505 ms (12.0%)
Agent	profiling	1.259 s	213.488 ms (20.4%)
Total	tracing	10.479 s	-
Total	appsec	10.761 s	282.381 ms (2.7%)
Total	iast	11.049 s	569.971 ms (5.4%)
Total	profiling	10.877 s	398.408 ms (3.8%)

gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~5bebee6f43, baseline=1.47.0-SNAPSHOT~9466d9584d

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (716.381 ms) : 0, 716381
BytebuddyAgent [candidate] (721.142 ms) : 0, 721142
GlobalTracer [baseline] (239.003 ms) : 0, 239003
GlobalTracer [candidate] (240.187 ms) : 0, 240187
AppSec [baseline] (55.731 ms) : 0, 55731
AppSec [candidate] (55.804 ms) : 0, 55804
Remote Config [baseline] (702.947 µs) : 0, 703
Remote Config [candidate] (700.921 µs) : 0, 701
Telemetry [baseline] (12.949 ms) : 0, 12949
Telemetry [candidate] (13.077 ms) : 0, 13077
section appsec
BytebuddyAgent [baseline] (734.74 ms) : 0, 734740
BytebuddyAgent [candidate] (736.507 ms) : 0, 736507
GlobalTracer [baseline] (236.385 ms) : 0, 236385
GlobalTracer [candidate] (235.79 ms) : 0, 235790
AppSec [baseline] (177.276 ms) : 0, 177276
AppSec [candidate] (176.376 ms) : 0, 176376
Remote Config [baseline] (672.087 µs) : 0, 672
Remote Config [candidate] (658.372 µs) : 0, 658
Telemetry [baseline] (8.258 ms) : 0, 8258
Telemetry [candidate] (8.267 ms) : 0, 8267
IAST [baseline] (21.603 ms) : 0, 21603
IAST [candidate] (21.279 ms) : 0, 21279
section iast
BytebuddyAgent [baseline] (837.211 ms) : 0, 837211
BytebuddyAgent [candidate] (837.216 ms) : 0, 837216
GlobalTracer [baseline] (229.798 ms) : 0, 229798
GlobalTracer [candidate] (229.914 ms) : 0, 229914
AppSec [baseline] (57.2 ms) : 0, 57200
AppSec [candidate] (57.251 ms) : 0, 57251
Remote Config [baseline] (618.493 µs) : 0, 618
Remote Config [candidate] (603.71 µs) : 0, 604
Telemetry [baseline] (8.661 ms) : 0, 8661
Telemetry [candidate] (8.723 ms) : 0, 8723
IAST [baseline] (22.853 ms) : 0, 22853
IAST [candidate] (22.725 ms) : 0, 22725
section profiling
BytebuddyAgent [baseline] (717.919 ms) : 0, 717919
BytebuddyAgent [candidate] (708.69 ms) : 0, 708690
GlobalTracer [baseline] (353.372 ms) : 0, 353372
GlobalTracer [candidate] (349.695 ms) : 0, 349695
AppSec [baseline] (56.319 ms) : 0, 56319
AppSec [candidate] (54.765 ms) : 0, 54765
Remote Config [baseline] (682.586 µs) : 0, 683
Remote Config [candidate] (663.054 µs) : 0, 663
Telemetry [baseline] (9.043 ms) : 0, 9043
Telemetry [candidate] (8.999 ms) : 0, 8999
ProfilingAgent [baseline] (98.332 ms) : 0, 98332
ProfilingAgent [candidate] (96.245 ms) : 0, 96245
Profiling [baseline] (98.356 ms) : 0, 98356
Profiling [candidate] (96.268 ms) : 0, 96268

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-02-26T16:35:41	2025-02-26T16:43:26
git_branch	master	alejandro.gonzalez/exclude-config-coverage
git_commit_date	1740583553	1740587020
git_commit_sha	`9466d95`	`5bebee6`
release_version	1.47.0-SNAPSHOT~9466d9584d	1.47.0-SNAPSHOT~5bebee6f43
start_time	2025-02-26T16:35:27	2025-02-26T16:43:12

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1740588604	1740588604
ci_job_id	824334409	824334409
ci_pipeline_id	57077400	57077400
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-gyqeaxyt-project-304-concurrent-0-2x55af6w 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-gyqeaxyt-project-304-concurrent-0-2x55af6w 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~5bebee6f43, baseline=1.47.0-SNAPSHOT~9466d9584d
    dateFormat X
    axisFormat %s
section baseline
no_agent (381.827 µs) : 362, 402
.   : milestone, 382,
iast (509.573 µs) : 488, 531
.   : milestone, 510,
iast_FULL (726.996 µs) : 705, 749
.   : milestone, 727,
iast_GLOBAL (554.104 µs) : 532, 576
.   : milestone, 554,
iast_HARDCODED_SECRET_DISABLED (510.796 µs) : 489, 532
.   : milestone, 511,
iast_INACTIVE (463.38 µs) : 442, 485
.   : milestone, 463,
iast_TELEMETRY_OFF (500.452 µs) : 479, 522
.   : milestone, 500,
tracing (462.884 µs) : 442, 484
.   : milestone, 463,
section candidate
no_agent (383.69 µs) : 364, 403
.   : milestone, 384,
iast (515.662 µs) : 493, 538
.   : milestone, 516,
iast_FULL (729.17 µs) : 707, 751
.   : milestone, 729,
iast_GLOBAL (557.802 µs) : 536, 579
.   : milestone, 558,
iast_HARDCODED_SECRET_DISABLED (515.181 µs) : 493, 537
.   : milestone, 515,
iast_INACTIVE (462.616 µs) : 442, 484
.   : milestone, 463,
iast_TELEMETRY_OFF (498.159 µs) : 475, 521
.   : milestone, 498,
tracing (460.991 µs) : 440, 482
.   : milestone, 461,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	381.827 µs [361.618 µs, 402.036 µs]	-
iast	509.573 µs [487.953 µs, 531.194 µs]	127.746 µs (33.5%)
iast_FULL	726.996 µs [705.34 µs, 748.652 µs]	345.168 µs (90.4%)
iast_GLOBAL	554.104 µs [532.441 µs, 575.766 µs]	172.277 µs (45.1%)
iast_HARDCODED_SECRET_DISABLED	510.796 µs [489.2 µs, 532.392 µs]	128.969 µs (33.8%)
iast_INACTIVE	463.38 µs [442.008 µs, 484.751 µs]	81.553 µs (21.4%)
iast_TELEMETRY_OFF	500.452 µs [478.775 µs, 522.13 µs]	118.625 µs (31.1%)
tracing	462.884 µs [441.583 µs, 484.185 µs]	81.057 µs (21.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	383.69 µs [363.917 µs, 403.462 µs]	-
iast	515.662 µs [493.002 µs, 538.322 µs]	131.973 µs (34.4%)
iast_FULL	729.17 µs [707.289 µs, 751.052 µs]	345.48 µs (90.0%)
iast_GLOBAL	557.802 µs [536.14 µs, 579.463 µs]	174.112 µs (45.4%)
iast_HARDCODED_SECRET_DISABLED	515.181 µs [493.276 µs, 537.086 µs]	131.491 µs (34.3%)
iast_INACTIVE	462.616 µs [441.642 µs, 483.59 µs]	78.926 µs (20.6%)
iast_TELEMETRY_OFF	498.159 µs [474.983 µs, 521.336 µs]	114.47 µs (29.8%)
tracing	460.991 µs [440.154 µs, 481.827 µs]	77.301 µs (20.1%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~5bebee6f43, baseline=1.47.0-SNAPSHOT~9466d9584d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.359 ms) : 1339, 1378
.   : milestone, 1359,
appsec (1.748 ms) : 1724, 1772
.   : milestone, 1748,
appsec_no_iast (1.766 ms) : 1740, 1792
.   : milestone, 1766,
code_origins (1.689 ms) : 1656, 1722
.   : milestone, 1689,
iast (1.507 ms) : 1483, 1531
.   : milestone, 1507,
profiling (1.507 ms) : 1483, 1531
.   : milestone, 1507,
tracing (1.504 ms) : 1479, 1528
.   : milestone, 1504,
section candidate
no_agent (1.353 ms) : 1333, 1374
.   : milestone, 1353,
appsec (1.758 ms) : 1735, 1782
.   : milestone, 1758,
appsec_no_iast (1.769 ms) : 1745, 1793
.   : milestone, 1769,
code_origins (1.684 ms) : 1650, 1718
.   : milestone, 1684,
iast (1.512 ms) : 1489, 1536
.   : milestone, 1512,
profiling (1.514 ms) : 1492, 1537
.   : milestone, 1514,
tracing (1.49 ms) : 1465, 1515
.   : milestone, 1490,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.359 ms [1.339 ms, 1.378 ms]	-
appsec	1.748 ms [1.724 ms, 1.772 ms]	389.055 µs (28.6%)
appsec_no_iast	1.766 ms [1.74 ms, 1.792 ms]	407.082 µs (30.0%)
code_origins	1.689 ms [1.656 ms, 1.722 ms]	330.682 µs (24.3%)
iast	1.507 ms [1.483 ms, 1.531 ms]	148.457 µs (10.9%)
profiling	1.507 ms [1.483 ms, 1.531 ms]	148.567 µs (10.9%)
tracing	1.504 ms [1.479 ms, 1.528 ms]	144.935 µs (10.7%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.353 ms [1.333 ms, 1.374 ms]	-
appsec	1.758 ms [1.735 ms, 1.782 ms]	405.137 µs (29.9%)
appsec_no_iast	1.769 ms [1.745 ms, 1.793 ms]	415.708 µs (30.7%)
code_origins	1.684 ms [1.65 ms, 1.718 ms]	330.528 µs (24.4%)
iast	1.512 ms [1.489 ms, 1.536 ms]	159.209 µs (11.8%)
profiling	1.514 ms [1.492 ms, 1.537 ms]	161.281 µs (11.9%)
tracing	1.49 ms [1.465 ms, 1.515 ms]	136.713 µs (10.1%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alejandro.gonzalez/exclude-config-coverage
git_commit_date	1740583553	1740587020
git_commit_sha	`9466d95`	`5bebee6`
release_version	1.47.0-SNAPSHOT~9466d9584d	1.47.0-SNAPSHOT~5bebee6f43

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1740589085	1740589085
ci_job_id	824334411	824334411
ci_pipeline_id	57077400	57077400
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-vtotqy1x-project-304-concurrent-3-845ul0za 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-vtotqy1x-project-304-concurrent-3-845ul0za 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~5bebee6f43, baseline=1.47.0-SNAPSHOT~9466d9584d
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.549 s) : 15549000, 15549000
.   : milestone, 15549000,
appsec (14.783 s) : 14783000, 14783000
.   : milestone, 14783000,
iast (18.483 s) : 18483000, 18483000
.   : milestone, 18483000,
iast_GLOBAL (18.366 s) : 18366000, 18366000
.   : milestone, 18366000,
profiling (15.147 s) : 15147000, 15147000
.   : milestone, 15147000,
tracing (15.061 s) : 15061000, 15061000
.   : milestone, 15061000,
section candidate
no_agent (15.221 s) : 15221000, 15221000
.   : milestone, 15221000,
appsec (15.121 s) : 15121000, 15121000
.   : milestone, 15121000,
iast (18.706 s) : 18706000, 18706000
.   : milestone, 18706000,
iast_GLOBAL (17.948 s) : 17948000, 17948000
.   : milestone, 17948000,
profiling (15.6 s) : 15600000, 15600000
.   : milestone, 15600000,
tracing (15.128 s) : 15128000, 15128000
.   : milestone, 15128000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.549 s [15.549 s, 15.549 s]	-
appsec	14.783 s [14.783 s, 14.783 s]	-766.0 ms (-4.9%)
iast	18.483 s [18.483 s, 18.483 s]	2.934 s (18.9%)
iast_GLOBAL	18.366 s [18.366 s, 18.366 s]	2.817 s (18.1%)
profiling	15.147 s [15.147 s, 15.147 s]	-402.0 ms (-2.6%)
tracing	15.061 s [15.061 s, 15.061 s]	-488.0 ms (-3.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.221 s [15.221 s, 15.221 s]	-
appsec	15.121 s [15.121 s, 15.121 s]	-100.0 ms (-0.7%)
iast	18.706 s [18.706 s, 18.706 s]	3.485 s (22.9%)
iast_GLOBAL	17.948 s [17.948 s, 17.948 s]	2.727 s (17.9%)
profiling	15.6 s [15.6 s, 15.6 s]	379.0 ms (2.5%)
tracing	15.128 s [15.128 s, 15.128 s]	-93.0 ms (-0.6%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~5bebee6f43, baseline=1.47.0-SNAPSHOT~9466d9584d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.464 ms) : 1452, 1475
.   : milestone, 1464,
appsec (2.34 ms) : 2298, 2383
.   : milestone, 2340,
iast (2.096 ms) : 2041, 2151
.   : milestone, 2096,
iast_GLOBAL (2.143 ms) : 2087, 2198
.   : milestone, 2143,
profiling (1.97 ms) : 1925, 2014
.   : milestone, 1970,
tracing (1.931 ms) : 1889, 1973
.   : milestone, 1931,
section candidate
no_agent (1.465 ms) : 1453, 1476
.   : milestone, 1465,
appsec (2.356 ms) : 2313, 2400
.   : milestone, 2356,
iast (2.101 ms) : 2047, 2156
.   : milestone, 2101,
iast_GLOBAL (2.151 ms) : 2095, 2206
.   : milestone, 2151,
profiling (1.966 ms) : 1922, 2010
.   : milestone, 1966,
tracing (1.937 ms) : 1895, 1979
.   : milestone, 1937,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.464 ms [1.452 ms, 1.475 ms]	-
appsec	2.34 ms [2.298 ms, 2.383 ms]	876.559 µs (59.9%)
iast	2.096 ms [2.041 ms, 2.151 ms]	632.273 µs (43.2%)
iast_GLOBAL	2.143 ms [2.087 ms, 2.198 ms]	678.76 µs (46.4%)
profiling	1.97 ms [1.925 ms, 2.014 ms]	505.979 µs (34.6%)
tracing	1.931 ms [1.889 ms, 1.973 ms]	467.488 µs (31.9%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.465 ms [1.453 ms, 1.476 ms]	-
appsec	2.356 ms [2.313 ms, 2.4 ms]	891.793 µs (60.9%)
iast	2.101 ms [2.047 ms, 2.156 ms]	636.483 µs (43.5%)
iast_GLOBAL	2.151 ms [2.095 ms, 2.206 ms]	686.168 µs (46.8%)
profiling	1.966 ms [1.922 ms, 2.01 ms]	501.373 µs (34.2%)
tracing	1.937 ms [1.895 ms, 1.979 ms]	472.045 µs (32.2%)

PerfectSlayer

Thanks for the update but can you remove it from excludedClassesBranchCoverage then?

PerfectSlayer

Thanks for the quick fix 🙇

jandro996 added 2 commits February 26, 2025 14:18

Test more getters to improve coverage

b91df6c

Exclude datadog.trace.api.Config from coverage verification

672a817

jandro996 added type: bug Bug report and fix comp: core Tracer core tag: no release notes Changes to exclude from release notes labels Feb 26, 2025

jandro996 requested a review from a team as a code owner February 26, 2025 13:51

jandro996 requested review from PerfectSlayer, dougqh and smola February 26, 2025 13:51

smola added comp: testing Testing and removed type: bug Bug report and fix labels Feb 26, 2025

PerfectSlayer requested changes Feb 26, 2025

View reviewed changes

remove from excludedClassesBranchCoverage

5bebee6

PerfectSlayer approved these changes Feb 27, 2025

View reviewed changes

jandro996 merged commit 85ac63b into master Feb 27, 2025

jandro996 deleted the alejandro.gonzalez/exclude-config-coverage branch February 27, 2025 07:17

github-actions Bot added this to the 1.47.0 milestone Feb 27, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Exclude datadog.trace.api.Config from coverage verification#8454

Exclude datadog.trace.api.Config from coverage verification#8454
jandro996 merged 3 commits intomasterfrom
alejandro.gonzalez/exclude-config-coverage

jandro996 commented Feb 26, 2025

Uh oh!

pr-commenter Bot commented Feb 26, 2025 •

edited

Loading

Uh oh!

PerfectSlayer left a comment •

edited

Loading

Uh oh!

PerfectSlayer left a comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

jandro996 commented Feb 26, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter Bot commented Feb 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

PerfectSlayer left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

PerfectSlayer left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

pr-commenter Bot commented Feb 26, 2025 •

edited

Loading

PerfectSlayer left a comment •

edited

Loading