Skip to content

Fix NullPointerException in Jacoco coverage report merge logic #9803

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
nikita-tkachenko-datadog merged 3 commits into from
Oct 21, 2025
Merged

Fix NullPointerException in Jacoco coverage report merge logic #9803

nikita-tkachenko-datadog merged 3 commits into from
Oct 21, 2025

Conversation

@nikita-tkachenko-datadog
Copy link
Contributor

@nikita-tkachenko-datadog nikita-tkachenko-datadog commented Oct 20, 2025 •
edited by atlassian bot
Loading

What Does This Do

Fixes a NullPointerException in datadog.trace.civisibility.coverage.report.JacocoCoverageProcessor#mergeAndUploadCoverageReport.

Additional Notes

The exception happens because repo index returns null when trying to resolve the source path of a class generated at build-time.

Contributor Checklist

Jira ticket: SDTEST-2826

@nikita-tkachenko-datadog nikita-tkachenko-datadog added type: bug Bug report and fix comp: ci visibility Continuous Integration Visibility labels Oct 20, 2025
@nikita-tkachenko-datadog nikita-tkachenko-datadog marked this pull request as ready for review October 20, 2025 14:02
@nikita-tkachenko-datadog nikita-tkachenko-datadog requested a review from a team as a code owner October 20, 2025 14:02
@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Oct 20, 2025 •
edited
Loading

Test Environment - sbt-scalatest

Job Status: success

Scenario Overhead (%)
agent -86.03
agentEvpProxy -86.19

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Oct 20, 2025

Test Environment - pass4s

Job Status: success

Scenario Overhead (%)
agent 7.97
agentless 5.01
agentlessCodeCoverage 14.85

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Oct 20, 2025 •
edited
Loading

Test Environment - sonar-kotlin

Job Status: success

Scenario Overhead (%)
agent 17.25
agentless 14.33
agentlessCodeCoverage 15.24
agentlessLineCoverage 20.12

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Oct 20, 2025 •
edited
Loading

Test Environment - okhttp

Job Status: success

Scenario Overhead (%)
agent -40.19
agentless -48.06
agentlessCodeCoverage -46.67
agentlessLineCoverage -39.30

@pr-commenter
Copy link

pr-commenter bot commented Oct 20, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/report-upload-npe
git_commit_date 1761042432 1761043497
git_commit_sha 1669104 2509190
release_version 1.55.0-SNAPSHOT~1669104b14 1.55.0-SNAPSHOT~250919032f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1761045197 1761045197
ci_job_id 1188651475 1188651475
ci_pipeline_id 79824192 79824192
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-5zkyr4ek 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-5zkyr4ek 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 4 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~250919032f, baseline=1.55.0-SNAPSHOT~1669104b14

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.02 s) : 0, 1020061
Total [baseline] (8.698 s) : 0, 8698400
Agent [candidate] (1.024 s) : 0, 1023915
Total [candidate] (8.662 s) : 0, 8661844
section iast
Agent [baseline] (1.151 s) : 0, 1150642
Total [baseline] (9.3 s) : 0, 9299887
Agent [candidate] (1.153 s) : 0, 1152966
Total [candidate] (9.309 s) : 0, 9309250
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.02 s -
Agent iast 1.151 s 130.58 ms (12.8%)
Total tracing 8.698 s -
Total iast 9.3 s 601.487 ms (6.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.024 s -
Agent iast 1.153 s 129.051 ms (12.6%)
Total tracing 8.662 s -
Total iast 9.309 s 647.407 ms (7.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~250919032f, baseline=1.55.0-SNAPSHOT~1669104b14

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.462 ms) : 0, 1462
BytebuddyAgent [baseline] (694.694 ms) : 0, 694694
BytebuddyAgent [candidate] (697.722 ms) : 0, 697722
GlobalTracer [baseline] (243.192 ms) : 0, 243192
GlobalTracer [candidate] (244.579 ms) : 0, 244579
AppSec [baseline] (32.145 ms) : 0, 32145
AppSec [candidate] (32.447 ms) : 0, 32447
Debugger [baseline] (6.258 ms) : 0, 6258
Debugger [candidate] (6.383 ms) : 0, 6383
Remote Config [baseline] (692.509 µs) : 0, 693
Remote Config [candidate] (683.414 µs) : 0, 683
Telemetry [baseline] (9.298 ms) : 0, 9298
Telemetry [candidate] (9.336 ms) : 0, 9336
Flare Poller [baseline] (11.012 ms) : 0, 11012
Flare Poller [candidate] (10.073 ms) : 0, 10073
section iast
crashtracking [baseline] (1.473 ms) : 0, 1473
crashtracking [candidate] (1.472 ms) : 0, 1472
BytebuddyAgent [baseline] (815.088 ms) : 0, 815088
BytebuddyAgent [candidate] (816.614 ms) : 0, 816614
GlobalTracer [baseline] (231.202 ms) : 0, 231202
GlobalTracer [candidate] (232.168 ms) : 0, 232168
IAST [baseline] (26.555 ms) : 0, 26555
IAST [candidate] (26.524 ms) : 0, 26524
AppSec [baseline] (35.24 ms) : 0, 35240
AppSec [candidate] (35.034 ms) : 0, 35034
Debugger [baseline] (6.116 ms) : 0, 6116
Debugger [candidate] (6.139 ms) : 0, 6139
Remote Config [baseline] (595.345 µs) : 0, 595
Remote Config [candidate] (603.276 µs) : 0, 603
Telemetry [baseline] (8.614 ms) : 0, 8614
Telemetry [candidate] (8.753 ms) : 0, 8753
Flare Poller [baseline] (4.348 ms) : 0, 4348
Flare Poller [candidate] (4.174 ms) : 0, 4174
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~250919032f, baseline=1.55.0-SNAPSHOT~1669104b14

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.018 s) : 0, 1018408
Total [baseline] (10.766 s) : 0, 10766465
Agent [candidate] (1.024 s) : 0, 1024137
Total [candidate] (10.862 s) : 0, 10862496
section appsec
Agent [baseline] (1.196 s) : 0, 1195796
Total [baseline] (10.87 s) : 0, 10869550
Agent [candidate] (1.194 s) : 0, 1194244
Total [candidate] (10.816 s) : 0, 10815809
section iast
Agent [baseline] (1.154 s) : 0, 1153552
Total [baseline] (11.037 s) : 0, 11036579
Agent [candidate] (1.159 s) : 0, 1158681
Total [candidate] (11.227 s) : 0, 11227230
section profiling
Agent [baseline] (1.166 s) : 0, 1165899
Total [baseline] (10.89 s) : 0, 10890169
Agent [candidate] (1.17 s) : 0, 1169676
Total [candidate] (10.95 s) : 0, 10949829
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.018 s -
Agent appsec 1.196 s 177.388 ms (17.4%)
Agent iast 1.154 s 135.143 ms (13.3%)
Agent profiling 1.166 s 147.49 ms (14.5%)
Total tracing 10.766 s -
Total appsec 10.87 s 103.085 ms (1.0%)
Total iast 11.037 s 270.113 ms (2.5%)
Total profiling 10.89 s 123.704 ms (1.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.024 s -
Agent appsec 1.194 s 170.107 ms (16.6%)
Agent iast 1.159 s 134.544 ms (13.1%)
Agent profiling 1.17 s 145.539 ms (14.2%)
Total tracing 10.862 s -
Total appsec 10.816 s -46.686 ms (-0.4%)
Total iast 11.227 s 364.734 ms (3.4%)
Total profiling 10.95 s 87.333 ms (0.8%) 
gantt
    title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~250919032f, baseline=1.55.0-SNAPSHOT~1669104b14

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.476 ms) : 0, 1476
crashtracking [candidate] (1.468 ms) : 0, 1468
BytebuddyAgent [baseline] (693.596 ms) : 0, 693596
BytebuddyAgent [candidate] (698.493 ms) : 0, 698493
GlobalTracer [baseline] (243.179 ms) : 0, 243179
GlobalTracer [candidate] (243.026 ms) : 0, 243026
AppSec [baseline] (32.261 ms) : 0, 32261
AppSec [candidate] (32.126 ms) : 0, 32126
Debugger [baseline] (6.299 ms) : 0, 6299
Debugger [candidate] (6.254 ms) : 0, 6254
Remote Config [baseline] (679.546 µs) : 0, 680
Remote Config [candidate] (684.165 µs) : 0, 684
Telemetry [baseline] (9.258 ms) : 0, 9258
Telemetry [candidate] (9.222 ms) : 0, 9222
Flare Poller [baseline] (10.429 ms) : 0, 10429
Flare Poller [candidate] (11.615 ms) : 0, 11615
section appsec
crashtracking [baseline] (1.468 ms) : 0, 1468
crashtracking [candidate] (1.448 ms) : 0, 1448
BytebuddyAgent [baseline] (718.809 ms) : 0, 718809
BytebuddyAgent [candidate] (716.892 ms) : 0, 716892
GlobalTracer [baseline] (235.143 ms) : 0, 235143
GlobalTracer [candidate] (234.617 ms) : 0, 234617
IAST [baseline] (24.808 ms) : 0, 24808
IAST [candidate] (24.866 ms) : 0, 24866
AppSec [baseline] (175.125 ms) : 0, 175125
AppSec [candidate] (175.967 ms) : 0, 175967
Debugger [baseline] (6.058 ms) : 0, 6058
Debugger [candidate] (6.112 ms) : 0, 6112
Remote Config [baseline] (634.488 µs) : 0, 634
Remote Config [candidate] (634.476 µs) : 0, 634
Telemetry [baseline] (8.579 ms) : 0, 8579
Telemetry [candidate] (8.616 ms) : 0, 8616
Flare Poller [baseline] (3.897 ms) : 0, 3897
Flare Poller [candidate] (3.919 ms) : 0, 3919
section iast
crashtracking [baseline] (1.461 ms) : 0, 1461
crashtracking [candidate] (1.464 ms) : 0, 1464
BytebuddyAgent [baseline] (816.575 ms) : 0, 816575
BytebuddyAgent [candidate] (820.75 ms) : 0, 820750
GlobalTracer [baseline] (232.07 ms) : 0, 232070
GlobalTracer [candidate] (233.145 ms) : 0, 233145
IAST [baseline] (26.722 ms) : 0, 26722
IAST [candidate] (26.81 ms) : 0, 26810
AppSec [baseline] (35.461 ms) : 0, 35461
AppSec [candidate] (35.155 ms) : 0, 35155
Debugger [baseline] (6.132 ms) : 0, 6132
Debugger [candidate] (6.123 ms) : 0, 6123
Remote Config [baseline] (612.307 µs) : 0, 612
Remote Config [candidate] (593.28 µs) : 0, 593
Telemetry [baseline] (8.68 ms) : 0, 8680
Telemetry [candidate] (8.661 ms) : 0, 8661
Flare Poller [baseline] (4.293 ms) : 0, 4293
Flare Poller [candidate] (4.32 ms) : 0, 4320
section profiling
crashtracking [baseline] (1.489 ms) : 0, 1489
crashtracking [candidate] (1.472 ms) : 0, 1472
BytebuddyAgent [baseline] (721.801 ms) : 0, 721801
BytebuddyAgent [candidate] (724.438 ms) : 0, 724438
GlobalTracer [baseline] (219.308 ms) : 0, 219308
GlobalTracer [candidate] (220.175 ms) : 0, 220175
AppSec [baseline] (32.138 ms) : 0, 32138
AppSec [candidate] (32.467 ms) : 0, 32467
Debugger [baseline] (7.432 ms) : 0, 7432
Debugger [candidate] (7.567 ms) : 0, 7567
Remote Config [baseline] (699.234 µs) : 0, 699
Remote Config [candidate] (696.666 µs) : 0, 697
Telemetry [baseline] (15.105 ms) : 0, 15105
Telemetry [candidate] (14.997 ms) : 0, 14997
Flare Poller [baseline] (4.199 ms) : 0, 4199
Flare Poller [candidate] (4.157 ms) : 0, 4157
ProfilingAgent [baseline] (109.775 ms) : 0, 109775
ProfilingAgent [candidate] (109.553 ms) : 0, 109553
Profiling [baseline] (110.425 ms) : 0, 110425
Profiling [candidate] (110.189 ms) : 0, 110189
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/report-upload-npe
git_commit_date 1761042432 1761043497
git_commit_sha 1669104 2509190
release_version 1.55.0-SNAPSHOT~1669104b14 1.55.0-SNAPSHOT~250919032f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1761044984 1761044984
ci_job_id 1188651476 1188651476
ci_pipeline_id 79824192 79824192
cpu_model Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-99lq6q52 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-99lq6q52 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 4 performance regressions! Performance is the same for 6 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:tracing:high_load worse
[+289.381µs; +566.266µs] or [+3.569%; +6.984%]		 unstable
[-97.147op/s; +40.522op/s] or [-17.001%; +7.092%]		 8.536ms 543.094op/s 8.108ms 571.406op/s
scenario:load:petclinic:iast:high_load worse
[+0.934ms; +1.810ms] or [+2.060%; +3.994%]		 unstable
[-10.854op/s; +4.979op/s] or [-10.517%; +4.825%]		 46.696ms 100.263op/s 45.324ms 103.200op/s
scenario:load:petclinic:code_origins:high_load worse
[+1.033ms; +1.903ms] or [+2.279%; +4.198%]		 unstable
[-10.900op/s; +4.475op/s] or [-10.566%; +4.338%]		 46.807ms 99.950op/s 45.338ms 103.162op/s
scenario:load:petclinic:profiling:high_load worse
[+1.532ms; +2.535ms] or [+2.997%; +4.958%]		 unstable
[-10.060op/s; +3.110op/s] or [-10.992%; +3.398%]		 53.169ms 88.050op/s 51.135ms 91.525op/s
scenario:load:petclinic:appsec:high_load better
[-2.691ms; -1.756ms] or [-5.432%; -3.546%]		 unstable
[-3.023op/s; +11.873op/s] or [-3.201%; +12.570%]		 47.312ms 98.888op/s 49.535ms 94.463op/s
scenario:load:petclinic:no_agent:high_load better
[-2.196ms; -1.526ms] or [-5.607%; -3.897%]		 unstable
[-3.127op/s; +14.952op/s] or [-2.619%; +12.524%]		 37.305ms 125.300op/s 39.166ms 119.388op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~250919032f, baseline=1.55.0-SNAPSHOT~1669104b14
    dateFormat X
    axisFormat %s
section baseline
no_agent (39.166 ms) : 38850, 39483
.   : milestone, 39166,
appsec (49.535 ms) : 49076, 49995
.   : milestone, 49535,
code_origins (45.338 ms) : 44935, 45741
.   : milestone, 45338,
iast (45.324 ms) : 44926, 45723
.   : milestone, 45324,
profiling (51.135 ms) : 50670, 51600
.   : milestone, 51135,
tracing (45.849 ms) : 45464, 46234
.   : milestone, 45849,
section candidate
no_agent (37.305 ms) : 37000, 37611
.   : milestone, 37305,
appsec (47.312 ms) : 46905, 47719
.   : milestone, 47312,
code_origins (46.807 ms) : 46401, 47212
.   : milestone, 46807,
iast (46.696 ms) : 46281, 47112
.   : milestone, 46696,
profiling (53.169 ms) : 52702, 53637
.   : milestone, 53169,
tracing (46.65 ms) : 46230, 47069
.   : milestone, 46650,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 39.166 ms [38.85 ms, 39.483 ms] -
appsec 49.535 ms [49.076 ms, 49.995 ms] 10.369 ms (26.5%)
code_origins 45.338 ms [44.935 ms, 45.741 ms] 6.172 ms (15.8%)
iast 45.324 ms [44.926 ms, 45.723 ms] 6.158 ms (15.7%)
profiling 51.135 ms [50.67 ms, 51.6 ms] 11.969 ms (30.6%)
tracing 45.849 ms [45.464 ms, 46.234 ms] 6.682 ms (17.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.305 ms [37.0 ms, 37.611 ms] -
appsec 47.312 ms [46.905 ms, 47.719 ms] 10.007 ms (26.8%)
code_origins 46.807 ms [46.401 ms, 47.212 ms] 9.501 ms (25.5%)
iast 46.696 ms [46.281 ms, 47.112 ms] 9.391 ms (25.2%)
profiling 53.169 ms [52.702 ms, 53.637 ms] 15.864 ms (42.5%)
tracing 46.65 ms [46.23 ms, 47.069 ms] 9.344 ms (25.0%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~250919032f, baseline=1.55.0-SNAPSHOT~1669104b14
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.855 ms) : 4797, 4913
.   : milestone, 4855,
iast (10.938 ms) : 10749, 11127
.   : milestone, 10938,
iast_FULL (14.636 ms) : 14343, 14929
.   : milestone, 14636,
iast_GLOBAL (11.645 ms) : 11425, 11866
.   : milestone, 11645,
profiling (9.474 ms) : 9335, 9612
.   : milestone, 9474,
tracing (8.108 ms) : 7979, 8237
.   : milestone, 8108,
section candidate
no_agent (4.772 ms) : 4715, 4829
.   : milestone, 4772,
iast (10.867 ms) : 10676, 11058
.   : milestone, 10867,
iast_FULL (15.129 ms) : 14830, 15428
.   : milestone, 15129,
iast_GLOBAL (11.6 ms) : 11366, 11833
.   : milestone, 11600,
profiling (9.642 ms) : 9498, 9785
.   : milestone, 9642,
tracing (8.536 ms) : 8408, 8664
.   : milestone, 8536,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.855 ms [4.797 ms, 4.913 ms] -
iast 10.938 ms [10.749 ms, 11.127 ms] 6.083 ms (125.3%)
iast_FULL 14.636 ms [14.343 ms, 14.929 ms] 9.781 ms (201.5%)
iast_GLOBAL 11.645 ms [11.425 ms, 11.866 ms] 6.791 ms (139.9%)
profiling 9.474 ms [9.335 ms, 9.612 ms] 4.619 ms (95.1%)
tracing 8.108 ms [7.979 ms, 8.237 ms] 3.253 ms (67.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.772 ms [4.715 ms, 4.829 ms] -
iast 10.867 ms [10.676 ms, 11.058 ms] 6.094 ms (127.7%)
iast_FULL 15.129 ms [14.83 ms, 15.428 ms] 10.357 ms (217.0%)
iast_GLOBAL 11.6 ms [11.366 ms, 11.833 ms] 6.828 ms (143.1%)
profiling 9.642 ms [9.498 ms, 9.785 ms] 4.869 ms (102.0%)
tracing 8.536 ms [8.408 ms, 8.664 ms] 3.764 ms (78.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/report-upload-npe
git_commit_date 1761042432 1761043497
git_commit_sha 1669104 2509190
release_version 1.55.0-SNAPSHOT~1669104b14 1.55.0-SNAPSHOT~250919032f
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1761045343 1761045343
ci_job_id 1188651477 1188651477
ci_pipeline_id 79824192 79824192
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-dpaprr4p 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-dpaprr4p 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~250919032f, baseline=1.55.0-SNAPSHOT~1669104b14
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.977 s) : 14977000, 14977000
.   : milestone, 14977000,
appsec (15.006 s) : 15006000, 15006000
.   : milestone, 15006000,
iast (18.519 s) : 18519000, 18519000
.   : milestone, 18519000,
iast_GLOBAL (17.867 s) : 17867000, 17867000
.   : milestone, 17867000,
profiling (15.804 s) : 15804000, 15804000
.   : milestone, 15804000,
tracing (15.291 s) : 15291000, 15291000
.   : milestone, 15291000,
section candidate
no_agent (15.512 s) : 15512000, 15512000
.   : milestone, 15512000,
appsec (14.934 s) : 14934000, 14934000
.   : milestone, 14934000,
iast (18.402 s) : 18402000, 18402000
.   : milestone, 18402000,
iast_GLOBAL (17.965 s) : 17965000, 17965000
.   : milestone, 17965000,
profiling (15.089 s) : 15089000, 15089000
.   : milestone, 15089000,
tracing (15.203 s) : 15203000, 15203000
.   : milestone, 15203000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.977 s [14.977 s, 14.977 s] -
appsec 15.006 s [15.006 s, 15.006 s] 29.0 ms (0.2%)
iast 18.519 s [18.519 s, 18.519 s] 3.542 s (23.6%)
iast_GLOBAL 17.867 s [17.867 s, 17.867 s] 2.89 s (19.3%)
profiling 15.804 s [15.804 s, 15.804 s] 827.0 ms (5.5%)
tracing 15.291 s [15.291 s, 15.291 s] 314.0 ms (2.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.512 s [15.512 s, 15.512 s] -
appsec 14.934 s [14.934 s, 14.934 s] -578.0 ms (-3.7%)
iast 18.402 s [18.402 s, 18.402 s] 2.89 s (18.6%)
iast_GLOBAL 17.965 s [17.965 s, 17.965 s] 2.453 s (15.8%)
profiling 15.089 s [15.089 s, 15.089 s] -423.0 ms (-2.7%)
tracing 15.203 s [15.203 s, 15.203 s] -309.0 ms (-2.0%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~250919032f, baseline=1.55.0-SNAPSHOT~1669104b14
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.483 ms) : 1472, 1495
.   : milestone, 1483,
appsec (3.719 ms) : 3501, 3936
.   : milestone, 3719,
iast (2.219 ms) : 2155, 2283
.   : milestone, 2219,
iast_GLOBAL (2.265 ms) : 2201, 2329
.   : milestone, 2265,
profiling (2.505 ms) : 2286, 2724
.   : milestone, 2505,
tracing (2.051 ms) : 2001, 2101
.   : milestone, 2051,
section candidate
no_agent (1.478 ms) : 1466, 1489
.   : milestone, 1478,
appsec (3.687 ms) : 3471, 3902
.   : milestone, 3687,
iast (2.219 ms) : 2155, 2283
.   : milestone, 2219,
iast_GLOBAL (2.27 ms) : 2205, 2334
.   : milestone, 2270,
profiling (2.07 ms) : 2018, 2122
.   : milestone, 2070,
tracing (2.04 ms) : 1990, 2090
.   : milestone, 2040,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.472 ms, 1.495 ms] -
appsec 3.719 ms [3.501 ms, 3.936 ms] 2.235 ms (150.7%)
iast 2.219 ms [2.155 ms, 2.283 ms] 735.985 µs (49.6%)
iast_GLOBAL 2.265 ms [2.201 ms, 2.329 ms] 781.858 µs (52.7%)
profiling 2.505 ms [2.286 ms, 2.724 ms] 1.022 ms (68.9%)
tracing 2.051 ms [2.001 ms, 2.101 ms] 568.105 µs (38.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.466 ms, 1.489 ms] -
appsec 3.687 ms [3.471 ms, 3.902 ms] 2.209 ms (149.4%)
iast 2.219 ms [2.155 ms, 2.283 ms] 740.817 µs (50.1%)
iast_GLOBAL 2.27 ms [2.205 ms, 2.334 ms] 791.626 µs (53.6%)
profiling 2.07 ms [2.018 ms, 2.122 ms] 591.922 µs (40.0%)
tracing 2.04 ms [1.99 ms, 2.09 ms] 562.323 µs (38.0%)

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Oct 20, 2025 •
edited
Loading

Test Environment - jolokia

Job Status: success

Scenario Overhead (%)
agent 89.15
agentless 85.38
agentlessCodeCoverage 96.25
agentlessLineCoverage 96.95

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Oct 20, 2025 •
edited
Loading

Test Environment - spring_boot

Job Status: failed

Scenario Overhead (%)
agent -73.56
agentless -71.99
agentlessCodeCoverage -67.84
agentlessLineCoverage -100.00

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Oct 20, 2025 •
edited
Loading

Test Environment - reactive-streams-jvm

Job Status: success

Scenario Overhead (%)
agent -46.66
agentless -64.30
agentlessCodeCoverage -63.74
agentlessLineCoverage -44.21

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Oct 20, 2025

Test Environment - nebula-release-plugin

Job Status: failed

Scenario Overhead (%)
agent 36.23
agentless 49.70
agentlessCodeCoverage 44.54
agentlessLineCoverage 198.48

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Oct 20, 2025

Test Environment - netflix-zuul

Job Status: failed

Scenario Overhead (%)
agent 60.01
agentless -46.15
agentlessCodeCoverage -100.00
agentlessLineCoverage -100.00

@datadog-official
Copy link

datadog-official bot commented Oct 20, 2025 •
edited by datadog-datadog-prod-us1 bot
Loading

🎯 Code Coverage
• Patch Coverage: 0.00%
• Total Coverage: 63.33% (+3.63%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 2509190 | Docs | Was this helpful? Give us feedback!

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Oct 20, 2025

Test Environment - sonar-java

Job Status: success

Scenario Overhead (%)
agent 5.99
agentless 24.92
agentlessCodeCoverage 58.55
agentlessLineCoverage 139.77

@nikita-tkachenko-datadog nikita-tkachenko-datadog merged commit 793a0e7 into master Oct 21, 2025
534 checks passed
@nikita-tkachenko-datadog nikita-tkachenko-datadog deleted the nikita-tkachenko/report-upload-npe branch October 21, 2025 13:44
@github-actions github-actions bot added this to the 1.55.0 milestone Oct 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mcculls mcculls mcculls approved these changes

@daniel-mohedano daniel-mohedano daniel-mohedano approved these changes

@Mariovido Mariovido Awaiting requested review from Mariovido Mariovido is a code owner automatically assigned from DataDog/ci-app-libraries-java

Assignees

No one assigned

Labels

comp: ci visibility Continuous Integration Visibility type: bug Bug report and fix

Projects

None yet

Milestone

1.55.0

Development

Successfully merging this pull request may close these issues.

4 participants

@nikita-tkachenko-datadog @mcculls @daniel-mohedano