Skip to content

Lower logging level for RepoIndex error #9697

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
daniel-mohedano merged 2 commits into from
Oct 8, 2025
Merged

Lower logging level for RepoIndex error #9697

daniel-mohedano merged 2 commits into from
Oct 8, 2025

Conversation

@daniel-mohedano
Copy link
Contributor

@daniel-mohedano daniel-mohedano commented Oct 8, 2025

What Does This Do

  • Lowers the logging level from ERROR to DEBUG when datadog.trace.civisibility.source.index.RepoIndex#getFallbackSourcePath is unable to retrieve the file name for a certain class.

Motivation

  • Auto-generated classes can make this error quite common, polluting the CI logs for customers.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@daniel-mohedano daniel-mohedano added type: enhancement Enhancements and improvements comp: ci visibility Continuous Integration Visibility labels Oct 8, 2025
daniel-mohedano
daniel-mohedano commented Oct 8, 2025
View reviewed changes
dd-java-agent/instrumentation/junit/junit-4.10/src/test/groovy/JUnit4Test.groovy
Comment on lines +80 to +88
"test-failed" | false | [TestFailed] | []
"test-retry-failed" | false | [TestFailed] | [new TestFQN("org.example.TestFailed", "test_failed")]
// "test-failed-then-succeed" | true | [TestFailedThenSucceed] | [new TestFQN("org.example.TestFailedThenSucceed", "test_failed_then_succeed")]
// "test-assumption-is-not-retried" | true | [TestAssumption] | [new TestFQN("org.example.TestAssumption", "test_fail_assumption")]
// "test-skipped-is-not-retried" | true | [TestSkipped] | [new TestFQN("org.example.TestSkipped", "test_skipped")]
// "test-retry-parameterized" | false | [TestFailedParameterized] | [
// new TestFQN("org.example.TestFailedParameterized", "test_failed_parameterized") /* backend cannot provide parameters for flaky parameterized tests yet */
// ]
// "test-expected-exception-is-not-retried" | true | [TestSucceedExpectedException] | [new TestFQN("org.example.TestSucceedExpectedException", "test_succeed")]
"test-failed-then-succeed" | true | [TestFailedThenSucceed] | [new TestFQN("org.example.TestFailedThenSucceed", "test_failed_then_succeed")]
"test-assumption-is-not-retried" | true | [TestAssumption] | [new TestFQN("org.example.TestAssumption", "test_fail_assumption")]
"test-skipped-is-not-retried" | true | [TestSkipped] | [new TestFQN("org.example.TestSkipped", "test_skipped")]
"test-retry-parameterized" | false | [TestFailedParameterized] | [
new TestFQN("org.example.TestFailedParameterized", "test_failed_parameterized") /* backend cannot provide parameters for flaky parameterized tests yet */
]
"test-expected-exception-is-not-retried" | true | [TestSucceedExpectedException] | [new TestFQN("org.example.TestSucceedExpectedException", "test_succeed")]
Copy link
Contributor Author

@daniel-mohedano daniel-mohedano Oct 8, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We missed this in #9478 😭

Copy link
Contributor

@nikita-tkachenko-datadog nikita-tkachenko-datadog Oct 8, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ouch!

@datadog-official
Copy link

datadog-official bot commented Oct 8, 2025 •
edited
Loading

🎯 Code Coverage
• Patch Coverage: 0.00%
• Total Coverage: 64.41% (+4.72%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: ab29d63 | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Oct 8, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/repo-index-log-level
git_commit_date 1759910850 1759920700
git_commit_sha 60a3b9d ab29d63
release_version 1.55.0-SNAPSHOT~60a3b9d880 1.55.0-SNAPSHOT~ab29d63333
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1759922528 1759922528
ci_job_id 1169070774 1169070774
ci_pipeline_id 78705506 78705506
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-tyjqvauv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-tyjqvauv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 4 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~ab29d63333, baseline=1.55.0-SNAPSHOT~60a3b9d880

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.015 s) : 0, 1014772
Total [baseline] (8.646 s) : 0, 8645984
Agent [candidate] (1.016 s) : 0, 1016096
Total [candidate] (8.635 s) : 0, 8635010
section iast
Agent [baseline] (1.152 s) : 0, 1152040
Total [baseline] (9.263 s) : 0, 9263296
Agent [candidate] (1.158 s) : 0, 1158324
Total [candidate] (9.239 s) : 0, 9238653
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.015 s -
Agent iast 1.152 s 137.269 ms (13.5%)
Total tracing 8.646 s -
Total iast 9.263 s 617.312 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.016 s -
Agent iast 1.158 s 142.228 ms (14.0%)
Total tracing 8.635 s -
Total iast 9.239 s 603.643 ms (7.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~ab29d63333, baseline=1.55.0-SNAPSHOT~60a3b9d880

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.455 ms) : 0, 1455
crashtracking [candidate] (1.443 ms) : 0, 1443
BytebuddyAgent [baseline] (690.924 ms) : 0, 690924
BytebuddyAgent [candidate] (691.88 ms) : 0, 691880
GlobalTracer [baseline] (241.101 ms) : 0, 241101
GlobalTracer [candidate] (241.445 ms) : 0, 241445
AppSec [baseline] (32.999 ms) : 0, 32999
AppSec [candidate] (33.003 ms) : 0, 33003
Debugger [baseline] (6.429 ms) : 0, 6429
Debugger [candidate] (6.481 ms) : 0, 6481
Remote Config [baseline] (700.817 µs) : 0, 701
Remote Config [candidate] (696.511 µs) : 0, 697
Telemetry [baseline] (9.29 ms) : 0, 9290
Telemetry [candidate] (9.36 ms) : 0, 9360
Flare Poller [baseline] (10.851 ms) : 0, 10851
Flare Poller [candidate] (10.762 ms) : 0, 10762
section iast
crashtracking [baseline] (1.46 ms) : 0, 1460
crashtracking [candidate] (1.486 ms) : 0, 1486
BytebuddyAgent [baseline] (815.919 ms) : 0, 815919
BytebuddyAgent [candidate] (821.288 ms) : 0, 821288
GlobalTracer [baseline] (231.94 ms) : 0, 231940
GlobalTracer [candidate] (232.553 ms) : 0, 232553
IAST [baseline] (26.527 ms) : 0, 26527
IAST [candidate] (26.841 ms) : 0, 26841
AppSec [baseline] (35.582 ms) : 0, 35582
AppSec [candidate] (35.247 ms) : 0, 35247
Debugger [baseline] (6.095 ms) : 0, 6095
Debugger [candidate] (6.156 ms) : 0, 6156
Remote Config [baseline] (605.947 µs) : 0, 606
Remote Config [candidate] (602.038 µs) : 0, 602
Telemetry [baseline] (8.556 ms) : 0, 8556
Telemetry [candidate] (8.59 ms) : 0, 8590
Flare Poller [baseline] (4.128 ms) : 0, 4128
Flare Poller [candidate] (4.162 ms) : 0, 4162
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~ab29d63333, baseline=1.55.0-SNAPSHOT~60a3b9d880

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.013 s) : 0, 1013232
Total [baseline] (10.757 s) : 0, 10756853
Agent [candidate] (1.02 s) : 0, 1020052
Total [candidate] (10.834 s) : 0, 10834060
section appsec
Agent [baseline] (1.193 s) : 0, 1192936
Total [baseline] (11.097 s) : 0, 11097379
Agent [candidate] (1.191 s) : 0, 1191445
Total [candidate] (11.002 s) : 0, 11002029
section iast
Agent [baseline] (1.148 s) : 0, 1148338
Total [baseline] (10.966 s) : 0, 10965930
Agent [candidate] (1.154 s) : 0, 1153833
Total [candidate] (11.068 s) : 0, 11068036
section profiling
Agent [baseline] (1.161 s) : 0, 1161024
Total [baseline] (11.052 s) : 0, 11051983
Agent [candidate] (1.16 s) : 0, 1160327
Total [candidate] (11.028 s) : 0, 11027588
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.013 s -
Agent appsec 1.193 s 179.704 ms (17.7%)
Agent iast 1.148 s 135.106 ms (13.3%)
Agent profiling 1.161 s 147.792 ms (14.6%)
Total tracing 10.757 s -
Total appsec 11.097 s 340.526 ms (3.2%)
Total iast 10.966 s 209.077 ms (1.9%)
Total profiling 11.052 s 295.13 ms (2.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.02 s -
Agent appsec 1.191 s 171.393 ms (16.8%)
Agent iast 1.154 s 133.781 ms (13.1%)
Agent profiling 1.16 s 140.275 ms (13.8%)
Total tracing 10.834 s -
Total appsec 11.002 s 167.968 ms (1.6%)
Total iast 11.068 s 233.976 ms (2.2%)
Total profiling 11.028 s 193.527 ms (1.8%) 
gantt
    title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~ab29d63333, baseline=1.55.0-SNAPSHOT~60a3b9d880

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.46 ms) : 0, 1460
BytebuddyAgent [baseline] (691.402 ms) : 0, 691402
BytebuddyAgent [candidate] (695.626 ms) : 0, 695626
GlobalTracer [baseline] (240.612 ms) : 0, 240612
GlobalTracer [candidate] (242.314 ms) : 0, 242314
AppSec [baseline] (32.887 ms) : 0, 32887
AppSec [candidate] (33.357 ms) : 0, 33357
Debugger [baseline] (6.419 ms) : 0, 6419
Debugger [candidate] (6.559 ms) : 0, 6559
Remote Config [baseline] (693.207 µs) : 0, 693
Remote Config [candidate] (703.13 µs) : 0, 703
Telemetry [baseline] (9.191 ms) : 0, 9191
Telemetry [candidate] (9.458 ms) : 0, 9458
Flare Poller [baseline] (9.506 ms) : 0, 9506
Flare Poller [candidate] (9.389 ms) : 0, 9389
section appsec
crashtracking [baseline] (1.452 ms) : 0, 1452
crashtracking [candidate] (1.451 ms) : 0, 1451
BytebuddyAgent [baseline] (717.35 ms) : 0, 717350
BytebuddyAgent [candidate] (716.255 ms) : 0, 716255
GlobalTracer [baseline] (233.94 ms) : 0, 233940
GlobalTracer [candidate] (233.882 ms) : 0, 233882
IAST [baseline] (24.738 ms) : 0, 24738
IAST [candidate] (24.713 ms) : 0, 24713
AppSec [baseline] (175.299 ms) : 0, 175299
AppSec [candidate] (174.902 ms) : 0, 174902
Debugger [baseline] (6.088 ms) : 0, 6088
Debugger [candidate] (6.14 ms) : 0, 6140
Remote Config [baseline] (642.502 µs) : 0, 643
Remote Config [candidate] (648.783 µs) : 0, 649
Telemetry [baseline] (8.442 ms) : 0, 8442
Telemetry [candidate] (8.426 ms) : 0, 8426
Flare Poller [baseline] (3.932 ms) : 0, 3932
Flare Poller [candidate] (3.945 ms) : 0, 3945
section iast
crashtracking [baseline] (1.454 ms) : 0, 1454
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (813.048 ms) : 0, 813048
BytebuddyAgent [candidate] (816.185 ms) : 0, 816185
GlobalTracer [baseline] (231.048 ms) : 0, 231048
GlobalTracer [candidate] (232.6 ms) : 0, 232600
IAST [baseline] (26.479 ms) : 0, 26479
IAST [candidate] (26.628 ms) : 0, 26628
AppSec [baseline] (35.618 ms) : 0, 35618
AppSec [candidate] (35.889 ms) : 0, 35889
Debugger [baseline] (6.112 ms) : 0, 6112
Debugger [candidate] (6.168 ms) : 0, 6168
Remote Config [baseline] (599.711 µs) : 0, 600
Remote Config [candidate] (604.553 µs) : 0, 605
Telemetry [baseline] (8.564 ms) : 0, 8564
Telemetry [candidate] (8.878 ms) : 0, 8878
Flare Poller [baseline] (4.155 ms) : 0, 4155
Flare Poller [candidate] (4.197 ms) : 0, 4197
section profiling
crashtracking [baseline] (1.429 ms) : 0, 1429
crashtracking [candidate] (1.417 ms) : 0, 1417
BytebuddyAgent [baseline] (720.348 ms) : 0, 720348
BytebuddyAgent [candidate] (719.887 ms) : 0, 719887
GlobalTracer [baseline] (217.434 ms) : 0, 217434
GlobalTracer [candidate] (217.283 ms) : 0, 217283
AppSec [baseline] (33.214 ms) : 0, 33214
AppSec [candidate] (32.983 ms) : 0, 32983
Debugger [baseline] (7.261 ms) : 0, 7261
Debugger [candidate] (6.476 ms) : 0, 6476
Remote Config [baseline] (690.447 µs) : 0, 690
Remote Config [candidate] (691.097 µs) : 0, 691
Telemetry [baseline] (16.03 ms) : 0, 16030
Telemetry [candidate] (16.645 ms) : 0, 16645
Flare Poller [baseline] (4.18 ms) : 0, 4180
Flare Poller [candidate] (4.236 ms) : 0, 4236
ProfilingAgent [baseline] (107.36 ms) : 0, 107360
ProfilingAgent [candidate] (107.458 ms) : 0, 107458
Profiling [baseline] (108.62 ms) : 0, 108620
Profiling [candidate] (108.842 ms) : 0, 108842
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/repo-index-log-level
git_commit_date 1759910850 1759920700
git_commit_sha 60a3b9d ab29d63
release_version 1.55.0-SNAPSHOT~60a3b9d880 1.55.0-SNAPSHOT~ab29d63333
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1759922286 1759922286
ci_job_id 1169070776 1169070776
ci_pipeline_id 78705506 78705506
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-h9n60s19 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-h9n60s19 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:tracing:high_load better
[-753.537µs; -497.875µs] or [-9.121%; -6.026%]		 unstable
[-27.789op/s; +118.914op/s] or [-4.953%; +21.193%]		 7.636ms 606.656op/s 8.262ms 561.094op/s
scenario:load:insecure-bank:iast:high_load better
[-760.953µs; -397.265µs] or [-7.426%; -3.877%]		 unstable
[-28.558op/s; +82.558op/s] or [-6.298%; +18.206%]		 9.667ms 480.469op/s 10.246ms 453.469op/s
scenario:load:petclinic:profiling:high_load worse
[+3.383ms; +4.336ms] or [+7.463%; +9.566%]		 unstable
[-15.466op/s; -0.659op/s] or [-14.979%; -0.638%]		 49.187ms 95.188op/s 45.328ms 103.250op/s
scenario:load:petclinic:code_origins:high_load worse
[+1.400ms; +2.232ms] or [+3.220%; +5.134%]		 unstable
[-11.853op/s; +3.228op/s] or [-11.013%; +2.999%]		 45.295ms 103.312op/s 43.479ms 107.625op/s
scenario:load:petclinic:appsec:high_load better
[-2.124ms; -1.208ms] or [-4.422%; -2.515%]		 unstable
[-4.082op/s; +11.107op/s] or [-4.192%; +11.405%]		 46.381ms 100.900op/s 48.048ms 97.388op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~ab29d63333, baseline=1.55.0-SNAPSHOT~60a3b9d880
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.02 ms) : 35735, 36305
.   : milestone, 36020,
appsec (48.048 ms) : 47603, 48493
.   : milestone, 48048,
code_origins (43.479 ms) : 43098, 43860
.   : milestone, 43479,
iast (44.462 ms) : 44079, 44846
.   : milestone, 44462,
profiling (45.328 ms) : 44904, 45751
.   : milestone, 45328,
tracing (44.183 ms) : 43801, 44564
.   : milestone, 44183,
section candidate
no_agent (36.321 ms) : 36035, 36606
.   : milestone, 36321,
appsec (46.381 ms) : 45976, 46786
.   : milestone, 46381,
code_origins (45.295 ms) : 44903, 45688
.   : milestone, 45295,
iast (44.998 ms) : 44601, 45396
.   : milestone, 44998,
profiling (49.187 ms) : 48726, 49648
.   : milestone, 49187,
tracing (44.404 ms) : 44033, 44775
.   : milestone, 44404,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.02 ms [35.735 ms, 36.305 ms] -
appsec 48.048 ms [47.603 ms, 48.493 ms] 12.028 ms (33.4%)
code_origins 43.479 ms [43.098 ms, 43.86 ms] 7.459 ms (20.7%)
iast 44.462 ms [44.079 ms, 44.846 ms] 8.442 ms (23.4%)
profiling 45.328 ms [44.904 ms, 45.751 ms] 9.308 ms (25.8%)
tracing 44.183 ms [43.801 ms, 44.564 ms] 8.163 ms (22.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.321 ms [36.035 ms, 36.606 ms] -
appsec 46.381 ms [45.976 ms, 46.786 ms] 10.061 ms (27.7%)
code_origins 45.295 ms [44.903 ms, 45.688 ms] 8.974 ms (24.7%)
iast 44.998 ms [44.601 ms, 45.396 ms] 8.678 ms (23.9%)
profiling 49.187 ms [48.726 ms, 49.648 ms] 12.866 ms (35.4%)
tracing 44.404 ms [44.033 ms, 44.775 ms] 8.084 ms (22.3%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~ab29d63333, baseline=1.55.0-SNAPSHOT~60a3b9d880
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.359 ms) : 4304, 4414
.   : milestone, 4359,
iast (10.246 ms) : 10072, 10421
.   : milestone, 10246,
iast_FULL (13.44 ms) : 13179, 13701
.   : milestone, 13440,
iast_GLOBAL (10.937 ms) : 10741, 11132
.   : milestone, 10937,
profiling (8.968 ms) : 8818, 9117
.   : milestone, 8968,
tracing (8.262 ms) : 8133, 8390
.   : milestone, 8262,
section candidate
no_agent (4.44 ms) : 4383, 4497
.   : milestone, 4440,
iast (9.667 ms) : 9505, 9830
.   : milestone, 9667,
iast_FULL (13.771 ms) : 13499, 14043
.   : milestone, 13771,
iast_GLOBAL (11.191 ms) : 10986, 11397
.   : milestone, 11191,
profiling (8.937 ms) : 8787, 9087
.   : milestone, 8937,
tracing (7.636 ms) : 7528, 7744
.   : milestone, 7636,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.359 ms [4.304 ms, 4.414 ms] -
iast 10.246 ms [10.072 ms, 10.421 ms] 5.888 ms (135.1%)
iast_FULL 13.44 ms [13.179 ms, 13.701 ms] 9.081 ms (208.3%)
iast_GLOBAL 10.937 ms [10.741 ms, 11.132 ms] 6.578 ms (150.9%)
profiling 8.968 ms [8.818 ms, 9.117 ms] 4.609 ms (105.7%)
tracing 8.262 ms [8.133 ms, 8.39 ms] 3.903 ms (89.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.44 ms [4.383 ms, 4.497 ms] -
iast 9.667 ms [9.505 ms, 9.83 ms] 5.228 ms (117.8%)
iast_FULL 13.771 ms [13.499 ms, 14.043 ms] 9.332 ms (210.2%)
iast_GLOBAL 11.191 ms [10.986 ms, 11.397 ms] 6.752 ms (152.1%)
profiling 8.937 ms [8.787 ms, 9.087 ms] 4.498 ms (101.3%)
tracing 7.636 ms [7.528 ms, 7.744 ms] 3.196 ms (72.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/repo-index-log-level
git_commit_date 1759910850 1759920700
git_commit_sha 60a3b9d ab29d63
release_version 1.55.0-SNAPSHOT~60a3b9d880 1.55.0-SNAPSHOT~ab29d63333
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1759922714 1759922714
ci_job_id 1169070777 1169070777
ci_pipeline_id 78705506 78705506
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-2i7xvu2n 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-2i7xvu2n 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~ab29d63333, baseline=1.55.0-SNAPSHOT~60a3b9d880
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.72 s) : 15720000, 15720000
.   : milestone, 15720000,
appsec (15.18 s) : 15180000, 15180000
.   : milestone, 15180000,
iast (18.619 s) : 18619000, 18619000
.   : milestone, 18619000,
iast_GLOBAL (18.282 s) : 18282000, 18282000
.   : milestone, 18282000,
profiling (15.062 s) : 15062000, 15062000
.   : milestone, 15062000,
tracing (15.373 s) : 15373000, 15373000
.   : milestone, 15373000,
section candidate
no_agent (14.882 s) : 14882000, 14882000
.   : milestone, 14882000,
appsec (15.204 s) : 15204000, 15204000
.   : milestone, 15204000,
iast (18.689 s) : 18689000, 18689000
.   : milestone, 18689000,
iast_GLOBAL (17.711 s) : 17711000, 17711000
.   : milestone, 17711000,
profiling (15.491 s) : 15491000, 15491000
.   : milestone, 15491000,
tracing (15.276 s) : 15276000, 15276000
.   : milestone, 15276000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.72 s [15.72 s, 15.72 s] -
appsec 15.18 s [15.18 s, 15.18 s] -540.0 ms (-3.4%)
iast 18.619 s [18.619 s, 18.619 s] 2.899 s (18.4%)
iast_GLOBAL 18.282 s [18.282 s, 18.282 s] 2.562 s (16.3%)
profiling 15.062 s [15.062 s, 15.062 s] -658.0 ms (-4.2%)
tracing 15.373 s [15.373 s, 15.373 s] -347.0 ms (-2.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.882 s [14.882 s, 14.882 s] -
appsec 15.204 s [15.204 s, 15.204 s] 322.0 ms (2.2%)
iast 18.689 s [18.689 s, 18.689 s] 3.807 s (25.6%)
iast_GLOBAL 17.711 s [17.711 s, 17.711 s] 2.829 s (19.0%)
profiling 15.491 s [15.491 s, 15.491 s] 609.0 ms (4.1%)
tracing 15.276 s [15.276 s, 15.276 s] 394.0 ms (2.6%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~ab29d63333, baseline=1.55.0-SNAPSHOT~60a3b9d880
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.48 ms) : 1468, 1492
.   : milestone, 1480,
appsec (3.698 ms) : 3483, 3913
.   : milestone, 3698,
iast (2.216 ms) : 2152, 2280
.   : milestone, 2216,
iast_GLOBAL (2.273 ms) : 2209, 2338
.   : milestone, 2273,
profiling (2.07 ms) : 2019, 2122
.   : milestone, 2070,
tracing (2.025 ms) : 1975, 2074
.   : milestone, 2025,
section candidate
no_agent (1.478 ms) : 1466, 1489
.   : milestone, 1478,
appsec (3.731 ms) : 3512, 3950
.   : milestone, 3731,
iast (2.219 ms) : 2155, 2283
.   : milestone, 2219,
iast_GLOBAL (2.268 ms) : 2203, 2332
.   : milestone, 2268,
profiling (2.089 ms) : 2036, 2142
.   : milestone, 2089,
tracing (2.044 ms) : 1994, 2094
.   : milestone, 2044,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.468 ms, 1.492 ms] -
appsec 3.698 ms [3.483 ms, 3.913 ms] 2.218 ms (149.9%)
iast 2.216 ms [2.152 ms, 2.28 ms] 735.909 µs (49.7%)
iast_GLOBAL 2.273 ms [2.209 ms, 2.338 ms] 793.458 µs (53.6%)
profiling 2.07 ms [2.019 ms, 2.122 ms] 590.436 µs (39.9%)
tracing 2.025 ms [1.975 ms, 2.074 ms] 545.072 µs (36.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.466 ms, 1.489 ms] -
appsec 3.731 ms [3.512 ms, 3.95 ms] 2.253 ms (152.5%)
iast 2.219 ms [2.155 ms, 2.283 ms] 741.403 µs (50.2%)
iast_GLOBAL 2.268 ms [2.203 ms, 2.332 ms] 789.69 µs (53.4%)
profiling 2.089 ms [2.036 ms, 2.142 ms] 611.149 µs (41.4%)
tracing 2.044 ms [1.994 ms, 2.094 ms] 565.908 µs (38.3%)

@daniel-mohedano daniel-mohedano marked this pull request as ready for review October 8, 2025 11:40
@daniel-mohedano daniel-mohedano requested a review from a team as a code owner October 8, 2025 11:40
nikita-tkachenko-datadog
nikita-tkachenko-datadog approved these changes Oct 8, 2025
View reviewed changes
dd-java-agent/instrumentation/junit/junit-4.10/src/test/groovy/JUnit4Test.groovy
Comment on lines +80 to +88
"test-failed" | false | [TestFailed] | []
"test-retry-failed" | false | [TestFailed] | [new TestFQN("org.example.TestFailed", "test_failed")]
// "test-failed-then-succeed" | true | [TestFailedThenSucceed] | [new TestFQN("org.example.TestFailedThenSucceed", "test_failed_then_succeed")]
// "test-assumption-is-not-retried" | true | [TestAssumption] | [new TestFQN("org.example.TestAssumption", "test_fail_assumption")]
// "test-skipped-is-not-retried" | true | [TestSkipped] | [new TestFQN("org.example.TestSkipped", "test_skipped")]
// "test-retry-parameterized" | false | [TestFailedParameterized] | [
// new TestFQN("org.example.TestFailedParameterized", "test_failed_parameterized") /* backend cannot provide parameters for flaky parameterized tests yet */
// ]
// "test-expected-exception-is-not-retried" | true | [TestSucceedExpectedException] | [new TestFQN("org.example.TestSucceedExpectedException", "test_succeed")]
"test-failed-then-succeed" | true | [TestFailedThenSucceed] | [new TestFQN("org.example.TestFailedThenSucceed", "test_failed_then_succeed")]
"test-assumption-is-not-retried" | true | [TestAssumption] | [new TestFQN("org.example.TestAssumption", "test_fail_assumption")]
"test-skipped-is-not-retried" | true | [TestSkipped] | [new TestFQN("org.example.TestSkipped", "test_skipped")]
"test-retry-parameterized" | false | [TestFailedParameterized] | [
new TestFQN("org.example.TestFailedParameterized", "test_failed_parameterized") /* backend cannot provide parameters for flaky parameterized tests yet */
]
"test-expected-exception-is-not-retried" | true | [TestSucceedExpectedException] | [new TestFQN("org.example.TestSucceedExpectedException", "test_succeed")]
Copy link
Contributor

@nikita-tkachenko-datadog nikita-tkachenko-datadog Oct 8, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ouch!

@daniel-mohedano daniel-mohedano merged commit 113e707 into master Oct 8, 2025
536 checks passed
@daniel-mohedano daniel-mohedano deleted the daniel.mohedano/repo-index-log-level branch October 8, 2025 11:50
@github-actions github-actions bot added this to the 1.55.0 milestone Oct 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@nikita-tkachenko-datadog nikita-tkachenko-datadog nikita-tkachenko-datadog approved these changes

Assignees

No one assigned

Labels

comp: ci visibility Continuous Integration Visibility type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.55.0

Development

Successfully merging this pull request may close these issues.

3 participants

@daniel-mohedano @nikita-tkachenko-datadog