Skip to content

[APMLP-1090] Remove JRuby from CI matrix#5594

Merged
Strech merged 8 commits into
masterfrom
apmlp-1090-remove-jruby-from-ci-matrix
Apr 15, 2026
Merged

[APMLP-1090] Remove JRuby from CI matrix#5594
Strech merged 8 commits into
masterfrom
apmlp-1090-remove-jruby-from-ci-matrix

Conversation

@Strech

@Strech Strech commented Apr 15, 2026

Copy link
Copy Markdown
Member

What does this PR do?

Removes all the version of JRuby from CI matrix with all relevant assets

Motivation:

This is a last step of the Sunsetting JRuby support RFC

Change log entry

Yes. Core: Removed JRuby from the CI test matrix

Additional Notes:

Maybe I forgot some Gitlab parts, but we will see.

How to test the change?

CI should be enough.

Strech and others added 7 commits April 15, 2026 11:40
@Strech @claude
Remove JRuby 9.2 from CI matrix
293f505 
Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
@Strech @claude
Remove JRuby 9.3 from CI matrix
53ce95e 
Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
@Strech @claude
Remove JRuby 9.4 from CI matrix
e1f7469 
Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
@Strech @claude
Remove JRuby column from Matrixfile
1dd9f2b 
Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
@Strech @claude
Clean up JRuby references in _unit_test.yml
b5c83af 
Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
@Strech @claude
Clean up JRuby logic from rake tasks
0065c4b 
Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
@Strech @claude
Remove JRuby columns from update_supported_versions.rb
976df49 
Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
@datadog-datadog-prod-us1-2

datadog-datadog-prod-us1-2 Bot commented Apr 15, 2026 •
edited
Loading

Copy link
Copy Markdown

✅ Tests

🎉 All green!

❄️ No new flaky tests detected
🧪 All tests passed

🎯 Code Coverage (details)
• Patch Coverage: 100.00%
• Overall Coverage: 97.26% (+0.88%)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 0858454 | Docs | Datadog PR Page | Was this helpful? React with 👍/👎 or give us feedback!

@Strech
Strech force-pushed the apmlp-1090-remove-jruby-from-ci-matrix branch from ae55c9a to 976df49 Compare April 15, 2026 13:01
@Strech
Strech marked this pull request as ready for review April 15, 2026 13:28
@Strech
Strech requested a review from a team as a code owner April 15, 2026 13:28
@pr-commenter

pr-commenter Bot commented Apr 15, 2026

Copy link
Copy Markdown

Benchmarks

Benchmark execution time: 2026-04-15 14:01:30

Comparing candidate commit 0858454 in PR branch apmlp-1090-remove-jruby-from-ci-matrix with baseline commit 7e8c031 in branch master.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 45 metrics, 1 unstable metrics.

Explanation

This is an A/B test comparing a candidate commit's performance against that of a baseline commit. Performance changes are noted in the tables below as:

  • 🟩 = significantly better candidate vs. baseline
  • 🟥 = significantly worse candidate vs. baseline

We compute a confidence interval (CI) over the relative difference of means between metrics from the candidate and baseline commits, considering the baseline as the reference.

If the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD), the change is considered significant.

Feel free to reach out to #apm-benchmarking-platform on Slack if you have any questions.

More details about the CI and significant changes

You can imagine this CI as a range of values that is likely to contain the true difference of means between the candidate and baseline commits.

CIs of the difference of means are often centered around 0%, because often changes are not that big:

---------------------------------(------|---^--------)-------------------------------->
                              -0.6%    0%  0.3%     +1.2%
                                 |          |        |
         lower bound of the CI --'          |        |
sample mean (center of the CI) -------------'        |
         upper bound of the CI ----------------------'

As described above, a change is considered significant if the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD).

For instance, for an execution time metric, this confidence interval indicates a significantly worse performance:

----------------------------------------|---------|---(---------^---------)---------->
                                       0%        1%  1.3%      2.2%      3.1%
                                                  |   |         |         |
       significant impact threshold --------------'   |         |         |
                      lower bound of CI --------------'         |         |
       sample mean (center of the CI) --------------------------'         |
                      upper bound of CI ----------------------------------'

@Strech
Strech merged commit d8cd6b8 into master Apr 15, 2026
592 checks passed
@Strech
Strech deleted the apmlp-1090-remove-jruby-from-ci-matrix branch April 15, 2026 14:06
@github-actions github-actions Bot added this to the 2.31.0 milestone Apr 15, 2026
@ivoanjo

ivoanjo commented Apr 15, 2026

Copy link
Copy Markdown
Member

Thanks for looking into this one! 🙏

@y9v y9v mentioned this pull request Apr 16, 2026
Closed
@anmarchenko anmarchenko mentioned this pull request Apr 20, 2026
Merged
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@anmarchenko anmarchenko anmarchenko approved these changes
@y9v y9v y9v approved these changes
@vpellan vpellan vpellan approved these changes
@p-datadog p-datadog p-datadog approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

2.31.0

Development

Successfully merging this pull request may close these issues.

6 participants

@Strech @ivoanjo @anmarchenko @y9v @vpellan @p-datadog