Skip to content

Remove "experimental" label from compaction supervisors and MSQ compaction engine#19113

Merged
kfaraz merged 7 commits into
apache:masterfrom
kfaraz:update_comp_supe_docs
Mar 11, 2026
Merged

Remove "experimental" label from compaction supervisors and MSQ compaction engine#19113
kfaraz merged 7 commits into
apache:masterfrom
kfaraz:update_comp_supe_docs

Conversation

@kfaraz

@kfaraz kfaraz commented Mar 9, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Changes

  • Remove experimental tag from compaction supervisors and MSQ compaction engine
  • Update docs and remove mention of old properties
  • Override default engine in provided in the supervisor spec

This PR has:

  • been self-reviewed.
  • added documentation for new or modified features or behaviors.
  • a release note entry in the PR description.
  • added Javadocs for most classes and all non-trivial methods. Linked related entities via Javadoc links.
  • added or updated version, license, or notice information in licenses.yaml
  • added comments explaining the "why" and the intent of the code wherever would not be obvious for an unfamiliar reader.
  • added unit tests or modified existing tests to cover new code paths, ensuring the threshold for code coverage is met.
  • added integration tests.
  • been tested in a test Druid cluster.

@kfaraz kfaraz mentioned this pull request Mar 9, 2026
Open
@kfaraz kfaraz changed the title Allow default engine override in compaction supervisor and fix docs Remove "experimental" label from compaction supervisors and MSQ compaction engine Mar 9, 2026
@kfaraz

kfaraz commented Mar 9, 2026

Copy link
Copy Markdown
Contributor Author

Thanks for the review, @capistrant !

Failures seem genuine, will take a look tomorrow.

@abhishekrb19

abhishekrb19 commented Mar 10, 2026

Copy link
Copy Markdown
Contributor

@kfaraz I'm wondering if there’s anything in the documented MSQ task engine limitations that is no longer relevant now that it’s the default engine and mostly compatible with the Coordinator's native auto-compaction mechanism when users are considering migration (for example, supported aggregators in native vs MSQ).

@kfaraz

kfaraz commented Mar 11, 2026

Copy link
Copy Markdown
Contributor Author

@abhishekrb19 , AFAIK, these are limitations of the MSQ engine which are still applicable.

@kfaraz
kfaraz merged commit 8c75ad6 into apache:master Mar 11, 2026
87 of 89 checks passed
@kfaraz
kfaraz deleted the update_comp_supe_docs branch March 11, 2026 04:10
@github-actions github-actions Bot added this to the 37.0.0 milestone Mar 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@capistrant capistrant capistrant approved these changes

Assignees

No one assigned

Labels

Area - Documentation Area - Ingestion Release Notes

Projects

None yet

Milestone

37.0.0

Development

Successfully merging this pull request may close these issues.

3 participants

@kfaraz @abhishekrb19 @capistrant