Skip to content

Conversation

@shauryachats
Copy link
Collaborator

This PR adds support for setting default values for several query execution options at the broker level, including:

  • usePhysicalOptimizer
  • useLiteMode
  • runInBroker
  • useBrokerPruning
  • liteModeServerStageLimit

These values are now configurable via pinot-broker.conf and can still be overridden per query. The changes ensure consistent behavior across components like QueryEnvironment and PhysicalPlannerContext, replacing hardcoded defaults with configurable ones.

@shauryachats shauryachats changed the title Add Broker Config Defaults for Physical Optimizer and Lite Mode Settings Add broker config defaults for physical optimizer and lite mode settings Jun 30, 2025
@ankitsultana ankitsultana changed the title Add broker config defaults for physical optimizer and lite mode settings [multistage] Add broker config defaults for physical optimizer and lite mode settings Jun 30, 2025
@ankitsultana ankitsultana added multi-stage Related to the multi-stage query engine mse-physical-optimizer mse-lite-mode labels Jun 30, 2025
@codecov-commenter
Copy link

codecov-commenter commented Jun 30, 2025

Codecov Report

Attention: Patch coverage is 64.00000% with 18 lines in your changes missing coverage. Please review.

Project coverage is 63.19%. Comparing base (1a476de) to head (b876967).
Report is 374 commits behind head on master.

Files with missing lines Patch % Lines
...requesthandler/MultiStageBrokerRequestHandler.java 0.00% 10 Missing ⚠️
...he/pinot/query/context/PhysicalPlannerContext.java 66.66% 4 Missing ⚠️
.../physical/v2/opt/rules/LiteModeSortInsertRule.java 66.66% 1 Missing and 1 partial ⚠️
...e/pinot/common/utils/config/QueryOptionsUtils.java 90.00% 0 Missing and 1 partial ⚠️
...al/v2/opt/rules/LeafStageWorkerAssignmentRule.java 0.00% 0 Missing and 1 partial ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##             master   #16240      +/-   ##
============================================
+ Coverage     62.90%   63.19%   +0.28%     
+ Complexity     1386     1362      -24     
============================================
  Files          2867     2960      +93     
  Lines        163354   171029    +7675     
  Branches      24952    26179    +1227     
============================================
+ Hits         102755   108078    +5323     
- Misses        52847    54767    +1920     
- Partials       7752     8184     +432     
Flag Coverage Δ
custom-integration1 100.00% <ø> (ø)
integration 100.00% <ø> (ø)
integration1 100.00% <ø> (ø)
integration2 0.00% <ø> (ø)
java-11 63.16% <64.00%> (+0.29%) ⬆️
java-21 63.16% <64.00%> (+0.33%) ⬆️
skip-bytebuffers-false ?
skip-bytebuffers-true ?
temurin 63.19% <64.00%> (+0.28%) ⬆️
unittests 63.18% <64.00%> (+0.28%) ⬆️
unittests1 64.74% <80.00%> (+8.92%) ⬆️
unittests2 33.40% <16.00%> (-0.17%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@ankitsultana ankitsultana merged commit acbc35b into apache:master Jul 1, 2025
18 checks passed
@shauryachats shauryachats deleted the query_options_from_broker branch July 1, 2025 02:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

mse-lite-mode mse-physical-optimizer multi-stage Related to the multi-stage query engine

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants