Skip to content

Conversation

@Jackie-Jiang
Copy link
Contributor

Description

Allow broker to override expressions in query automatically if configured in the query config.

In certain scenarios, users cannot control the queries sent to pinot (e.g. queries are auto-generated by some other tools), then they can use this feature to override the expressions within the query to the desired ones by putting the query config (e.g. override transform function to derived column).

Release Notes

Add a new config expressionOverrideMap under the QueryConfig

@Jackie-Jiang Jackie-Jiang added feature release-notes Referenced by PRs that need attention when compiling the next release notes labels Mar 8, 2022
@codecov-commenter
Copy link

Codecov Report

Merging #8319 (3873136) into master (8bde29e) will decrease coverage by 42.05%.
The diff coverage is 62.19%.

❗ Current head 3873136 differs from pull request most recent head 1ea7fe8. Consider uploading reports for the commit 1ea7fe8 to get more accurate results

Impacted file tree graph

@@              Coverage Diff              @@
##             master    #8319       +/-   ##
=============================================
- Coverage     70.87%   28.82%   -42.06%     
=============================================
  Files          1635     1623       -12     
  Lines         85676    85393      -283     
  Branches      12900    12876       -24     
=============================================
- Hits          60726    24616    -36110     
- Misses        20758    58507    +37749     
+ Partials       4192     2270     -1922     
Flag Coverage Δ
integration1 28.82% <62.19%> (-0.11%) ⬇️
integration2 ?
unittests1 ?
unittests2 ?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
...org/apache/pinot/spi/config/table/QueryConfig.java 0.00% <0.00%> (-85.72%) ⬇️
...pache/pinot/common/config/provider/TableCache.java 75.21% <65.78%> (-2.95%) ⬇️
...roker/requesthandler/BaseBrokerRequestHandler.java 61.50% <74.28%> (-10.35%) ⬇️
.../java/org/apache/pinot/spi/utils/BooleanUtils.java 0.00% <0.00%> (-100.00%) ⬇️
...ava/org/apache/pinot/spi/config/table/FSTType.java 0.00% <0.00%> (-100.00%) ⬇️
...ava/org/apache/pinot/spi/data/MetricFieldSpec.java 0.00% <0.00%> (-100.00%) ⬇️
...va/org/apache/pinot/spi/utils/BigDecimalUtils.java 0.00% <0.00%> (-100.00%) ⬇️
...java/org/apache/pinot/common/tier/TierFactory.java 0.00% <0.00%> (-100.00%) ⬇️
...a/org/apache/pinot/spi/config/table/TableType.java 0.00% <0.00%> (-100.00%) ⬇️
.../org/apache/pinot/spi/data/DimensionFieldSpec.java 0.00% <0.00%> (-100.00%) ⬇️
... and 1180 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8bde29e...1ea7fe8. Read the comment docs.

@Jackie-Jiang Jackie-Jiang merged commit 1150305 into apache:master Mar 9, 2022
@Jackie-Jiang Jackie-Jiang deleted the expression_override branch March 9, 2022 03:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

feature release-notes Referenced by PRs that need attention when compiling the next release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants