Skip to content

Conversation

@gortiz
Copy link
Contributor

@gortiz gortiz commented Apr 30, 2024

This PR adds 4 new metrics:

  1. queriesWithJoins (global): How many queries with joins have been executed. For each query with at least one join, this meter is increased exactly once.
  2. joinCount (global): How many joins have been executed. For each query with at least one join, this meter is increased as many times as joins in the query.
  3. queriesWithWindow (global): How many queries with window functions have been executed. For each query with at least one window function, this meter is increased exactly once.
  4. windowCount (global): How many window functions have been executed. For each query with at least one window function, this meter is increased as many times as window functions in the query.

@codecov-commenter
Copy link

codecov-commenter commented Apr 30, 2024

Codecov Report

Attention: Patch coverage is 40.00000% with 57 lines in your changes missing coverage. Please review.

Project coverage is 62.03%. Comparing base (59551e4) to head (0b2b3d9).
Report is 554 commits behind head on master.

Files Patch % Lines
...he/pinot/spi/metrics/NoopPinotMetricsRegistry.java 2.32% 42 Missing ⚠️
...t/spi/annotations/metrics/PinotMetricsFactory.java 22.22% 7 Missing ⚠️
...org/apache/pinot/common/metrics/MinionMetrics.java 0.00% 3 Missing ⚠️
...org/apache/pinot/spi/metrics/PinotMetricUtils.java 62.50% 1 Missing and 2 partials ⚠️
...apache/pinot/common/metrics/ControllerMetrics.java 66.66% 1 Missing ⚠️
...uery/planner/logical/PinotLogicalQueryPlanner.java 92.85% 0 Missing and 1 partial ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##             master   #13032      +/-   ##
============================================
+ Coverage     61.75%   62.03%   +0.28%     
+ Complexity      207      198       -9     
============================================
  Files          2436     2540     +104     
  Lines        133233   139591    +6358     
  Branches      20636    21597     +961     
============================================
+ Hits          82274    86601    +4327     
- Misses        44911    46500    +1589     
- Partials       6048     6490     +442     
Flag Coverage Δ
custom-integration1 <0.01% <0.00%> (-0.01%) ⬇️
integration <0.01% <0.00%> (-0.01%) ⬇️
integration1 <0.01% <0.00%> (-0.01%) ⬇️
integration2 0.00% <0.00%> (ø)
java-11 61.97% <40.00%> (+0.26%) ⬆️
java-21 61.93% <40.00%> (+0.30%) ⬆️
skip-bytebuffers-false 62.00% <40.00%> (+0.26%) ⬆️
skip-bytebuffers-true 61.90% <40.00%> (+34.17%) ⬆️
temurin 62.03% <40.00%> (+0.28%) ⬆️
unittests 62.03% <40.00%> (+0.28%) ⬆️
unittests1 46.56% <40.00%> (-0.33%) ⬇️
unittests2 27.76% <0.00%> (+0.03%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@Jackie-Jiang Jackie-Jiang added metrics observability multi-stage Related to the multi-stage query engine labels Apr 30, 2024
@gortiz gortiz requested a review from Jackie-Jiang May 20, 2024 13:50
Copy link
Contributor

@Jackie-Jiang Jackie-Jiang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please take a look at the failed tests

@gortiz gortiz force-pushed the join-metrics branch 2 times, most recently from a2ca1c9 to 10c38b3 Compare June 5, 2024 07:31
@gortiz gortiz merged commit bdef83b into apache:master Jun 5, 2024
@gortiz gortiz deleted the join-metrics branch June 5, 2024 09:20
gortiz added a commit to gortiz/pinot that referenced this pull request Jun 14, 2024
This PR adds 4 new metrics:

* queriesWithJoins (global): How many queries with joins have been executed. For each query with at least one join, this meter is increased exactly once.
* joinCount (global): How many joins have been executed. For each query with at least one join, this meter is increased as many times as joins in the query.
* queriesWithWindow (global): How many queries with window functions have been executed. For each query with at least one window function, this meter is increased exactly once.
* windowCount (global): How many window functions have been executed. For each query with at least one window function, this meter is increased as many times as window functions in the query.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

metrics multi-stage Related to the multi-stage query engine observability

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants