You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit fe1ca24
Browse filesBrowse the repository at this point in the historyBrowse files
feat(datafusion): add grouped update metric and update_batch_grouped for accumulators
This change introduces two new methods to the Accumulator trait:
1. `grouped_update_batch_metric`: Returns an optional metric that can be used to time grouped updates once per batch instead of per group.
2. `update_batch_grouped`: Updates state when called by a grouped accumulator adapter, with support for using the grouped update metric.
The GroupsAccumulatorAdapter now uses these new methods to avoid timing every per-group call, recording one interval for the full batch instead. This reduces the overhead of metric collection when there are many groups.
DistinctArrayAggAccumulator is updated to take advantage of the new grouped update functionality, skipping per-group timing for deduplication operations.
This refactor improves performance for grouped aggregations by making metric collection proportional to batch count rather than group cardinality.
0 commit comments