You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "Dandandan (via GitHub)" <gi...@apache.org> on 2026/03/07 08:25:50 UTC

Re: [I] Manage group values and states by blocks in aggregation [datafusion]

Dandandan commented on issue #11931:
URL: https://github.com/apache/datafusion/issues/11931#issuecomment-4015952467

   Implementing this aggregation approach https://github.com/apache/datafusion/issues/20773 would also contribute to keeping the state small per aggregation in the partial aggregate (and hopefully improves performance). The approach could be repeated in final / final partitioned aggregation (not sure why it is not done in the paper, I guess because in 90% cases the reduction factor and partitioning reduces the number of distinct values enough to make the final aggregate small.
   
   While still a large feature to implement, I think implementing it might be more local to aggregation (no changes needed to groupvalues / accumulators, etc...)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org