[GitHub] [spark] cloud-fan commented on pull request #35873: [SPARK-38560][SQL] If `Sum`, `Count`, `Any` accompany with distinct, cannot do partial agg push down.

[GitBox <gi...@apache.org>]

cloud-fan commented on pull request #35873:
URL: https://github.com/apache/spark/pull/35873#issuecomment-1069195665


   I don't think it's a problem of JDBC v2. It's a problem of the pushdown framework. Distinct aggregate functions have very special planning rule and it's very complicated to do partial pushdown.
   
   My suggestion is to only do complete pushdown if there exists distinct aggregate functions, in the pushdown framework.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org