[GitHub] [spark] sunchao commented on pull request #32583: [SPARK-35437][SQL] Use expressions to filter Hive partitions at client side

[GitBox <gi...@apache.org>]

sunchao commented on pull request #32583:
URL: https://github.com/apache/spark/pull/32583#issuecomment-893623832


   > Hive: Time taken: 2.816 seconds, Fetched: 10 row(s)
   > Spark: Time taken: 248 seconds, Fetched: 10 row(s)
   > Patch and verify:
   > Time taken: 19.241 seconds, Fetched 10 row(s)
   
   @cxzl25 I'm a little surprised that Hive is still so much faster than Spark even with the patch. Curious if you have any insight on this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org