You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2020/09/07 10:11:11 UTC

[GitHub] [spark] gengliangwang commented on pull request #29564: [WIP][SPARK-32708] Query optimization fails to reuse exchange with DataSourceV2

gengliangwang commented on pull request #29564:
URL: https://github.com/apache/spark/pull/29564#issuecomment-688222654


   In Branch 3.0, there is a mixed-in trait `SupportsPushDownFilters` which is introduced by https://github.com/apache/spark/pull/19136 and https://github.com/apache/spark/pull/19424 .
   
   However, if we are going to cherry-pick the PRs mentioned above, then there will be reasons to cherry-pick the other data source V2 related PRs into 2.4 as well. 
   @mingjialiu is there a strong reason to use data source v2 on branch 2.4 instead of 3.0? There seems quite some work to sync DS v2 api changes to branch 2.4
   cc @cloud-fan as well.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org