You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2019/01/11 07:19:25 UTC
[GitHub] eatoncys opened a new pull request #23517:
[SPARK-26599][SQL]BroardCast hint can not work with PruneFileSourcePartitions
eatoncys opened a new pull request #23517: [SPARK-26599][SQL]BroardCast hint can not work with PruneFileSourcePartitions
URL: https://github.com/apache/spark/pull/23517
## What changes were proposed in this pull request?
BroardCast hint can not work with `PruneFileSourcePartitions`, for example, when the filter condition p is a partition field, table b in SQL below cannot be broadcast.
` sql("select /*+ broadcastjoin(b) */ * from (select a from empty_test where p=1) a " +
"join (select a,b from par_1 where p=1) b on a.a=b.a").explain`
The reason is that `PruneFileSourcePartitions ` deleted `ResolvedHint ` when matching `PhysicalOperations`, the plan after `PruneFileSourcePartitions ` before this PR is:

This PR adds processing to `ResolvedHint `, when matched to it, skip it directly and parse its child nodes.
## How was this patch tested?
Unit test of `PruneFileSourcePartitionsSuite`
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org