You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "jiahong.li (Jira)" <ji...@apache.org> on 2021/01/11 07:16:00 UTC
[jira] [Created] (SPARK-34067) PartitionPruning push down
pruningHasBenefit function into insertPredicate function to decrease
calculate time
jiahong.li created SPARK-34067:
----------------------------------
Summary: PartitionPruning push down pruningHasBenefit function into insertPredicate function to decrease calculate time
Key: SPARK-34067
URL: https://issues.apache.org/jira/browse/SPARK-34067
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.0.1, 3.0.0
Reporter: jiahong.li
in the class PartitionPruning, function prune, push pruningHasBenefit function into insertPredicate function, as `SQLConf.get.exchangeReuseEnabled` is always true default and `SQLConf.get.dynamicPartitionPruningReuseBroadcastOnly ` is always true default.
by set hasBenefit to lazy ,we can do not need invoke hasBenefit ,so we can save time.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org