You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Gopal V (JIRA)" <ji...@apache.org> on 2015/08/27 07:49:45 UTC
[jira] [Commented] (HIVE-10175) DynamicPartitionPruning lacks a
fast-path exit for large IN() queries
[ https://issues.apache.org/jira/browse/HIVE-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716123#comment-14716123 ]
Gopal V commented on HIVE-10175:
--------------------------------
[~hagleitn]: Review please?
> DynamicPartitionPruning lacks a fast-path exit for large IN() queries
> ---------------------------------------------------------------------
>
> Key: HIVE-10175
> URL: https://issues.apache.org/jira/browse/HIVE-10175
> Project: Hive
> Issue Type: Bug
> Components: Physical Optimizer, Tez
> Affects Versions: 1.2.0
> Reporter: Gopal V
> Assignee: Gopal V
> Priority: Minor
> Attachments: HIVE-10175.1.patch, HIVE-10175.profile.html
>
>
> TezCompiler::runDynamicPartitionPruning() & ppr.PartitionPruner() calls the graph walker even if all tables provided to the optimizer are unpartitioned (or temporary) tables.
> This makes it extremely slow as it will walk & inspect a large/complex FilterOperator later in the pipeline.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)