You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Yi Zhang (Jira)" <ji...@apache.org> on 2023/03/16 21:04:00 UTC

[jira] [Created] (HIVE-27149) StorageHandler PPD query planning statistics not adjusted for residualPredicate

Yi Zhang created HIVE-27149:
-------------------------------

             Summary: StorageHandler PPD query planning statistics not adjusted for residualPredicate
                 Key: HIVE-27149
                 URL: https://issues.apache.org/jira/browse/HIVE-27149
             Project: Hive
          Issue Type: Bug
          Components: StorageHandler
    Affects Versions: 4.0.0-alpha-2
            Reporter: Yi Zhang


In StorageHandler PPD, filter predicates can be pushed down to storage and trimmed to a subset residualPredicate, however, at query planning statistics based on filters only consider the 'final' residual predicates, when in fact there are pushedPredicates that should also be considered, this affect reducer parallelism (more reducers than needed)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)