You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hive.apache.org by "Yi Zhang (Jira)" <ji...@apache.org> on 2023/03/16 21:04:00 UTC

[jira] [Updated] (HIVE-27149) StorageHandler PPD query planning statistics not adjusted for pushedPredicate

     [ https://issues.apache.org/jira/browse/HIVE-27149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yi Zhang updated HIVE-27149:
----------------------------
    Summary: StorageHandler PPD query planning statistics not adjusted for pushedPredicate  (was: StorageHandler PPD query planning statistics not adjusted for residualPredicate)

> StorageHandler PPD query planning statistics not adjusted for pushedPredicate
> -----------------------------------------------------------------------------
>
>                 Key: HIVE-27149
>                 URL: https://issues.apache.org/jira/browse/HIVE-27149
>             Project: Hive
>          Issue Type: Bug
>          Components: StorageHandler
>    Affects Versions: 4.0.0-alpha-2
>            Reporter: Yi Zhang
>            Priority: Minor
>
> In StorageHandler PPD, filter predicates can be pushed down to storage and trimmed to a subset residualPredicate, however, at query planning statistics based on filters only consider the 'final' residual predicates, when in fact there are pushedPredicates that should also be considered, this affect reducer parallelism (more reducers than needed)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)