You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2023/11/02 00:04:00 UTC

[jira] [Commented] (IMPALA-10325) Parquet scan should use min/max statistics to skip pages based on equi-join predicate

    [ https://issues.apache.org/jira/browse/IMPALA-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17781937#comment-17781937 ] 

ASF subversion and git services commented on IMPALA-10325:
----------------------------------------------------------

Commit 27b45ad32ab72af266be8b7d28aa9761c85e5219 in impala's branch refs/heads/master from Eyizoha
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=27b45ad32 ]

IMPALA-12508: Update query option "enabled_runtime_filter_types" comments

The query option "enabled_runtime_filter_types" currently allows
specifying a comma-separated list of runtime filter types (including
BLOOM, MIN_MAX and IN_LIST) to enable or setting it to "all" to use all
types. But the comment for this query option does not mention IN_LIST
and states that it only applies to Kudu, which is outdated, as it also
affects HDFS scans after IMPALA-10325.

Therefore, this patch update the relevant comments to avoid any
misleading caused by the outdated comments.

Change-Id: Iecff7c655e273712d851d9ce94ef5713e579aa72
Reviewed-on: http://gerrit.cloudera.org:8080/20627
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> Parquet scan should use min/max statistics to skip pages based on equi-join predicate
> -------------------------------------------------------------------------------------
>
>                 Key: IMPALA-10325
>                 URL: https://issues.apache.org/jira/browse/IMPALA-10325
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Backend
>            Reporter: Qifan Chen
>            Assignee: Qifan Chen
>            Priority: Major
>             Fix For: Impala 4.0.0
>
>
> Parquet stores min/max stats for pages which can be used to skip certain pages if they don't qualify an equi-join predicate. 
> The query below ends up scanning all rows for table a, which may not be needed if the min/max of b.ss_addr_sk can be detected and used during the scan of a. 
> {code:java}
> select a.ss_sold_time_sk from
> store_sales a join [SHUFFLE] store_sales b
> where a.ss_addr_sk = b.ss_addr_sk and
> b.ss_customer_sk < 10
> ;
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org