[jira] [Commented] (IMPALA-10763) Min/max filters should be enabled on Z-order sorted columns

["ASF subversion and git services (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381650#comment-17381650 ] 

ASF subversion and git services commented on IMPALA-10763:
----------------------------------------------------------

Commit 36d8e6766e3f1ce133a86b3edc5fee34e5e71cc7 in impala's branch refs/heads/master from Qifan Chen
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=36d8e67 ]

IMPALA-10763: Min/max filters should be enabled on Z-order sorted columns

This patch enables min/max filtering on any Z-order sort-by columns
by default.

Since the column stats for a row group or a page is computed from the
column values stored in the row group or the page, the current
infrastructure for min/max filtering works for the Z-order out of box.
The fact that these column values are ordered by Z-order is
orthogonal to the work of min/max filtering.

By default, the new feature is enabled. Set the existing control knob
minmax_filter_sorted_columns to false to turn it off.

Testing
  1. Added new z-order related sort column tests in
     overlap_min_max_filters_on_sorted_columns.test;
  2. Ran core-test.

Change-Id: I2a528ffbd0e333721ef38b4be7d4ddcdbf188adf
Reviewed-on: http://gerrit.cloudera.org:8080/17635
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> Min/max filters should be enabled on Z-order sorted columns
> -----------------------------------------------------------
>
>                 Key: IMPALA-10763
>                 URL: https://issues.apache.org/jira/browse/IMPALA-10763
>             Project: IMPALA
>          Issue Type: Test
>            Reporter: Qifan Chen
>            Assignee: Qifan Chen
>            Priority: Major
>
> Currently, min/max filters are enabled for lexically sorted columns (please refer to 
> IMPALA-10709: Min/max filters should be enabled for joins on sorted columns in Parquet tables) with a limitation that only the leading sorted columns are assigned with min/max filters. Non-leading sorted columns will be ignored. 
> To effectively handle multiple sort columns, Impala offers an alternative sort order called Z-order. Z-order sorts these columns in multi-dimension into a sequence of values such that the locality of the data points are preserved. 
> The purpose of this JIRA is to integrate the min/max filter feature with a table with Z-order sorted columns. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org