[jira] [Resolved] (IMPALA-12601) Add a fully partitioned TPC-DS dataset for planner tests

["Riza Suminto (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IMPALA-12601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Riza Suminto resolved IMPALA-12601.
-----------------------------------
    Fix Version/s: Impala 4.4.0
       Resolution: Fixed

> Add a fully partitioned TPC-DS dataset for planner tests
> --------------------------------------------------------
>
>                 Key: IMPALA-12601
>                 URL: https://issues.apache.org/jira/browse/IMPALA-12601
>             Project: IMPALA
>          Issue Type: Test
>          Components: Infrastructure
>    Affects Versions: Impala 4.3.0
>            Reporter: Riza Suminto
>            Assignee: Riza Suminto
>            Priority: Major
>             Fix For: Impala 4.4.0
>
>
> testdata/datasets/tpcds only have store_sales table fully-partitioned and leave other facts table unpartitioned. This is probably intended for faster data loading during test. However, this is not an accurate reflection of larger scale TPC-DS dataset where all facts tables are partitioned. Impala planner may change the detail of query plan if partition column exist.
> Today, Impala can load a small scale, fully-partitioned TPC-DS dataset in parquet format to minicluster in reasonable speed. We should consider adding such test db and change PlannerTests to test against that fully-partitioned db instead of current tpcds/tpcds_parquet test db.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)