You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Riza Suminto (Jira)" <ji...@apache.org> on 2023/12/05 18:09:00 UTC
[jira] [Created] (IMPALA-12601) Add a fully partitioned TPC-DS dataset for planner tests
Riza Suminto created IMPALA-12601:
-------------------------------------
Summary: Add a fully partitioned TPC-DS dataset for planner tests
Key: IMPALA-12601
URL: https://issues.apache.org/jira/browse/IMPALA-12601
Project: IMPALA
Issue Type: Test
Components: Infrastructure
Affects Versions: Impala 4.3.0
Reporter: Riza Suminto
Assignee: Riza Suminto
testdata/datasets/tpcds only have store_sales table fully-partitioned and leave other facts table unpartitioned. This is probably intended for faster data loading during test. However, this is not an accurate reflection of larger scale TPC-DS dataset where all facts tables are partitioned. Impala planner may change the detail of query plan if partition column exist.
Today, Impala can load a small scale, fully-partitioned TPC-DS dataset in parquet format to minicluster in reasonable speed. We should consider adding such test db and change PlannerTests to test against that fully-partitioned db instead of current tpcds/tpcds_parquet test db.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)