You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@impala.apache.org by "Csaba Ringhofer (Code Review)" <ge...@cloudera.org> on 2026/07/16 08:11:38 UTC
[Impala-ASF-CR] IMPALA-15184: Switch tpcds json from bzip to zstd
Hello Joe McDonnell, Michael Smith, Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/24586
to look at the new patch set (#3).
Change subject: IMPALA-15184: Switch tpcds json from bzip to zstd
......................................................................
IMPALA-15184: Switch tpcds json from bzip to zstd
bzip is very slow, and it is enough to test it on
smaller data (already covered in functional text).
Switching to zstd, which did not have its own db.
From dataload logs before change:
Loading TPC-H data OK (Took: 5 min 39 sec)
Loading TPC-DS data OK (Took: 22 min 33 sec)
Loading functional-query data OK (Took: 30 min 43 sec)
After change:
Loading TPC-H data OK (Took: 5 min 22 sec)
Loading TPC-DS data OK (Took: 13 min 49 sec)
Loading functional-query data OK (Took: 27 min 30 sec)
Total dataload time is decreased from ~35m to ~30m.
The longest leg functional-query also decreased, likely
due to less contention on the max 2 parallel Hive queries
(see IMPALA-15185 for details on Hive parallelism).
Change-Id: Ia5e787619cc9f2b1cd30d40440aecd20fcef4117
---
M testdata/bin/generate-schema-statements.py
M testdata/workloads/tpcds/tpcds_core.csv
2 files changed, 2 insertions(+), 1 deletion(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/86/24586/3
--
To view, visit http://gerrit.cloudera.org:8080/24586
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ia5e787619cc9f2b1cd30d40440aecd20fcef4117
Gerrit-Change-Number: 24586
Gerrit-PatchSet: 3
Gerrit-Owner: Csaba Ringhofer <cs...@cloudera.com>
Gerrit-Reviewer: Csaba Ringhofer <cs...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Joe McDonnell <jo...@cloudera.com>
Gerrit-Reviewer: Michael Smith <mi...@cloudera.com>