You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@impala.apache.org by "Michael Smith (Code Review)" <ge...@cloudera.org> on 2022/09/23 17:58:33 UTC

[Impala-ASF-CR] IMPALA-11562: Revert support for o3fs as default filesystem

Michael Smith has uploaded a new patch set (#4). ( http://gerrit.cloudera.org:8080/19001 )

Change subject: IMPALA-11562: Revert support for o3fs as default filesystem
......................................................................

IMPALA-11562: Revert support for o3fs as default filesystem

Reverts support for o3fs as a default filesystem added in IMPALA-9442.
Updates test setup to use ofs instead.

Munges absolute paths in Iceberg metadata to match the new location
required for ofs. Ozone has strict requirements on volume and bucket
names, so all tables must be created within a bucket (e.g. inside
/impala/test-warehouse/).

Change-Id: I45e90d30b2e68876dec0db3c43ac15ee510b17bd
---
M bin/impala-config.sh
M bin/run-all-tests.sh
M fe/src/main/java/org/apache/impala/common/FileSystemUtil.java
M testdata/bin/create-tpcds-testcase-files.sh
M testdata/bin/load-metastore-snapshot.sh
M testdata/bin/load-test-warehouse-snapshot.sh
A testdata/bin/rewrite-iceberg-metadata.py
M testdata/cluster/admin
M testdata/workloads/functional-query/queries/QueryTest/iceberg-alter.test
M testdata/workloads/functional-query/queries/QueryTest/iceberg-create-table-like-table.test
M testdata/workloads/functional-query/queries/QueryTest/iceberg-create.test
M testdata/workloads/functional-query/queries/QueryTest/iceberg-ctas.test
M testdata/workloads/functional-query/queries/QueryTest/iceberg-insert.test
M testdata/workloads/functional-query/queries/QueryTest/iceberg-negative.test
M testdata/workloads/functional-query/queries/QueryTest/iceberg-old-fileformat.test
M testdata/workloads/functional-query/queries/QueryTest/iceberg-query.test
M testdata/workloads/functional-query/queries/QueryTest/multiple-filesystems.test
M testdata/workloads/functional-query/queries/QueryTest/partition-col-types.test
M testdata/workloads/functional-query/queries/QueryTest/show-create-table.test
M tests/authorization/test_ranger.py
M tests/common/file_utils.py
M tests/common/impala_test_suite.py
M tests/custom_cluster/test_startup_filesystem_checks.py
M tests/metadata/test_ddl.py
M tests/metadata/test_explain.py
M tests/metadata/test_load.py
M tests/metadata/test_recover_partitions.py
M tests/metadata/test_recursive_listing.py
M tests/metadata/test_show_create_table.py
M tests/metadata/test_testcase_builder.py
M tests/query_test/test_compressed_formats.py
M tests/query_test/test_iceberg.py
M tests/query_test/test_insert_behaviour.py
M tests/query_test/test_insert_parquet.py
M tests/query_test/test_observability.py
M tests/query_test/test_runtime_filters.py
M tests/util/filesystem_utils.py
M tests/util/hdfs_util.py
38 files changed, 354 insertions(+), 242 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/01/19001/4
-- 
To view, visit http://gerrit.cloudera.org:8080/19001
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I45e90d30b2e68876dec0db3c43ac15ee510b17bd
Gerrit-Change-Number: 19001
Gerrit-PatchSet: 4
Gerrit-Owner: Michael Smith <mi...@cloudera.com>