You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2023/12/18 16:06:00 UTC
[jira] [Commented] (IMPALA-12584) Add backend config to restrict data file locations for Iceberg tables
[ https://issues.apache.org/jira/browse/IMPALA-12584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17798263#comment-17798263 ]
ASF subversion and git services commented on IMPALA-12584:
----------------------------------------------------------
Commit bd0ba644e6b8953028f9061e8f457a4ad33154aa in impala's branch refs/heads/master from Peter Rozsa
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=bd0ba644e ]
IMPALA-12584: Add backend config to restrict data file locations for Iceberg tables
This change adds backend flag 'iceberg_restrict_data_file_location',
when the flag is set to 'true', Impala will raise an error when at least
one data file of an Iceberg table is outside of the table directory.
The default value of the flag is 'false'.
Tests:
- custom-cluster test added to validate both states of the flag
Change-Id: I60e3d93b5039dc977417e7b097b3d6ddeda52de4
Reviewed-on: http://gerrit.cloudera.org:8080/20786
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> Add backend config to restrict data file locations for Iceberg tables
> ---------------------------------------------------------------------
>
> Key: IMPALA-12584
> URL: https://issues.apache.org/jira/browse/IMPALA-12584
> Project: IMPALA
> Issue Type: Bug
> Reporter: Zoltán Borók-Nagy
> Assignee: Peter Rozsa
> Priority: Major
> Labels: impala-iceberg
>
> Similarly to [https://github.com/apache/hive/pull/4910,] Impala should have a backend flag to restrict the data file locations of Iceberg tables.
> If the flag is true, Impala should raise an error for Iceberg tables that have data files outside of the table directory.
> We should not limit the location of metadata files, so they could be placed to a different storage system (e.g. Amazon S3 Express).
> We must also ensure that users cannot create Iceberg tables at arbitrary locations.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org