[jira] [Commented] (IMPALA-11821) Enable new avro/mixed iceberg tests for Ozone

["ASF subversion and git services (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-11821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678057#comment-17678057 ] 

ASF subversion and git services commented on IMPALA-11821:
----------------------------------------------------------

Commit 4595371ea29abdcf0707e17069bfcf984ca5b8e6 in impala's branch refs/heads/master from Gergely Fürnstáhl
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=4595371ea ]

IMPALA-11821: Adjusting manifest_length and absolute paths in case of metadata rewrite

testdata/bin/rewrite-iceberg-metadata.py rewrites manifest and snapshot
files using the provided prefix for file paths. Snapshot files store
the length of manifest files as well, this needs to be adjusted too.

Additionally, improved path rewrite to be able to rewrite absolute
paths correctly and pretty dumping metadata jsons.

Testing:
 - Tested locally, manually verified the rewrites
 - Tested on Ozone, automatically rewriting the test data and running
test_iceberg.py

Change-Id: I89b9208f25552012cc1ab16fa60a819dd5a683d9
Reviewed-on: http://gerrit.cloudera.org:8080/19412
Reviewed-by: Noemi Pap-Takacs <np...@cloudera.com>
Reviewed-by: Michael Smith <mi...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> Enable new avro/mixed iceberg tests for Ozone
> ---------------------------------------------
>
>                 Key: IMPALA-11821
>                 URL: https://issues.apache.org/jira/browse/IMPALA-11821
>             Project: IMPALA
>          Issue Type: Task
>            Reporter: Michael Smith
>            Assignee: Michael Smith
>            Priority: Major
>              Labels: ozone
>
> Revert https://gerrit.cloudera.org/c/19387/, remove {{/iceberg_test}} from https://github.com/apache/impala/blob/master/testdata/bin/load-test-warehouse-snapshot.sh#L119, and resolve any other issues needed for the tests to pass.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org