You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2023/01/17 02:40:00 UTC
[jira] [Commented] (IMPALA-11833) Test iceberg files have wrong length in them
[ https://issues.apache.org/jira/browse/IMPALA-11833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677577#comment-17677577 ]
ASF subversion and git services commented on IMPALA-11833:
----------------------------------------------------------
Commit 0a1f2dd723051639ac081d1c7aaa3241df6a04fb in impala's branch refs/heads/master from Gergely Fürnstáhl
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=0a1f2dd72 ]
IMPALA-11833: Fixed manifest_length in snapshot files
Some manifest files were manually edited to support multiple
environments, namely hdfs://localhost:20500 were cropped from every
path. The snapshot files contain the length of these manifest files,
which was not adjusted.
Testing:
- Ran test_iceberg.py locally
- Verified lengths manually
Change-Id: I258055998a1d41b7f6047b6879e919834ed2c247
Reviewed-on: http://gerrit.cloudera.org:8080/19409
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> Test iceberg files have wrong length in them
> --------------------------------------------
>
> Key: IMPALA-11833
> URL: https://issues.apache.org/jira/browse/IMPALA-11833
> Project: IMPALA
> Issue Type: Bug
> Reporter: Gergely Fürnstáhl
> Assignee: Gergely Fürnstáhl
> Priority: Major
>
> CAUSED BY: UncheckedIOException: Failed to open input stream for file /test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_v2_no_deletes/metadata/5c80922f-01b5-4d52-bc93-6505be3b977b-m0.avro: java.io.IOException: Expected to read 6591 bytes, but only 3658 bytes read.
> The files were modified to fit test environment.
> Briefly, "[hdfs://localhost:20500]" were cropped from every path, but the manifest length was not corrected, so the files are "corrupt" in this sense.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org