You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@impala.apache.org by bo...@apache.org on 2023/02/07 10:45:36 UTC

[impala] branch master updated: IMPALA-11900 Test table iceberg_partitioned_orc has wrong metadata

This is an automated email from the ASF dual-hosted git repository.

boroknagyz pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git


The following commit(s) were added to refs/heads/master by this push:
     new 84cb5e851 IMPALA-11900 Test table iceberg_partitioned_orc has wrong metadata
84cb5e851 is described below

commit 84cb5e8510e0a837c1daaf48bd5e7c1127da8dab
Author: Zoltan Borok-Nagy <bo...@cloudera.com>
AuthorDate: Mon Feb 6 16:56:14 2023 +0100

    IMPALA-11900 Test table iceberg_partitioned_orc has wrong metadata
    
    Iceberg table iceberg_partitioned_orc has wrong metadata.
    The field 'file_size_in_bytes' is wrong for the data files.
    
    This causes issues on object stores where we rely more on information
    coming from Iceberg metadata.
    
    This commit updates the manifest and manifest list files to reflect
    correct information.
    
    Change-Id: Iae860f401947092d9fdca802f41dd6de79e0638d
    Reviewed-on: http://gerrit.cloudera.org:8080/19476
    Tested-by: Impala Public Jenkins <im...@cloudera.com>
    Reviewed-by: Gabor Kaszab <ga...@cloudera.com>
---
 .../02fb8198-e791-4d89-8afa-c75fb5443346-m0.avro      | Bin 5018 -> 6760 bytes
 ...603670-1-02fb8198-e791-4d89-8afa-c75fb5443346.avro | Bin 2582 -> 1456 bytes
 2 files changed, 0 insertions(+), 0 deletions(-)

diff --git a/testdata/data/iceberg_test/hadoop_catalog/iceberg_partitioned_orc/functional_parquet/iceberg_partitioned_orc/metadata/02fb8198-e791-4d89-8afa-c75fb5443346-m0.avro b/testdata/data/iceberg_test/hadoop_catalog/iceberg_partitioned_orc/functional_parquet/iceberg_partitioned_orc/metadata/02fb8198-e791-4d89-8afa-c75fb5443346-m0.avro
index f6a6e4158..6ff715109 100644
Binary files a/testdata/data/iceberg_test/hadoop_catalog/iceberg_partitioned_orc/functional_parquet/iceberg_partitioned_orc/metadata/02fb8198-e791-4d89-8afa-c75fb5443346-m0.avro and b/testdata/data/iceberg_test/hadoop_catalog/iceberg_partitioned_orc/functional_parquet/iceberg_partitioned_orc/metadata/02fb8198-e791-4d89-8afa-c75fb5443346-m0.avro differ
diff --git a/testdata/data/iceberg_test/hadoop_catalog/iceberg_partitioned_orc/functional_parquet/iceberg_partitioned_orc/metadata/snap-3506237933060603670-1-02fb8198-e791-4d89-8afa-c75fb5443346.avro b/testdata/data/iceberg_test/hadoop_catalog/iceberg_partitioned_orc/functional_parquet/iceberg_partitioned_orc/metadata/snap-3506237933060603670-1-02fb8198-e791-4d89-8afa-c75fb5443346.avro
index ae0c45a78..27e93265e 100644
Binary files a/testdata/data/iceberg_test/hadoop_catalog/iceberg_partitioned_orc/functional_parquet/iceberg_partitioned_orc/metadata/snap-3506237933060603670-1-02fb8198-e791-4d89-8afa-c75fb5443346.avro and b/testdata/data/iceberg_test/hadoop_catalog/iceberg_partitioned_orc/functional_parquet/iceberg_partitioned_orc/metadata/snap-3506237933060603670-1-02fb8198-e791-4d89-8afa-c75fb5443346.avro differ