You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Tamas Mate (Jira)" <ji...@apache.org> on 2023/11/03 14:29:00 UTC

[jira] [Created] (IMPALA-12537) Iceberg returns a deleted file's name when INPUT__FILE__NAME is in the select list

Tamas Mate created IMPALA-12537:
-----------------------------------

             Summary: Iceberg returns a deleted file's name when INPUT__FILE__NAME is in the select list
                 Key: IMPALA-12537
                 URL: https://issues.apache.org/jira/browse/IMPALA-12537
             Project: IMPALA
          Issue Type: Bug
          Components: Backend
    Affects Versions: Impala 4.3.0
            Reporter: Tamas Mate


On S3, Impala returns 3 rows when {{INPUT__FILE__NAME}} is specified, but it only returns the 2 data file names on HDFS.
iceberg_query_metadata table had 3 records originally (i=1, i=2, i=3) and the second one i=2 was deleted, I observed the following test failure:
{code:none}
20:28:08 SELECT i, INPUT__FILE__NAME from functional_parquet.iceberg_query_metadata tbl;
20:28:08 
20:28:08 -- 2023-11-02 12:14:08,868 INFO     MainThread: Started query 4448ab74f3a639a5:2b8cf6ea00000000
20:28:08 -- 2023-11-02 12:14:08,997 ERROR    MainThread: Comparing QueryTestResults (expected vs actual):
20:28:08 row_regex:[1-9]\d*|0,'.*/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/.*.parq' == 1,'s3a://impala-test-uswest2-3/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/ed4288065b402e80-c705c47400000000_264336845_data.0.parq'
20:28:08 row_regex:[1-9]\d*|0,'.*/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/.*.parq' == 2,'s3a://impala-test-uswest2-3/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_query_metadata/data/0a4510a5e8578659-1607b64000000000_435794406_data.0.parq'
20:28:08 Number of rows returned (expected vs actual): 2 != 3
{code}
cc.:[~boroknagyz], [~gaborkaszab] 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org