[jira] [Created] (IMPALA-12621) Flaky tests due to "Failed to write json to file" in creating Iceberg tables

["Quanlong Huang (Jira)" <ji...@apache.org>]

Quanlong Huang created IMPALA-12621:
---------------------------------------

             Summary: Flaky tests due to "Failed to write json to file" in creating Iceberg tables
                 Key: IMPALA-12621
                 URL: https://issues.apache.org/jira/browse/IMPALA-12621
             Project: IMPALA
          Issue Type: Bug
            Reporter: Quanlong Huang


There are some flaky tests that could fail in creating Iceberg tables. E.g. saw  TestIcebergTable.test_create_table_like_table failed in [https://jenkins.impala.io/job/ubuntu-20.04-dockerised-tests/930/]
{code:java}
query_test/test_iceberg.py:937: in test_create_table_like_table
    use_db=unique_database)
common/impala_test_suite.py:720: in run_test_case
    result = exec_fn(query, user=test_section.get('USER', '').strip() or None)
common/impala_test_suite.py:658: in __exec_in_impala
    result = self.__execute_query(target_impalad_client, query, user=user)
common/impala_test_suite.py:994: in __execute_query
    return impalad_client.execute(query, user=user)
common/impala_connection.py:214: in execute
    return self.__beeswax_client.execute(sql_stmt, user=user)
beeswax/impala_beeswax.py:191: in execute
    handle = self.__execute_query(query_string.strip(), user=user)
beeswax/impala_beeswax.py:369: in __execute_query
    self.wait_for_finished(handle)
beeswax/impala_beeswax.py:390: in wait_for_finished
    raise ImpalaBeeswaxException("Query aborted:" + error_log, None)
E   ImpalaBeeswaxException: ImpalaBeeswaxException:
E    Query aborted:ImpalaRuntimeException: Error making 'createTable' RPC to Hive Metastore: 
E   CAUSED BY: RuntimeIOException: Failed to write json to file: hdfs://172.18.0.1:20500/test-warehouse/test_create_table_like_table_260cb6ec.db/ice_hadoop_tbl_no_part/metadata/3db9a772-baf3-4cd8-9e6b-273ed2839ebb.metadata.json
E   CAUSED BY: IOException: The stream is closed{code}
The CreateTable command is
{noformat}
create table ice_hadoop_tbl_no_part(
  id INT comment "this is id",
  col_bool BOOLEAN,
  col_int INT,
  col_bigint BIGINT,
  col_float FLOAT,
  col_double DOUBLE,
  col_dc1 DECIMAL(9, 3),
  col_dc2 DECIMAL(18, 3),
  col_dc3 DECIMAL(38, 3),
  col_date DATE,
  col_timestamp TIMESTAMP,
  col_string STRING,
  col_struct STRUCT < f1: BIGINT,
  f2: BIGINT >,
  col_array ARRAY < STRING >,
  col_map MAP < STRING,
  array < STRING > >
) stored as iceberg tblproperties('iceberg.catalog' = 'hadoop.tables'); {noformat}
There are several JIRAs tracking the same failure, e.g. IMPALA-10540, IMPALA-12261, IMPALA-10924, IMPALA-10633.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)