You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Mostafa Mokhtar (JIRA)" <ji...@apache.org> on 2017/03/30 00:26:41 UTC

[jira] [Created] (IMPALA-5141) Refresh table & Recover partitions & DML queries fail with "FileNotFoundException" when run concurrently with "invalidate metadata foo"

Mostafa Mokhtar created IMPALA-5141:
---------------------------------------

             Summary: Refresh table & Recover partitions & DML queries fail with "FileNotFoundException" when run concurrently with "invalidate metadata foo"
                 Key: IMPALA-5141
                 URL: https://issues.apache.org/jira/browse/IMPALA-5141
             Project: IMPALA
          Issue Type: Bug
    Affects Versions: Impala 2.9.0
            Reporter: Mostafa Mokhtar
            Assignee: Dimitris Tsirogiannis
         Attachments: Concurrent operations failure.txt, fc4ac8b7600276d0-6a1f4ae90000000d_711368339_data.0.parq, table_level_tests_shell.jmx

Jmeter JMX file attached. 
When running Repro adjust SOURCE_TABLE_HDFS_PATH to point to your HDFS path and copy the parq file attached to that path. 

Errors
{code}
TableLoadingException: Failed to load metadata for table: store_sales
CAUSED BY: RuntimeException: Error loading block metadata for directory hdfs://vd1320.halxg.cloudera.com:8020/user/hive/warehouse/table_level_tests/store_sales: File hdfs://vd1320.halxg.cloudera.com:8020/user/hive/warehouse/table_level_tests/store_sales/_impala_insert_staging/7c407f51b95eda50_585abc2f00000000 does not exist.
CAUSED BY: FileNotFoundException: File hdfs://vd1320.halxg.cloudera.com:8020/user/hive/warehouse/table_level_tests/store_sales/_impala_insert_staging/7c407f51b95eda50_585abc2f00000000 does not exist.
, Query: insert into store_sales partition(ss_sold_date_sk=107)  select * from store_sales_source.
{code}

{code}
ERROR processing query/statement. Error Code: ERROR_STATE, SQL state: 
TableLoadingException: Failed to load metadata for table: store_sales
CAUSED BY: RuntimeException: Error loading block metadata for directory hdfs://vd1320.halxg.cloudera.com:8020/user/hive/warehouse/table_level_tests/store_sales: File hdfs://vd1320.halxg.cloudera.com:8020/user/hive/warehouse/table_level_tests/store_sales/_impala_insert_staging/7c407f51b95eda50_585abc2f00000000 does not exist.
CAUSED BY: FileNotFoundException: File hdfs://vd1320.halxg.cloudera.com:8020/user/hive/warehouse/table_level_tests/store_sales/_impala_insert_staging/7c407f51b95eda50_585abc2f00000000 does not exist.
, Query: insert into store_sales partition(ss_sold_date_sk) /*+ clustered,shuffle */ select * from (select *, mod(cast(rand(52)  * 1000000000 as int),30) from store_sales_source union all  select *, 0 from store_sales_source limit 0) a.
{code}

{code}
ERROR processing query/statement. Error Code: 0, SQL state: TStatus(statusCode:ERROR_STATUS, sqlState:HY000, errorMessage:
TableLoadingException: Failed to load metadata for table: store_sales
CAUSED BY: RuntimeException: Error loading block metadata for directory hdfs://vd1320.halxg.cloudera.com:8020/user/hive/warehouse/table_level_tests/store_sales: File hdfs://vd1320.halxg.cloudera.com:8020/user/hive/warehouse/table_level_tests/store_sales/_impala_insert_staging/7c407f51b95eda50_585abc2f00000000 does not exist.
CAUSED BY: FileNotFoundException: File hdfs://vd1320.halxg.cloudera.com:8020/user/hive/warehouse/table_level_tests/store_sales/_impala_insert_staging/7c407f51b95eda50_585abc2f00000000 does not exist.
), Query: ALTER TABLE store_sales RECOVER PARTITIONS.
{code}




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)