You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Kurt Deschler (Jira)" <ji...@apache.org> on 2021/02/13 16:38:00 UTC

[jira] [Created] (IMPALA-10507) Workaround for sporadic TPC-DS testdata insert error

Kurt Deschler created IMPALA-10507:
--------------------------------------

             Summary: Workaround for sporadic TPC-DS testdata insert error
                 Key: IMPALA-10507
                 URL: https://issues.apache.org/jira/browse/IMPALA-10507
             Project: IMPALA
          Issue Type: Bug
          Components: Infrastructure
    Affects Versions: Impala 3.4.0
            Reporter: Kurt Deschler
            Assignee: Kurt Deschler


A TPC-DS insert statement generated from testdata/datasets/tpcds/tpcds_schema_template.sql fails with Tez errors trying to allocate space. This Jira is to woraround the error in the test.

Statment:

insert overwrite table store_sales partition(ss_sold_date_sk)
select ... from store_sales_unpartitioned
WHERE 2451272 <= ss_sold_date_sk and ss_sold_date_sk < 2451728
distribute by ss_sold_date_sk

Error:

Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /test-warehouse/tpcds.store_sales/.hive-staging_hive_2021-01-04_11-08-20_683_8822236846070344153-996/_task_tmp.-ext-10002/ss_sold_date_sk=2451574/_tmp.000000_1 could only be written to 0 of the 1 minReplication nodes. There are 3 datanode(s) running and 3 node(s) are excluded in this operation.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)