You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Andrew Sherman (Jira)" <ji...@apache.org> on 2021/11/24 16:55:00 UTC
[jira] [Updated] (IMPALA-10743) Dataload flakynes "too many dynamic partitions"
[ https://issues.apache.org/jira/browse/IMPALA-10743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Sherman updated IMPALA-10743:
------------------------------------
Priority: Critical (was: Major)
> Dataload flakynes "too many dynamic partitions"
> -----------------------------------------------
>
> Key: IMPALA-10743
> URL: https://issues.apache.org/jira/browse/IMPALA-10743
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Reporter: Csaba Ringhofer
> Priority: Critical
>
> The following INSERT failed:
> {code}
> INSERT OVERWRITE TABLE tpcds_seq_snap.s
> tore_sales PARTITION (ss_sold_date_sk)
> . . . . . . . . . . . . . . . . . . . .> SELECT ss_sold_time_sk,
> . . . . . . . . . . . . . . . . . . . .> ss_item_sk,
> . . . . . . . . . . . . . . . . . . . .> ss_customer_sk,
> . . . . . . . . . . . . . . . . . . . .> ss_cdemo_sk,
> . . . . . . . . . . . . . . . . . . . .> ss_hdemo_sk,
> . . . . . . . . . . . . . . . . . . . .> ss_addr_sk,
> . . . . . . . . . . . . . . . . . . . .> ss_store_sk,
> . . . . . . . . . . . . . . . . . . . .> ss_promo_sk,
> . . . . . . . . . . . . . . . . . . . .> ss_ticket_number,
> . . . . . . . . . . . . . . . . . . . .> ss_quantity,
> . . . . . . . . . . . . . . . . . . . .> ss_wholesale_cost,
> . . . . . . . . . . . . . . . . . . . .> ss_list_price,
> . . . . . . . . . . . . . . . . . . . .> ss_sales_price,
> . . . . . . . . . . . . . . . . . . . .> ss_ext_discount_amt,
> . . . . . . . . . . . . . . . . . . . .> ss_ext_sales_price,
> . . . . . . . . . . . . . . . . . . . .> ss_ext_wholesale_cost,
> . . . . . . . . . . . . . . . . . . . .> ss_ext_list_price,
> . . . . . . . . . . . . . . . . . . . .> ss_ext_tax,
> . . . . . . . . . . . . . . . . . . . .> ss_coupon_amt,
> . . . . . . . . . . . . . . . . . . . .> ss_net_paid,
> . . . . . . . . . . . . . . . . . . . .> ss_net_paid_inc_tax,
> . . . . . . . . . . . . . . . . . . . .> ss_net_profit,
> . . . . . . . . . . . . . . . . . . . .> ss_sold_date_sk
> . . . . . . . . . . . . . . . . . . . .> FROM tpcds.store_sales
> . . . . . . . . . . . . . . . . . . . .> WHERE ss_sold_date_sk < 2451272;
> {code}
> with error
> {code}
> ERROR : Vertex failed, vertexName=Map 1, vertexId=vertex_1623135064866_0012_19_00, diagnostics=[Task failed, taskId=task_1623135064866_0012_19_00_000001, diagnostics=[TaskAttempt 0 failed, info=[Error: Error while running task ( failure ) : attempt_1623135064866_0012_19_00_000001_0:java.lang.RuntimeException: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveFatalException: [Error 20004]: Fatal error occurred when node tried to create too many dynamic partitions. The maximum number of dynamic partitions is controlled by hive.exec.max.dynamic.partitions and hive.exec.max.dynamic.partitions.pernode. Maximum was set to 100 partitions per node, number of dynamic partitions on this node: 101
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org