You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Taraka Rama Rao Lethavadla (Jira)" <ji...@apache.org> on 2022/12/12 07:17:00 UTC
[jira] [Updated] (HIVE-26833) Update error message related to dynamic partitioning with workaround
[ https://issues.apache.org/jira/browse/HIVE-26833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Taraka Rama Rao Lethavadla updated HIVE-26833:
----------------------------------------------
Description:
We see below error message as part of insert query where Dynamic Partition is expected to happen
{noformat}
Caused by: org.apache.hadoop.hive.ql.metadata.HiveFatalException: [Error 20004]: Fatal error occurred when node tried to create too many dynamic partitions. The maximum number of dynamic partitions is controlled by hive.exec.max.dynamic.partitions and hive.exec.max.dynamic.partitions.pernode. Maximum was set to 2000 partitions per node, number of dynamic partitions on this node: 2001{noformat}
As part of this jira, planning to add another workaround like splitting the query into multiple queries based on a filter condition to the above error message
was:
We see below error message as part of insert query where Dynamic Partition is expected to happen
{noformat}
Caused by: org.apache.hadoop.hive.ql.metadata.HiveFatalException: [Error 20004]: Fatal error occurred when node tried to create too many dynamic partitions. The maximum number of dynamic partitions is controlled by hive.exec.max.dynamic.partitions and hive.exec.max.dynamic.partitions.pernode. Maximum was set to 2000 partitions per node, number of dynamic partitions on this node: 2001{noformat}
As part of this jira, planning to add another workaround like splitting the query into multiple queries based on a filter condition
> Update error message related to dynamic partitioning with workaround
> --------------------------------------------------------------------
>
> Key: HIVE-26833
> URL: https://issues.apache.org/jira/browse/HIVE-26833
> Project: Hive
> Issue Type: Improvement
> Reporter: Taraka Rama Rao Lethavadla
> Assignee: Taraka Rama Rao Lethavadla
> Priority: Minor
>
> We see below error message as part of insert query where Dynamic Partition is expected to happen
> {noformat}
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveFatalException: [Error 20004]: Fatal error occurred when node tried to create too many dynamic partitions. The maximum number of dynamic partitions is controlled by hive.exec.max.dynamic.partitions and hive.exec.max.dynamic.partitions.pernode. Maximum was set to 2000 partitions per node, number of dynamic partitions on this node: 2001{noformat}
> As part of this jira, planning to add another workaround like splitting the query into multiple queries based on a filter condition to the above error message
--
This message was sent by Atlassian Jira
(v8.20.10#820010)