You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2021/03/16 02:15:00 UTC
[jira] [Commented] (IMPALA-10503) testdata load hits hive memory
limit errors during hive inserts
[ https://issues.apache.org/jira/browse/IMPALA-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302159#comment-17302159 ]
ASF subversion and git services commented on IMPALA-10503:
----------------------------------------------------------
Commit c60a626ac66cc7cf24080b7ea84166c70bad9b22 in impala's branch refs/heads/master from Kurt Deschler
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=c60a626 ]
IMPALA-10503: testdata load hits hive memory limit errors during hive inserts
Changed the following hive settings to avoid hitting Hive container
limit errors:
hive.tez.container.size: 2048
hive.tez.java.opts: -Xmx1700m
With these settings, testdata load completes without errors on a
32GB host.
Reviewed-by: Fang-Yu Rao <fa...@cloudera.com>
Change-Id: Idac5f054e814070b983f7f57aef4ea9d54252bb2
Reviewed-on: http://gerrit.cloudera.org:8080/17061
Tested-by: Impala Public Jenkins <im...@cloudera.com>
Reviewed-by: Aman Sinha <am...@cloudera.com>
> testdata load hits hive memory limit errors during hive inserts
> ---------------------------------------------------------------
>
> Key: IMPALA-10503
> URL: https://issues.apache.org/jira/browse/IMPALA-10503
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 3.4.0
> Reporter: Kurt Deschler
> Assignee: Kurt Deschler
> Priority: Major
>
> Hit these memory errors running the following on a 32GB host:
> {{buildall.sh-format -testdata }}{{[2020-09-15 13:24:08.751]Container killed on request. Exit code is 143}}
> {{[2020-09-15 13:24:08.751]Container exited with a non-zero exit code 143.}}
> {{]], TaskAttempt 1 failed, info=[Container container_1600192631322_0036_01_000006 finished with diagnostics set to [Container failed, exitCode=-104. [2020-09-15 13:24:20.868]Container [pid=24715,containerID=container_1600192631322_0036_01_000006] is running 14176256B beyond the 'PHYSICAL' memory limit. Current usage: 1.0 GB of 1 GB physical memory used; 2.9 GB of 2.1 GB virtual memory used. Killing container.}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org