You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "László Bodor (Jira)" <ji...@apache.org> on 2023/11/29 12:08:00 UTC

[jira] [Updated] (HIVE-27916) Increase tez.am.resource.memory.mb for TestIcebergCliDrver

     [ https://issues.apache.org/jira/browse/HIVE-27916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

László Bodor updated HIVE-27916:
--------------------------------
    Reporter: László Bodor  (was: Stamatis Zampetakis)

> Increase tez.am.resource.memory.mb for TestIcebergCliDrver
> ----------------------------------------------------------
>
>                 Key: HIVE-27916
>                 URL: https://issues.apache.org/jira/browse/HIVE-27916
>             Project: Hive
>          Issue Type: Bug
>          Components: Test
>    Affects Versions: 4.0.0-beta-1
>            Reporter: László Bodor
>            Assignee: László Bodor
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.0.0
>
>
> Running all the tests under TestMiniTezCliDriver very frequently (but still intermittently) leads to OutOfMemory errors.
> {noformat}
> cd itests/qtest && mvn test -Dtest=TestMiniTezCliDriver
> {noformat}
> I set {{-XX:+HeapDumpOnOutOfMemoryError}} and the respective heapdumps are attached to this ticket.
> The OOM is thrown from the application master and a quick inspection of the dumps shows that it comes mainly from the accumulation of Configuration objects (~1MB each) by various classes.
> The max heap size for application master is pretty low (~100MB) so it is quite easy to reach. The heap size is explicitly very low for testing purposes but maybe we should re-evaluate the current configurations for the tests.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)