[jira] [Resolved] (IMPALA-15187) TestIcebergTrinoInterop trino container startup failing from excessive mem allocation request

["David Rorke (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IMPALA-15187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

David Rorke resolved IMPALA-15187.
----------------------------------
    Resolution: Fixed

> TestIcebergTrinoInterop trino container startup failing from excessive mem allocation request
> ---------------------------------------------------------------------------------------------
>
>                 Key: IMPALA-15187
>                 URL: https://issues.apache.org/jira/browse/IMPALA-15187
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Infrastructure
>            Reporter: David Rorke
>            Assignee: David Rorke
>            Priority: Major
>
> The Trino container is failing to start during TestIcebergTrinoInterop because the JVM is attempting to commit 50GB of memory during startup:
> {noformat}
> OpenJDK 64-Bit Server VM warning: INFO: os::commit_memory(0x0000fff2f6000000, 53552873472, 0) failed; error='Not enough space' (errno=12) # # There is insufficient memory for the Java Runtime Environment to continue. # Native memory allocation (mmap) failed to map 53552873472 bytes. Error detail: committing reserved memory.{noformat}
> The reason appears to be the following in the jvm.config file for the Docker image which tells the JVM to allocate 80% of the total container memory at startup:
> {noformat}
> -XX:InitialRAMPercentage=80
> -XX:MaxRAMPercentage=80{noformat}
> There are no container memory limits so these percentages will be applied to the total host memory (64GB in this case).  minicluster_trino should have a much lower memory requirement than this and these percentages could be reduced to something like 10% initial and 30% max.
> So far we've only seen this failure on ARM (not on Intel). The reason isn't clear (some arm instances use a large 64KB page size so maybe more fragmentation), but in any case the 50GB allocation is excessive and should be reduced on both ARM and Intel.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)