You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Julien Le Dem (JIRA)" <ji...@apache.org> on 2015/07/20 19:01:04 UTC

[jira] [Resolved] (PARQUET-340) totalMemoryPool is truncated to 32 bits

     [ https://issues.apache.org/jira/browse/PARQUET-340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Julien Le Dem resolved PARQUET-340.
-----------------------------------
       Resolution: Fixed
    Fix Version/s: 2.0.0

Issue resolved by pull request 246
[https://github.com/apache/parquet-mr/pull/246]

> totalMemoryPool is truncated to 32 bits
> ---------------------------------------
>
>                 Key: PARQUET-340
>                 URL: https://issues.apache.org/jira/browse/PARQUET-340
>             Project: Parquet
>          Issue Type: Bug
>            Reporter: Chris Bannister
>             Fix For: 2.0.0
>
>
> with heap set to 50gb seeings lots of errors like this
> Jul 17, 2015 3:18:14 PM WARNING: org.apache.parquet.hadoop.MemoryManager: Total allocation exceeds 95.00% (2,147,483,647 bytes) of heap memory
> this is because the ratio passed into calculate the total memory is a float which when used is causing the long value to be truncate to max int32.
> Fix this by making it a double instead



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)