You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "Dong Chen (JIRA)" <ji...@apache.org> on 2014/11/03 07:07:33 UTC

[jira] [Commented] (PARQUET-108) Parquet Memory Management in Java

    [ https://issues.apache.org/jira/browse/PARQUET-108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194287#comment-14194287 ] 

Dong Chen commented on PARQUET-108:
-----------------------------------

Hi [~brocknoland], I uploaded a patch to implement the memory manager. Could you please help to review it? 
The pull request is:
https://github.com/apache/incubator-parquet-mr/pull/80

> Parquet Memory Management in Java
> ---------------------------------
>
>                 Key: PARQUET-108
>                 URL: https://issues.apache.org/jira/browse/PARQUET-108
>             Project: Parquet
>          Issue Type: Improvement
>            Reporter: Brock Noland
>            Assignee: Dong Chen
>
> As discussed in HIVE-7685, Hive + Parquet often runs out memory when writing to many Hive partitions. This is quite problematic for our users.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)