You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tajo.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2015/02/06 04:38:34 UTC

[jira] [Commented] (TAJO-1271) Improve memory usage in HashShuffleFileWriteExec

    [ https://issues.apache.org/jira/browse/TAJO-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308552#comment-14308552 ] 

ASF GitHub Bot commented on TAJO-1271:
--------------------------------------

Github user jinossy commented on the pull request:

    https://github.com/apache/tajo/pull/329#issuecomment-73178173
  
    This patch is not yet ready for review


> Improve memory usage in HashShuffleFileWriteExec
> ------------------------------------------------
>
>                 Key: TAJO-1271
>                 URL: https://issues.apache.org/jira/browse/TAJO-1271
>             Project: Tajo
>          Issue Type: Improvement
>          Components: data shuffle
>    Affects Versions: 0.9.0
>            Reporter: Jinho Kim
>            Assignee: Jinho Kim
>
> Currently, HashShuffleFileWriteExec keep the cloned tuple list. and It written the tulples by count. This affects the jvm memory.
> We should improve it as following :
> * Keep the tuples in off-heap and reuse the row batch
> * Asynchronously write the hash partitions



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)