[jira] [Commented] (TAJO-1983) Improve memory usage of ExternalSortExec

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TAJO-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15013231#comment-15013231 ] 

ASF GitHub Bot commented on TAJO-1983:
--------------------------------------

GitHub user jinossy opened a pull request:

    https://github.com/apache/tajo/pull/869

    TAJO-1983: Improve memory usage of ExternalSortExec.

    I've add UnSafeTupleList. it uses off-heap memory. 
    A last chunk are not stored in local file and the chunks are merged when the next method is called.
    In addition, I’ve change the insignificant log level to debug. 

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/jinossy/tajo TAJO-1983

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/tajo/pull/869.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #869
    
----

----


> Improve memory usage of ExternalSortExec
> ----------------------------------------
>
>                 Key: TAJO-1983
>                 URL: https://issues.apache.org/jira/browse/TAJO-1983
>             Project: Tajo
>          Issue Type: Improvement
>          Components: Offheap, Physical Operator
>    Affects Versions: 0.9.0, 0.10.0, 0.11.0
>            Reporter: Jinho Kim
>            Assignee: Jinho Kim
>             Fix For: 0.12.0, 0.11.1
>
>
> ExternalSortExec keeps tuple list for sort. but it causes too many GC.
> We should change to off-heap tuple instead of VTuple



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)