[jira] [Commented] (FLINK-1296) Add support for very large record for sorting

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-1296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237311#comment-14237311 ] 

ASF GitHub Bot commented on FLINK-1296:
---------------------------------------

Github user StephanEwen commented on the pull request:

    https://github.com/apache/incubator-flink/pull/249#issuecomment-65960391
  
    This failes with the java 6 compiler, because it has a generics bug. I'll try and work around it...


> Add support for very large record for sorting
> ---------------------------------------------
>
>                 Key: FLINK-1296
>                 URL: https://issues.apache.org/jira/browse/FLINK-1296
>             Project: Flink
>          Issue Type: Bug
>          Components: Local Runtime
>    Affects Versions: 0.8-incubating
>            Reporter: Stephan Ewen
>            Assignee: Stephan Ewen
>             Fix For: 0.8-incubating
>
>
> Currently, very large records (multiple hundreds of megabytes) can break the sorter if the overflow the sort buffer.
> Furthermore, if a merge is attempted of those records, pulling multiple of them concurrently into memory can break the machine memory.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)