You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Stephan Ewen (JIRA)" <ji...@apache.org> on 2014/12/01 16:52:12 UTC

[jira] [Created] (FLINK-1296) Add support for very large record for sorting

Stephan Ewen created FLINK-1296:
-----------------------------------

             Summary: Add support for very large record for sorting
                 Key: FLINK-1296
                 URL: https://issues.apache.org/jira/browse/FLINK-1296
             Project: Flink
          Issue Type: Bug
          Components: Local Runtime
    Affects Versions: 0.8-incubating
            Reporter: Stephan Ewen
            Assignee: Stephan Ewen
             Fix For: 0.8-incubating


Currently, very large records (multiple hundreds of megabytes) can break the sorter if the overflow the sort buffer.

Furthermore, if a merge is attempted of those records, pulling multiple of them concurrently into memory can break the machine memory.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)