You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Jonathan Eagles (JIRA)" <ji...@apache.org> on 2018/05/02 14:32:00 UTC

[jira] [Created] (TEZ-3925) DefaultSorter skips RLE for first spill

Jonathan Eagles created TEZ-3925:
------------------------------------

             Summary: DefaultSorter skips RLE for first spill
                 Key: TEZ-3925
                 URL: https://issues.apache.org/jira/browse/TEZ-3925
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Jonathan Eagles
            Assignee: Jonathan Eagles


If a job is able to fit all keys/values in memory, no sort/spill will be triggered until the final spill. In this case, since no sort has taken place, RLE detection is based on state before a sort takes place. The final spill in a one spill default sort never enables RLE in the final file.out.

https://issues.apache.org/jira/browse/TEZ-3924?focusedCommentId=16460534&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16460534



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)