You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@tez.apache.org by "Jonathan Eagles (JIRA)" <ji...@apache.org> on 2016/07/11 17:35:11 UTC

[jira] [Created] (TEZ-3334) Tez Custom Shuffle Handler

Jonathan Eagles created TEZ-3334:
------------------------------------

             Summary: Tez Custom Shuffle Handler
                 Key: TEZ-3334
                 URL: https://issues.apache.org/jira/browse/TEZ-3334
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Jonathan Eagles


For conditions where auto-parallelism is reduced (e.g. TEZ-3222), a custom shuffle handler could help reduce the number of fetches and could more efficiently fetch data. In particular if a reducer is fetching 100 pieces serially from the same mapper it could do this in one fetch call. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)