You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2013/12/05 01:08:35 UTC

[jira] [Created] (TEZ-661) Implement a non-sorted scatter-gather input/output

Daniel Dai created TEZ-661:
------------------------------

             Summary: Implement a non-sorted scatter-gather input/output
                 Key: TEZ-661
                 URL: https://issues.apache.org/jira/browse/TEZ-661
             Project: Apache Tez
          Issue Type: Improvement
            Reporter: Daniel Dai


When implementing Pig union, we need to gather data from two or more upstream vertexes without sorting. The vertex itself might consists of several tasks. Ideally, it should use OnFileUnorderedKVOutput with DataMovementType.SCATTER_GATHER. However, this combination does not work according to [~hitesh]. We need to implement that.



--
This message was sent by Atlassian JIRA
(v6.1#6144)