You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2013/12/05 01:08:35 UTC
[jira] [Created] (TEZ-661) Implement a non-sorted scatter-gather
input/output
Daniel Dai created TEZ-661:
------------------------------
Summary: Implement a non-sorted scatter-gather input/output
Key: TEZ-661
URL: https://issues.apache.org/jira/browse/TEZ-661
Project: Apache Tez
Issue Type: Improvement
Reporter: Daniel Dai
When implementing Pig union, we need to gather data from two or more upstream vertexes without sorting. The vertex itself might consists of several tasks. Ideally, it should use OnFileUnorderedKVOutput with DataMovementType.SCATTER_GATHER. However, this combination does not work according to [~hitesh]. We need to implement that.
--
This message was sent by Atlassian JIRA
(v6.1#6144)