You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Siddharth Seth (JIRA)" <ji...@apache.org> on 2013/06/11 07:32:20 UTC

[jira] [Created] (TEZ-209) Optionally send the per-vertex/input/output data specified by users over RPC

Siddharth Seth created TEZ-209:
----------------------------------

             Summary: Optionally send the per-vertex/input/output data specified by users over RPC
                 Key: TEZ-209
                 URL: https://issues.apache.org/jira/browse/TEZ-209
             Project: Apache Tez
          Issue Type: Improvement
            Reporter: Siddharth Seth


Use the Umbilical protocol to send the per vertex/input/ouput data specified by users instead of localizing the entire dag plan per task. Data size, #tasks can be used as a parameters to decide whether to send the data over RPC or as local resources.
The replication factor on the dag plan should be automatically increased if there's a large number of tasks.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira