You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Siddharth Seth (JIRA)" <ji...@apache.org> on 2013/06/11 07:32:20 UTC
[jira] [Created] (TEZ-209) Optionally send the
per-vertex/input/output data specified by users over RPC
Siddharth Seth created TEZ-209:
----------------------------------
Summary: Optionally send the per-vertex/input/output data specified by users over RPC
Key: TEZ-209
URL: https://issues.apache.org/jira/browse/TEZ-209
Project: Apache Tez
Issue Type: Improvement
Reporter: Siddharth Seth
Use the Umbilical protocol to send the per vertex/input/ouput data specified by users instead of localizing the entire dag plan per task. Data size, #tasks can be used as a parameters to decide whether to send the data over RPC or as local resources.
The replication factor on the dag plan should be automatically increased if there's a large number of tasks.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira