You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Siddharth Seth (JIRA)" <ji...@apache.org> on 2014/11/15 00:47:34 UTC

[jira] [Created] (TEZ-1778) TezClient should supporting uploading and using previously uploaded jars from HDFS

Siddharth Seth created TEZ-1778:
-----------------------------------

             Summary: TezClient should supporting uploading and using previously uploaded jars from HDFS
                 Key: TEZ-1778
                 URL: https://issues.apache.org/jira/browse/TEZ-1778
             Project: Apache Tez
          Issue Type: Improvement
            Reporter: Siddharth Seth


Tez will be far easier to test and deploy if the HDFS pre-upload can be eliminated.
The Tez client could just upload the requisite jars if they don't already exist, to a common location.
This can get fairly tricky - and would likely end up with replication of the same jars per user (which isn't really too bad, instead of per job). We could leverage some of the work being done in YARN for making LocalResources easier to use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)