You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Ming Ma (JIRA)" <ji...@apache.org> on 2016/07/12 23:22:20 UTC
[jira] [Updated] (TEZ-3340) Add support for YARN Shared Cache
[ https://issues.apache.org/jira/browse/TEZ-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ming Ma updated TEZ-3340:
-------------------------
Description:
YARN provides shared cache in functionality YARN-1492. According to [~ctrezzo] most of the YARN functionality is in hadoop 2.8 and frameworks can start to use it. MR adds the support via MAPREDUCE-5951.
Can anyone confirm if Tez supports the upload of application DAG jar and dependent lib jars from client machine to HDFS as part of Tez app submission? From my test, that doesn't seem to happen. Instead Tez expects applications to upload the jars to HDFS beforehand and then set the tez.aux.uris to the HDFS locations.
was:
YARN provides shared cache in functionality YARN-1492. According to [~ctrezzo] most of the YARN functionality is in hadoop 2.8 and frameworks can start to use it. MR adds the support via MAPREDUCE-5951.
Can anyone confirm if Tez supports the upload of application DAG jar and dependent lib jars from client machine to HDFS as part of Tez app submission? From my test, that doesn't seem to happen. Tez expects applications to upload the jars to HDFS beforehand and then set the tez.aux.uris to the HDFS locations.
> Add support for YARN Shared Cache
> ---------------------------------
>
> Key: TEZ-3340
> URL: https://issues.apache.org/jira/browse/TEZ-3340
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Ming Ma
>
> YARN provides shared cache in functionality YARN-1492. According to [~ctrezzo] most of the YARN functionality is in hadoop 2.8 and frameworks can start to use it. MR adds the support via MAPREDUCE-5951.
> Can anyone confirm if Tez supports the upload of application DAG jar and dependent lib jars from client machine to HDFS as part of Tez app submission? From my test, that doesn't seem to happen. Instead Tez expects applications to upload the jars to HDFS beforehand and then set the tez.aux.uris to the HDFS locations.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)