You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2014/10/24 01:56:34 UTC

[jira] [Commented] (TEZ-1697) DAG submission fails if a local resource added is already part of tez.lib.uris

    [ https://issues.apache.org/jira/browse/TEZ-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14182207#comment-14182207 ] 

Rohini Palaniswamy commented on TEZ-1697:
-----------------------------------------

{code}
org.apache.tez.dag.api.TezUncheckedException: Attempting to add duplicate resource: guava-11.0.2.jar
at org.apache.tez.common.TezCommonUtils.addAdditionalLocalResources(TezCommonUtils.java:314)
at org.apache.tez.dag.api.DAG.createDag(DAG.java:648)
at org.apache.tez.client.TezClientUtils.prepareAndCreateDAGPlan(TezClientUtils.java:643)
at org.apache.tez.client.TezClient.submitDAGSession(TezClient.java:371)
at org.apache.tez.client.TezClient.submitDAG(TezClient.java:344)
at org.apache.pig.backend.hadoop.executionengine.tez.TezJob.run(TezJob.java:134)
at java.lang.Thread.run(Thread.java:722)
{code}
because guava is in tez lib uris and also pig adds it.
[~daijy] suggessted specifying tgz file in tez.lib.uris instead of directory to avoid this. But the purpose of the check is beaten anyway as the duplicate resources are ignored when tgz is there. Why not just log a warning? Mapreduce does this.

> DAG submission fails if a local resource added is already part of tez.lib.uris
> ------------------------------------------------------------------------------
>
>                 Key: TEZ-1697
>                 URL: https://issues.apache.org/jira/browse/TEZ-1697
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Rohini Palaniswamy
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)