You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Prasanth Jayachandran (JIRA)" <ji...@apache.org> on 2015/11/07 03:09:10 UTC
[jira] [Commented] (TEZ-2931) Running DistCp job in Tez with DEBUG
logging fails
[ https://issues.apache.org/jira/browse/TEZ-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994881#comment-14994881 ]
Prasanth Jayachandran commented on TEZ-2931:
--------------------------------------------
[~sseth] fyi..
> Running DistCp job in Tez with DEBUG logging fails
> --------------------------------------------------
>
> Key: TEZ-2931
> URL: https://issues.apache.org/jira/browse/TEZ-2931
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.5.2
> Reporter: Prasanth Jayachandran
>
> When working on HIVE-12364 I noticed the following exception when tez DEBUG logging is enabled. This fails all hive jobs that use distcp
> {code}
> Caused by: java.io.IOException: Cannot execute DistCp process: java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: application_1446860311492_0003-distcp:%20insert%20overwrite%20directory%20'/tmp/src'%20...src(Stage-1)-tez-dag.pb.txt
> at org.apache.hadoop.hive.shims.Hadoop23Shims.runDistCp(Hadoop23Shims.java:1180)
> at org.apache.hadoop.hive.common.FileUtils.copy(FileUtils.java:554)
> at org.apache.hadoop.hive.ql.metadata.Hive.moveFile(Hive.java:2625)
> ... 36 more
> Caused by: java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: application_1446860311492_0003-distcp:%20insert%20overwrite%20directory%20'/tmp/src'%20...src(Stage-1)-tez-dag.pb.txt
> at org.apache.hadoop.fs.Path.initialize(Path.java:206)
> at org.apache.hadoop.fs.Path.<init>(Path.java:172)
> at org.apache.hadoop.fs.Path.<init>(Path.java:94)
> at org.apache.tez.common.TezCommonUtils.getTezTextPlanStagingPath(TezCommonUtils.java:207)
> at org.apache.tez.client.TezClientUtils.localizeDagPlanAsText(TezClientUtils.java:737)
> at org.apache.tez.client.TezClientUtils.createApplicationSubmissionContext(TezClientUtils.java:598)
> at org.apache.tez.client.TezClient.submitDAGApplication(TezClient.java:680)
> at org.apache.tez.client.MRTezClient.submitDAGApplication(MRTezClient.java:47)
> at org.apache.tez.mapreduce.client.YARNRunner.submitJob(YARNRunner.java:648)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:536)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1296)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1293)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1293)
> at org.apache.hadoop.tools.DistCp.execute(DistCp.java:162)
> at org.apache.hadoop.hive.shims.Hadoop23Shims.runDistCp(Hadoop23Shims.java:1177)
> ... 38 more
> Caused by: java.net.URISyntaxException: Relative path in absolute URI: application_1446860311492_0003-distcp:%20insert%20overwrite%20directory%20'/tmp/src'%20...src(Stage-1)-tez-dag.pb.txt
> at java.net.URI.checkPath(URI.java:1823)
> at java.net.URI.<init>(URI.java:745)
> at org.apache.hadoop.fs.Path.initialize(Path.java:203)
> ... 55 more
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)