You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Chuan Liu (JIRA)" <ji...@apache.org> on 2013/08/07 23:13:48 UTC

[jira] [Commented] (HADOOP-9790) Job token path is not unquoted properly

    [ https://issues.apache.org/jira/browse/HADOOP-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13732749#comment-13732749 ] 

Chuan Liu commented on HADOOP-9790:
-----------------------------------

+1

bq. Oozie doesn't need to directly read HADOOP_TOKEN_FILE_LOCATION nor set it in the job conf. It's implicitly read by the UGI. The env is an implementation detail of how the container executor transfers tokens into a new process.

I think Ozzie uses DistCp in its mapreduce child tasks. Due to how we pass environment variable to child tasks on Windows, all code used by child tasks that accesses the environment variable values need to remove the surrounding quotes first.
                
> Job token path is not unquoted properly
> ---------------------------------------
>
>                 Key: HADOOP-9790
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9790
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 1-win
>         Environment: Windows
>            Reporter: Xi Fang
>            Assignee: Xi Fang
>         Attachments: HADOOP-9790.1.patch, HADOOP-9790.2.patch, stderr.txt
>
>
> Found during oozie unit tests (TestDistCpActionExecutor) and oozie ad-hoc testing (distcp action).
> The error is:
> Exception reading file:/"D:/git/Monarch/project/oozie-monarch/core/target/test-data/minicluster/mapred/local/0_0/taskTracker/test/jobcache/job_20130725105336682_0001/jobToken".

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira