You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Weili Shao (Commented) (JIRA)" <ji...@apache.org> on 2012/02/18 19:17:59 UTC
[jira] [Commented] (HADOOP-8089) cannot submit job from Eclipse
plugin running on Windows
[ https://issues.apache.org/jira/browse/HADOOP-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13211041#comment-13211041 ]
Weili Shao commented on HADOOP-8089:
------------------------------------
I think I found the reason at high level, after I put a return to avoid that permission setting, the job started with a localjobrunner and the result was written to the remote hdfs, which confused me for a while, since I had no knowledge of localjobrunner before. Now I realize that it's really that the JobClient wasn't initiated properly from the plugin xml conf, so without any mapred.job.tracker settings, it just started the localjobrunner. After I added the code:
Configuration conf = new Configuration();
conf.set("mapred.job.tracker", "[server]:9001");
It's working now. However. This configuration should be loaded from plugin's server configuration and it used to be working.
> cannot submit job from Eclipse plugin running on Windows
> --------------------------------------------------------
>
> Key: HADOOP-8089
> URL: https://issues.apache.org/jira/browse/HADOOP-8089
> Project: Hadoop Common
> Issue Type: Bug
> Components: contrib/eclipse-plugin
> Affects Versions: 1.0.0
> Environment: Windows XP
> Reporter: Weili Shao
>
> Built eclipse plugin for 1.0.0 on Windows and using it to submit a job, I got the following error:
> 12/02/17 17:14:24 ERROR security.UserGroupInformation: PriviledgedActionException as:weilis cause:java.io.IOException: Failed to set permissions of path: \tmp\hadoop-weilis\mapred\staging\weilis753422487\.staging to 0700
> Exception in thread "main" java.io.IOException: Failed to set permissions of path: \tmp\hadoop-weilis\mapred\staging\weilis753422487\.staging to 0700
> at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:682)
> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:655)
> at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
> at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
> at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
> at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:856)
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1083)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:465)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:495)
> The job staging area local on Windows system and I don't think there is a way to set a local file's permission to 0700 anyway. Please have a look.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira