[jira] [Commented] (MAPREDUCE-2687) Non superusers unable to launch apps in a non-secure cluster

["Ramya Sunil (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13066085#comment-13066085 ] 

Ramya Sunil commented on MAPREDUCE-2687:
----------------------------------------

The job is submitted as user ramya and mr_superuser is the owner of the mrv2 cluster. Below is the snippet of the logs:
{noformat}

INFO impl.JobImpl: DEBUG --- startJobs: parent=/user/mr_superuser/.staging child=jobID
INFO impl.JobImpl: Adding job token for jobID to jobTokenSecretManager
INFO impl.JobImpl: Writing back the job-token file on the remote file system:hdfs://<namenodehost>:<port>/user/mr_superuser/.staging/jobID/appTokens
WARN impl.JobImpl: Job init failed
org.apache.hadoop.yarn.YarnException: java.io.FileNotFoundException: File does not exist: hdfs://<namenodehost>:<port>/user/mr_superuser/.staging/jobID/job.splitmetainfo  
        at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.createSplits(JobImpl.java:1071)
        at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.transition(JobImpl.java:800)
        at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.transition(JobImpl.java:771)
        at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:376)
        at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:294)
        at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:39)
        at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:439)
        at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.handle(JobImpl.java:669)
        at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.handle(JobImpl.java:116)
        at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher.handle(MRAppMaster.java:508)
        at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.init(MRAppMaster.java:240)
        at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:558)
Caused by: java.io.FileNotFoundException: File does not exist: hdfs://<namenodehost>:<port>/user/mr_superuser/.staging/jobID/job.splitmetainfo
        at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:739)
        at org.apache.hadoop.mapreduce.split.SplitMetaInfoReader.readSplitMetaInfo(SplitMetaInfoReader.java:50)
        at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.createSplits(JobImpl.java:1066)
        ... 11 more
11/07/14 18:32:17 ERROR app.MRAppMaster: Caught throwable. Exiting:
java.lang.NullPointerException
        at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.abortJob(JobImpl.java:1118)
        at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.access$2900(JobImpl.java:116)
        at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.transition(JobImpl.java:947)
        at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.transition(JobImpl.java:771)
        at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:376)
        at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:294)
        at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:39)
        at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:439)
        at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.handle(JobImpl.java:669)
        at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.handle(JobImpl.java:116)
        at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher.handle(MRAppMaster.java:508)
        at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.init(MRAppMaster.java:240)
        at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:558)
{noformat}

> Non superusers unable to launch apps in a non-secure cluster
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-2687
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2687
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Ramya Sunil
>             Fix For: 0.23.0
>
>
> Apps of non superuser fail to succeed in a non-secure environment. Only the superuser(i.e. one who started/owns the mrv2 cluster) is able to launch apps successfully. However, when a normal user submits a job, the job fails.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira