You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Devaraj K (JIRA)" <ji...@apache.org> on 2011/09/21 11:58:09 UTC
[jira] [Created] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Jobs are failing when those are submitted by other users
--------------------------------------------------------
Key: MAPREDUCE-3056
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: Devaraj K
Assignee: Devaraj K
Priority: Critical
MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
RE: [jira] [Updated] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by Devaraj k <de...@huawei.com>.
Hi Vinod,
I faced the problem exaclty as you explained.
The problem is the default staging dir use of ${user.name} system property, which is the job-submitter on the client side and the system user on the server side.
I started working on this issue, I will submit patch soon.
Thanks
Devaraj
________________________________________
From: Vinod Kumar Vavilapalli (JIRA) [jira@apache.org]
Sent: Monday, September 26, 2011 11:21 PM
To: mapreduce-issues@hadoop.apache.org
Subject: [jira] [Updated] (MAPREDUCE-3056) Jobs are failing when those are submitted by other users
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod Kumar Vavilapalli updated MAPREDUCE-3056:
-----------------------------------------------
Component/s: applicationmaster
Fix Version/s: 0.23.0
I ran into this today myself. This happens with DefaultContainerExecutor case, which most of us are not using (surprise :) )
Devaraj (K), can you confirm?
The problem is the default staging dir use of ${user.name} system property, which is the job-submitter on the client side and the system user on the server side.
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Critical
> Fix For: 0.23.0
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13119985#comment-13119985 ]
Hudson commented on MAPREDUCE-3056:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #1009 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1009/])
MAPREDUCE-3056. Changed the default staging directory to not include user.name to prevent issues with non-secure mode. Contributed by Devaraj K.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178740
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestMRAppMaster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056-1.patch, MAPREDUCE-3056-2.patch, MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13119983#comment-13119983 ]
Hudson commented on MAPREDUCE-3056:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #1029 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1029/])
MAPREDUCE-3056. Changed the default staging directory to not include user.name to prevent issues with non-secure mode. Contributed by Devaraj K.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178740
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestMRAppMaster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056-1.patch, MAPREDUCE-3056-2.patch, MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-3056:
---------------------------------
Attachment: MAPREDUCE-3056-2.patch
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056-1.patch, MAPREDUCE-3056-2.patch, MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-3056:
---------------------------------
Attachment: MAPREDUCE-3056.patch
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13119987#comment-13119987 ]
Hudson commented on MAPREDUCE-3056:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #1087 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1087/])
MAPREDUCE-3056. Changed the default staging directory to not include user.name to prevent issues with non-secure mode. Contributed by Devaraj K.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178740
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestMRAppMaster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056-1.patch, MAPREDUCE-3056-2.patch, MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-3056:
---------------------------------
Fix Version/s: 0.24.0
Status: Patch Available (was: Open)
1. The default value of staging dir uses the ${user.name}. It is getting substituted in the app master with the server user name but it should use the client user name.
For this issue, as per ATM suggestion I have removed the user.name from the default staging dir.
2. Here the staging area dir uses the user name. It was using the system user name for this in couple of places and I have changed it to job submitted user name.
{code:title=MRApps.java|borderStyle=solid}
public static Path getStagingAreaDir(Configuration conf, String user) {
return new Path(
conf.get(MRJobConfig.MR_AM_STAGING_DIR) +
Path.SEPARATOR + user + Path.SEPARATOR + STAGING_CONSTANT);
}
{code}
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13119911#comment-13119911 ]
Hadoop QA commented on MAPREDUCE-3056:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12497591/MAPREDUCE-3056-2.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/933//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/933//console
This message is automatically generated.
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056-1.patch, MAPREDUCE-3056-2.patch, MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Devaraj K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13109661#comment-13109661 ]
Devaraj K commented on MAPREDUCE-3056:
--------------------------------------
Yes Mahadev. App Master is still referring the root's staging dir.
Client is showing the staging dir as 'hdfs://10.18.52.124:9000/tmp/hadoop-yarn/devaraj/staging/devaraj/.staging' when the submitted user name is 'devaraj'.
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Critical
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120111#comment-13120111 ]
Hudson commented on MAPREDUCE-3056:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #29 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/29/])
MAPREDUCE-3056. svn merge -c r1178740 --ignore-ancestry ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178741
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestMRAppMaster.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056-1.patch, MAPREDUCE-3056-2.patch, MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Aaron T. Myers (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13118229#comment-13118229 ]
Aaron T. Myers commented on MAPREDUCE-3056:
-------------------------------------------
Hey Devaraj, it should be possible to write a test for this, right? Or am I missing something that would make doing so difficult?
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3056:
-------------------------------------
Status: Open (was: Patch Available)
Agree with atm. Please provide a test case. Thanks!
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13117982#comment-13117982 ]
Hadoop QA commented on MAPREDUCE-3056:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12497139/MAPREDUCE-3056.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/906//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/906//console
This message is automatically generated.
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Arun C Murthy (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13118503#comment-13118503 ]
Arun C Murthy commented on MAPREDUCE-3056:
------------------------------------------
Also, don't get user name for config. Always use UGI.getCurrentUser.
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Vinod Kumar Vavilapalli (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod Kumar Vavilapalli updated MAPREDUCE-3056:
-----------------------------------------------
Component/s: applicationmaster
Fix Version/s: 0.23.0
I ran into this today myself. This happens with DefaultContainerExecutor case, which most of us are not using (surprise :) )
Devaraj (K), can you confirm?
The problem is the default staging dir use of ${user.name} system property, which is the job-submitter on the client side and the system user on the server side.
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Critical
> Fix For: 0.23.0
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120090#comment-13120090 ]
Hudson commented on MAPREDUCE-3056:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #820 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/820/])
MAPREDUCE-3056. Changed the default staging directory to not include user.name to prevent issues with non-secure mode. Contributed by Devaraj K.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178740
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestMRAppMaster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056-1.patch, MAPREDUCE-3056-2.patch, MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120124#comment-13120124 ]
Hudson commented on MAPREDUCE-3056:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #850 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/850/])
MAPREDUCE-3056. Changed the default staging directory to not include user.name to prevent issues with non-secure mode. Contributed by Devaraj K.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178740
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestMRAppMaster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056-1.patch, MAPREDUCE-3056-2.patch, MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Devaraj K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-3056:
---------------------------------
Component/s: mrv2
Affects Version/s: 0.24.0
0.23.0
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Critical
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Aaron T. Myers (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13114932#comment-13114932 ]
Aaron T. Myers commented on MAPREDUCE-3056:
-------------------------------------------
FWIW, basically the same bug exists in 0.20.x when ${user.name} is used in the value of the mapred.local.dir with the {{LinuxTaskController}}. I'd personally like to completely abandon support for expanding ${user.name} in configs for exactly this reason (HADOOP-7522) but in the absence of that, removing it from default values is certainly a step in the right direction.
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Critical
> Fix For: 0.23.0
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-3056:
---------------------------------
Status: Patch Available (was: Open)
Thanks for looking into the patch.
I have updated the patch as per above comments.
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056-1.patch, MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Vinod Kumar Vavilapalli (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod Kumar Vavilapalli updated MAPREDUCE-3056:
-----------------------------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
+1.
I just committed this to trunk and branch-0.23. Thanks Devaraj (K)!
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056-1.patch, MAPREDUCE-3056-2.patch, MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Devaraj K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13109380#comment-13109380 ]
Devaraj K commented on MAPREDUCE-3056:
--------------------------------------
{code:xml}
2011-09-20 10:28:55,661 INFO impl.JobImpl (JobImpl.java:setup(1001)) - DEBUG --- startJobs: parent=/tmp/hadoop-yarn/root/staging/root/.staging child=job_1316481926401_0003
2011-09-20 10:28:55,667 INFO impl.JobImpl (JobImpl.java:setup(1022)) - Adding job token for job_1316481926401_0003 to jobTokenSecretManager
2011-09-20 10:28:55,987 INFO impl.JobImpl (JobImpl.java:setup(1038)) - Writing back the job-token file on the remote file system:hdfs://10.18.52.124:9000/tmp/hadoop-yarn/root/staging/root/.staging/job_1316481926401_0003/appTokens
2011-09-20 10:28:56,486 FATAL app.MRAppMaster (MRAppMaster.java:main(668)) - Error starting MRAppMaster
org.apache.hadoop.yarn.YarnException: java.io.FileNotFoundException: File does not exist: hdfs://10.18.52.124:9000/tmp/hadoop-yarn/root/staging/root/.staging/job_1316481926401_0003/job.splitmetainfo
at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.createSplits(JobImpl.java:1113)
at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.transition(JobImpl.java:838)
at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.transition(JobImpl.java:809)
at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:376)
at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:294)
at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:39)
at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:439)
at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.handle(JobImpl.java:684)
at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl.handle(JobImpl.java:117)
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher.handle(MRAppMaster.java:609)
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.start(MRAppMaster.java:563)
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:666)
Caused by: java.io.FileNotFoundException: File does not exist: hdfs://10.18.52.124:9000/tmp/hadoop-yarn/root/staging/root/.staging/job_1316481926401_0003/job.splitmetainfo
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:764)
at org.apache.hadoop.mapreduce.split.SplitMetaInfoReader.readSplitMetaInfo(SplitMetaInfoReader.java:50)
at org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl$InitTransition.createSplits(JobImpl.java:1108)
... 11 more
2011-09-20 10:28:56,488 INFO jobhistory.JobHistoryEventHandler (JobHistoryEventHandler.java:stop(238)) - Stopping JobHistoryEventHandler
2011-09-20 10:28:56,488 INFO service.CompositeService (CompositeService.java:stop(97)) - Error stopping JobHistoryEventHandler
java.lang.NullPointerException
at org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler.stop(JobHistoryEventHandler.java:242)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:95)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:85)
at org.apache.hadoop.yarn.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:118)
2011-09-20 10:28:56,489 INFO service.CompositeService (CompositeService.java:stop(97)) - Error stopping org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
java.lang.NullPointerException
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter.stop(MRAppMaster.java:487)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:95)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:85)
at org.apache.hadoop.yarn.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:118)
2011-09-20 10:28:56,489 INFO service.CompositeService (CompositeService.java:stop(97)) - Error stopping org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
java.lang.NullPointerException
at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter.stop(MRAppMaster.java:443)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:95)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:85)
at org.apache.hadoop.yarn.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:118)
2011-09-20 10:28:56,489 INFO service.CompositeService (CompositeService.java:stop(97)) - Error stopping org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator
java.lang.IllegalStateException: For this operation, current State must be STARTED instead of INITED
at org.apache.hadoop.yarn.service.AbstractService.ensureCurrentState(AbstractService.java:101)
at org.apache.hadoop.yarn.service.AbstractService.stop(AbstractService.java:69)
at org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator.stop(DefaultSpeculator.java:213)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:95)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:85)
at org.apache.hadoop.yarn.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:118)
2011-09-20 10:28:56,491 INFO service.CompositeService (CompositeService.java:stop(97)) - Error stopping MRClientService
java.lang.NullPointerException
at org.apache.hadoop.mapreduce.v2.app.client.MRClientService.stop(MRClientService.java:161)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:95)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:85)
at org.apache.hadoop.yarn.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:118)
2011-09-20 10:28:56,492 INFO service.CompositeService (CompositeService.java:stop(97)) - Error stopping TaskCleaner
java.lang.NullPointerException
at org.apache.hadoop.mapreduce.v2.app.taskclean.TaskCleanerImpl.stop(TaskCleanerImpl.java:73)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:95)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:85)
at org.apache.hadoop.yarn.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:118)
2011-09-20 10:28:56,492 INFO service.CompositeService (CompositeService.java:stop(97)) - Error stopping org.apache.hadoop.mapred.TaskAttemptListenerImpl
java.lang.NullPointerException
at org.apache.hadoop.mapred.TaskAttemptListenerImpl.stopRpcServer(TaskAttemptListenerImpl.java:128)
at org.apache.hadoop.mapred.TaskAttemptListenerImpl.stop(TaskAttemptListenerImpl.java:123)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:95)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:85)
at org.apache.hadoop.yarn.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:118)
2011-09-20 10:28:56,492 INFO service.CompositeService (CompositeService.java:stop(97)) - Error stopping Dispatcher
java.lang.NullPointerException
at org.apache.hadoop.yarn.event.AsyncDispatcher.stop(AsyncDispatcher.java:93)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:95)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:85)
at org.apache.hadoop.yarn.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:118)
2011-09-20 10:28:56,493 INFO service.CompositeService (CompositeService.java:run(120)) - Error stopping org.apache.hadoop.mapreduce.v2.app.MRAppMaster
java.lang.IllegalStateException: For this operation, current State must be STARTED instead of INITED
at org.apache.hadoop.yarn.service.AbstractService.ensureCurrentState(AbstractService.java:101)
at org.apache.hadoop.yarn.service.AbstractService.stop(AbstractService.java:69)
at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:87)
at org.apache.hadoop.yarn.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:118)
{code}
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Critical
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13109618#comment-13109618 ]
Mahadev konar commented on MAPREDUCE-3056:
------------------------------------------
@Devaraj,
Looks like the staging dir still is pointing to roots dir?
bq. java.io.FileNotFoundException: File does not exist: hdfs://10.18.52.124:9000/tmp/hadoop-yarn/root/staging/root/.staging/job_1316481926401_0003/job.splitmetainfo
Do you have the client trace? What staging dir is shown on the client?
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Critical
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13119356#comment-13119356 ]
Hadoop QA commented on MAPREDUCE-3056:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12497470/MAPREDUCE-3056-1.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/926//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/926//console
This message is automatically generated.
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056-1.patch, MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-3056:
---------------------------------
Attachment: MAPREDUCE-3056-1.patch
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056-1.patch, MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Mahadev konar (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated MAPREDUCE-3056:
-------------------------------------
Priority: Blocker (was: Critical)
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Devaraj K (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13118115#comment-13118115 ]
Devaraj K commented on MAPREDUCE-3056:
--------------------------------------
I have verified it manually, jobs submitted by other users are executing fine. Please review this.
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K updated MAPREDUCE-3056:
---------------------------------
Status: Patch Available (was: Open)
Thanks Vinod.
bq.You missed changes for mapred-default.xml in the latest patch.
I,m sorry, missed this. I have included in the latest patch.
bq.Wrap lines >80 chars
I have taken care in the updated patch.
bq.MRAppMaster is a process started by NM and so current-user has no tokens loaded. You can drop the loading of tokens from current-user into the created user.
Removed the loading of tokens.
bq.You could collapse MRAppMaster.initAndStartAppMaster() inline and directly invoke main() in the test mocking the System.getenv() calls. Please try if it is possible, otherwise I am okay if you drop this.
I have not done this change because it requires for the testcase.
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056-1.patch, MAPREDUCE-3056-2.patch, MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Vinod Kumar Vavilapalli (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod Kumar Vavilapalli updated MAPREDUCE-3056:
-----------------------------------------------
Status: Open (was: Patch Available)
You missed changes for mapred-default.xml in the latest patch.
MRAppMaster:
- Wrap lines >80 chars
- MRAppMaster is a process started by NM and so current-user has no tokens loaded. You can drop the loading of tokens from current-user into the created user.
- You could collapse MRAppMaster.initAndStartAppMaster() inline and directly invoke main() in the test mocking the System.getenv() calls. Please try if it is possible, otherwise I am okay if you drop this.
Thanks!
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056-1.patch, MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3056) Jobs are failing when those are
submitted by other users
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120068#comment-13120068 ]
Hudson commented on MAPREDUCE-3056:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Build #36 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/36/])
MAPREDUCE-3056. svn merge -c r1178740 --ignore-ancestry ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178741
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestMRAppMaster.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
> Jobs are failing when those are submitted by other users
> --------------------------------------------------------
>
> Key: MAPREDUCE-3056
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3056
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Priority: Blocker
> Fix For: 0.23.0, 0.24.0
>
> Attachments: MAPREDUCE-3056-1.patch, MAPREDUCE-3056-2.patch, MAPREDUCE-3056.patch
>
>
> MR cluster is started by the user 'root'. If any other users other than 'root' submit a job, it is failing always.
> Find the conatiner logs in the comments section.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira