You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Andrew Gudkov (JIRA)" <ji...@apache.org> on 2008/03/06 18:48:58 UTC
[jira] Created: (HADOOP-2953) namenode doesn't start if group id
cannot be resolved to name
namenode doesn't start if group id cannot be resolved to name
-------------------------------------------------------------
Key: HADOOP-2953
URL: https://issues.apache.org/jira/browse/HADOOP-2953
Project: Hadoop Core
Issue Type: Bug
Components: dfs
Affects Versions: 0.16.0
Environment: Linux n510 2.6.22-3-686 #1 SMP Mon Nov 12 08:32:57 UTC 2007 i686 GNU/Linux
Java:
java version "1.5.0_14"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_14-b03)
Java HotSpot(TM) Client VM (build 1.5.0_14-b03, mixed mode, sharing)
PAM: ldap
Reporter: Andrew Gudkov
Priority: Minor
Namenode failes to start because unix group name for my user can't be got. First, system threw rather obscure message:
{quote}
ERROR dfs.NameNode (NameNode.java:main(856)) - java.lang.NullPointerException
at org.apache.hadoop.dfs.FSNamesystem.close(FSNamesystem.java:428)
at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:237)
at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
{quote}
I traversed through stack trace entries, and found (FSNamesystem:237) this code
{quote}
233 FSNamesystem(NameNode nn, Configuration conf) throws IOException {
234 try {
235 initialize(nn, conf);
236 } catch(IOException e) {
237 close();
238 throw e;
239 }
240 }
{quote}
Inserting e.printStackTrace() gave me next
{quote}
dfs.NameNodeMetrics (NameNodeMetrics.java:<init>(76)) - Initializing NameNodeMeterics using context object:org.apache.hadoop.metrics.spi.NullContext
java.io.IOException: javax.security.auth.login.LoginException: Login failed: id: cannot find name for group ID 1040
at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)
at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:268)
at org.apache.hadoop.dfs.FSNamesystem.setConfigurationParameters(FSNamesystem.java:330)
at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:249)
at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
at org.apache.hadoop.dfs.FSNamesystem.setConfigurationParameters(FSNamesystem.java:332)
at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:249)
at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
{quote}
And this is true - command "groups" returns the same - id: cannot find name for group ID 1040.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2953) namenode doesn't start if group id
cannot be resolved to name
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-2953:
----------------------------------
Status: Open (was: Patch Available)
bq. id -rgn should be id -rGn
+1
So Hudson can apply the patch, could you generate it from the root? It should apply cleanly with {{patch \-p0 < _file_}}
> namenode doesn't start if group id cannot be resolved to name
> -------------------------------------------------------------
>
> Key: HADOOP-2953
> URL: https://issues.apache.org/jira/browse/HADOOP-2953
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.18.1
> Environment: Linux n510 2.6.22-3-686 #1 SMP Mon Nov 12 08:32:57 UTC 2007 i686 GNU/Linux
> Java:
> java version "1.5.0_14"
> Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_14-b03)
> Java HotSpot(TM) Client VM (build 1.5.0_14-b03, mixed mode, sharing)
> PAM: ldap
> Reporter: Andrew Gudkov
> Priority: Minor
> Attachments: groupname.patch
>
>
> Namenode failes to start because unix group name for my user can't be got. First, system threw rather obscure message:
> {quote}
> ERROR dfs.NameNode (NameNode.java:main(856)) - java.lang.NullPointerException
> at org.apache.hadoop.dfs.FSNamesystem.close(FSNamesystem.java:428)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:237)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> {quote}
> I traversed through stack trace entries, and found (FSNamesystem:237) this code
> {quote}
> 233 FSNamesystem(NameNode nn, Configuration conf) throws IOException {
> 234 try {
> 235 initialize(nn, conf);
> 236 } catch(IOException e) {
> 237 close();
> 238 throw e;
> 239 }
> 240 }
> {quote}
> Inserting e.printStackTrace() gave me next
> {quote}
> dfs.NameNodeMetrics (NameNodeMetrics.java:<init>(76)) - Initializing NameNodeMeterics using context object:org.apache.hadoop.metrics.spi.NullContext
> java.io.IOException: javax.security.auth.login.LoginException: Login failed: id: cannot find name for group ID 1040
> at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)
> at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:268)
> at org.apache.hadoop.dfs.FSNamesystem.setConfigurationParameters(FSNamesystem.java:330)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:249)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> at org.apache.hadoop.dfs.FSNamesystem.setConfigurationParameters(FSNamesystem.java:332)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:249)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> {quote}
> And this is true - command "groups" returns the same - id: cannot find name for group ID 1040.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2953) namenode doesn't start if group id
cannot be resolved to name
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12575927#action_12575927 ]
Tsz Wo (Nicholas), SZE commented on HADOOP-2953:
------------------------------------------------
- The command `bash -c groups` is used to obtain group information and the NameNode cannot be started if group information is not available.
- We certainly should have some better error messages.
> namenode doesn't start if group id cannot be resolved to name
> -------------------------------------------------------------
>
> Key: HADOOP-2953
> URL: https://issues.apache.org/jira/browse/HADOOP-2953
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.16.0
> Environment: Linux n510 2.6.22-3-686 #1 SMP Mon Nov 12 08:32:57 UTC 2007 i686 GNU/Linux
> Java:
> java version "1.5.0_14"
> Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_14-b03)
> Java HotSpot(TM) Client VM (build 1.5.0_14-b03, mixed mode, sharing)
> PAM: ldap
> Reporter: Andrew Gudkov
> Priority: Minor
>
> Namenode failes to start because unix group name for my user can't be got. First, system threw rather obscure message:
> {quote}
> ERROR dfs.NameNode (NameNode.java:main(856)) - java.lang.NullPointerException
> at org.apache.hadoop.dfs.FSNamesystem.close(FSNamesystem.java:428)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:237)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> {quote}
> I traversed through stack trace entries, and found (FSNamesystem:237) this code
> {quote}
> 233 FSNamesystem(NameNode nn, Configuration conf) throws IOException {
> 234 try {
> 235 initialize(nn, conf);
> 236 } catch(IOException e) {
> 237 close();
> 238 throw e;
> 239 }
> 240 }
> {quote}
> Inserting e.printStackTrace() gave me next
> {quote}
> dfs.NameNodeMetrics (NameNodeMetrics.java:<init>(76)) - Initializing NameNodeMeterics using context object:org.apache.hadoop.metrics.spi.NullContext
> java.io.IOException: javax.security.auth.login.LoginException: Login failed: id: cannot find name for group ID 1040
> at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)
> at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:268)
> at org.apache.hadoop.dfs.FSNamesystem.setConfigurationParameters(FSNamesystem.java:330)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:249)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> at org.apache.hadoop.dfs.FSNamesystem.setConfigurationParameters(FSNamesystem.java:332)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:249)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> {quote}
> And this is true - command "groups" returns the same - id: cannot find name for group ID 1040.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-2953) namenode doesn't start if group id
cannot be resolved to name
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas reassigned HADOOP-2953:
-------------------------------------
Assignee: Patrick Winters
> namenode doesn't start if group id cannot be resolved to name
> -------------------------------------------------------------
>
> Key: HADOOP-2953
> URL: https://issues.apache.org/jira/browse/HADOOP-2953
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.18.1
> Environment: Linux n510 2.6.22-3-686 #1 SMP Mon Nov 12 08:32:57 UTC 2007 i686 GNU/Linux
> Java:
> java version "1.5.0_14"
> Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_14-b03)
> Java HotSpot(TM) Client VM (build 1.5.0_14-b03, mixed mode, sharing)
> PAM: ldap
> Reporter: Andrew Gudkov
> Assignee: Patrick Winters
> Priority: Minor
> Attachments: groupname.patch
>
>
> Namenode failes to start because unix group name for my user can't be got. First, system threw rather obscure message:
> {quote}
> ERROR dfs.NameNode (NameNode.java:main(856)) - java.lang.NullPointerException
> at org.apache.hadoop.dfs.FSNamesystem.close(FSNamesystem.java:428)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:237)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> {quote}
> I traversed through stack trace entries, and found (FSNamesystem:237) this code
> {quote}
> 233 FSNamesystem(NameNode nn, Configuration conf) throws IOException {
> 234 try {
> 235 initialize(nn, conf);
> 236 } catch(IOException e) {
> 237 close();
> 238 throw e;
> 239 }
> 240 }
> {quote}
> Inserting e.printStackTrace() gave me next
> {quote}
> dfs.NameNodeMetrics (NameNodeMetrics.java:<init>(76)) - Initializing NameNodeMeterics using context object:org.apache.hadoop.metrics.spi.NullContext
> java.io.IOException: javax.security.auth.login.LoginException: Login failed: id: cannot find name for group ID 1040
> at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)
> at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:268)
> at org.apache.hadoop.dfs.FSNamesystem.setConfigurationParameters(FSNamesystem.java:330)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:249)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> at org.apache.hadoop.dfs.FSNamesystem.setConfigurationParameters(FSNamesystem.java:332)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:249)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> {quote}
> And this is true - command "groups" returns the same - id: cannot find name for group ID 1040.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2953) namenode doesn't start if group id
cannot be resolved to name
Posted by "Patrick Winters (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Patrick Winters updated HADOOP-2953:
------------------------------------
Attachment: groupname.patch
> namenode doesn't start if group id cannot be resolved to name
> -------------------------------------------------------------
>
> Key: HADOOP-2953
> URL: https://issues.apache.org/jira/browse/HADOOP-2953
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.18.1
> Environment: Linux n510 2.6.22-3-686 #1 SMP Mon Nov 12 08:32:57 UTC 2007 i686 GNU/Linux
> Java:
> java version "1.5.0_14"
> Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_14-b03)
> Java HotSpot(TM) Client VM (build 1.5.0_14-b03, mixed mode, sharing)
> PAM: ldap
> Reporter: Andrew Gudkov
> Priority: Minor
> Attachments: groupname.patch
>
>
> Namenode failes to start because unix group name for my user can't be got. First, system threw rather obscure message:
> {quote}
> ERROR dfs.NameNode (NameNode.java:main(856)) - java.lang.NullPointerException
> at org.apache.hadoop.dfs.FSNamesystem.close(FSNamesystem.java:428)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:237)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> {quote}
> I traversed through stack trace entries, and found (FSNamesystem:237) this code
> {quote}
> 233 FSNamesystem(NameNode nn, Configuration conf) throws IOException {
> 234 try {
> 235 initialize(nn, conf);
> 236 } catch(IOException e) {
> 237 close();
> 238 throw e;
> 239 }
> 240 }
> {quote}
> Inserting e.printStackTrace() gave me next
> {quote}
> dfs.NameNodeMetrics (NameNodeMetrics.java:<init>(76)) - Initializing NameNodeMeterics using context object:org.apache.hadoop.metrics.spi.NullContext
> java.io.IOException: javax.security.auth.login.LoginException: Login failed: id: cannot find name for group ID 1040
> at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)
> at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:268)
> at org.apache.hadoop.dfs.FSNamesystem.setConfigurationParameters(FSNamesystem.java:330)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:249)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> at org.apache.hadoop.dfs.FSNamesystem.setConfigurationParameters(FSNamesystem.java:332)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:249)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> {quote}
> And this is true - command "groups" returns the same - id: cannot find name for group ID 1040.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2953) namenode doesn't start if group id
cannot be resolved to name
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12643528#action_12643528 ]
Hadoop QA commented on HADOOP-2953:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12392995/groupname.patch
against trunk revision 708774.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
-1 patch. The patch command could not apply the patch.
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3507/console
This message is automatically generated.
> namenode doesn't start if group id cannot be resolved to name
> -------------------------------------------------------------
>
> Key: HADOOP-2953
> URL: https://issues.apache.org/jira/browse/HADOOP-2953
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.18.1
> Environment: Linux n510 2.6.22-3-686 #1 SMP Mon Nov 12 08:32:57 UTC 2007 i686 GNU/Linux
> Java:
> java version "1.5.0_14"
> Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_14-b03)
> Java HotSpot(TM) Client VM (build 1.5.0_14-b03, mixed mode, sharing)
> PAM: ldap
> Reporter: Andrew Gudkov
> Priority: Minor
> Attachments: groupname.patch
>
>
> Namenode failes to start because unix group name for my user can't be got. First, system threw rather obscure message:
> {quote}
> ERROR dfs.NameNode (NameNode.java:main(856)) - java.lang.NullPointerException
> at org.apache.hadoop.dfs.FSNamesystem.close(FSNamesystem.java:428)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:237)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> {quote}
> I traversed through stack trace entries, and found (FSNamesystem:237) this code
> {quote}
> 233 FSNamesystem(NameNode nn, Configuration conf) throws IOException {
> 234 try {
> 235 initialize(nn, conf);
> 236 } catch(IOException e) {
> 237 close();
> 238 throw e;
> 239 }
> 240 }
> {quote}
> Inserting e.printStackTrace() gave me next
> {quote}
> dfs.NameNodeMetrics (NameNodeMetrics.java:<init>(76)) - Initializing NameNodeMeterics using context object:org.apache.hadoop.metrics.spi.NullContext
> java.io.IOException: javax.security.auth.login.LoginException: Login failed: id: cannot find name for group ID 1040
> at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)
> at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:268)
> at org.apache.hadoop.dfs.FSNamesystem.setConfigurationParameters(FSNamesystem.java:330)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:249)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> at org.apache.hadoop.dfs.FSNamesystem.setConfigurationParameters(FSNamesystem.java:332)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:249)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> {quote}
> And this is true - command "groups" returns the same - id: cannot find name for group ID 1040.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2953) namenode doesn't start if group id
cannot be resolved to name
Posted by "Patrick Winters (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Patrick Winters updated HADOOP-2953:
------------------------------------
Affects Version/s: (was: 0.16.0)
0.18.1
Status: Patch Available (was: Open)
Replaces the `groups` command for getting groups names with `id -rgn` which uses only real groups, ignoring effective id's.
> namenode doesn't start if group id cannot be resolved to name
> -------------------------------------------------------------
>
> Key: HADOOP-2953
> URL: https://issues.apache.org/jira/browse/HADOOP-2953
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.18.1
> Environment: Linux n510 2.6.22-3-686 #1 SMP Mon Nov 12 08:32:57 UTC 2007 i686 GNU/Linux
> Java:
> java version "1.5.0_14"
> Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_14-b03)
> Java HotSpot(TM) Client VM (build 1.5.0_14-b03, mixed mode, sharing)
> PAM: ldap
> Reporter: Andrew Gudkov
> Priority: Minor
> Attachments: groupname.patch
>
>
> Namenode failes to start because unix group name for my user can't be got. First, system threw rather obscure message:
> {quote}
> ERROR dfs.NameNode (NameNode.java:main(856)) - java.lang.NullPointerException
> at org.apache.hadoop.dfs.FSNamesystem.close(FSNamesystem.java:428)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:237)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> {quote}
> I traversed through stack trace entries, and found (FSNamesystem:237) this code
> {quote}
> 233 FSNamesystem(NameNode nn, Configuration conf) throws IOException {
> 234 try {
> 235 initialize(nn, conf);
> 236 } catch(IOException e) {
> 237 close();
> 238 throw e;
> 239 }
> 240 }
> {quote}
> Inserting e.printStackTrace() gave me next
> {quote}
> dfs.NameNodeMetrics (NameNodeMetrics.java:<init>(76)) - Initializing NameNodeMeterics using context object:org.apache.hadoop.metrics.spi.NullContext
> java.io.IOException: javax.security.auth.login.LoginException: Login failed: id: cannot find name for group ID 1040
> at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)
> at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:268)
> at org.apache.hadoop.dfs.FSNamesystem.setConfigurationParameters(FSNamesystem.java:330)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:249)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> at org.apache.hadoop.dfs.FSNamesystem.setConfigurationParameters(FSNamesystem.java:332)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:249)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> {quote}
> And this is true - command "groups" returns the same - id: cannot find name for group ID 1040.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2953) namenode doesn't start if group id
cannot be resolved to name
Posted by "Patrick Winters (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12643526#action_12643526 ]
Patrick Winters commented on HADOOP-2953:
-----------------------------------------
I have a similar problem running hadoop in the Sun Grid Engine, but this occurs when I'm using the CLI. It is as (Nicholas) said, that the command `groups` fails. In SGE, you get assigned an effective gid when your task submission runs, which doesn't map to a name. I've created a patch which uses only real gid's and ignores effective ones. Ultimately it uses `id -rgn` instead of `groups`
javax.security.auth.login.LoginException: Login failed: id: cannot find name for group ID 20030
at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)
> namenode doesn't start if group id cannot be resolved to name
> -------------------------------------------------------------
>
> Key: HADOOP-2953
> URL: https://issues.apache.org/jira/browse/HADOOP-2953
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.16.0
> Environment: Linux n510 2.6.22-3-686 #1 SMP Mon Nov 12 08:32:57 UTC 2007 i686 GNU/Linux
> Java:
> java version "1.5.0_14"
> Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_14-b03)
> Java HotSpot(TM) Client VM (build 1.5.0_14-b03, mixed mode, sharing)
> PAM: ldap
> Reporter: Andrew Gudkov
> Priority: Minor
>
> Namenode failes to start because unix group name for my user can't be got. First, system threw rather obscure message:
> {quote}
> ERROR dfs.NameNode (NameNode.java:main(856)) - java.lang.NullPointerException
> at org.apache.hadoop.dfs.FSNamesystem.close(FSNamesystem.java:428)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:237)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> {quote}
> I traversed through stack trace entries, and found (FSNamesystem:237) this code
> {quote}
> 233 FSNamesystem(NameNode nn, Configuration conf) throws IOException {
> 234 try {
> 235 initialize(nn, conf);
> 236 } catch(IOException e) {
> 237 close();
> 238 throw e;
> 239 }
> 240 }
> {quote}
> Inserting e.printStackTrace() gave me next
> {quote}
> dfs.NameNodeMetrics (NameNodeMetrics.java:<init>(76)) - Initializing NameNodeMeterics using context object:org.apache.hadoop.metrics.spi.NullContext
> java.io.IOException: javax.security.auth.login.LoginException: Login failed: id: cannot find name for group ID 1040
> at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)
> at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:268)
> at org.apache.hadoop.dfs.FSNamesystem.setConfigurationParameters(FSNamesystem.java:330)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:249)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> at org.apache.hadoop.dfs.FSNamesystem.setConfigurationParameters(FSNamesystem.java:332)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:249)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> {quote}
> And this is true - command "groups" returns the same - id: cannot find name for group ID 1040.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2953) namenode doesn't start if group id
cannot be resolved to name
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12643533#action_12643533 ]
Tsz Wo (Nicholas), SZE commented on HADOOP-2953:
------------------------------------------------
{{id -rgn}} should be {{id -rGn}}
After the replacement, it works for Cygwin and GNU/Linux but not sure about Solaris and Mac.
> namenode doesn't start if group id cannot be resolved to name
> -------------------------------------------------------------
>
> Key: HADOOP-2953
> URL: https://issues.apache.org/jira/browse/HADOOP-2953
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.18.1
> Environment: Linux n510 2.6.22-3-686 #1 SMP Mon Nov 12 08:32:57 UTC 2007 i686 GNU/Linux
> Java:
> java version "1.5.0_14"
> Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_14-b03)
> Java HotSpot(TM) Client VM (build 1.5.0_14-b03, mixed mode, sharing)
> PAM: ldap
> Reporter: Andrew Gudkov
> Priority: Minor
> Attachments: groupname.patch
>
>
> Namenode failes to start because unix group name for my user can't be got. First, system threw rather obscure message:
> {quote}
> ERROR dfs.NameNode (NameNode.java:main(856)) - java.lang.NullPointerException
> at org.apache.hadoop.dfs.FSNamesystem.close(FSNamesystem.java:428)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:237)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> {quote}
> I traversed through stack trace entries, and found (FSNamesystem:237) this code
> {quote}
> 233 FSNamesystem(NameNode nn, Configuration conf) throws IOException {
> 234 try {
> 235 initialize(nn, conf);
> 236 } catch(IOException e) {
> 237 close();
> 238 throw e;
> 239 }
> 240 }
> {quote}
> Inserting e.printStackTrace() gave me next
> {quote}
> dfs.NameNodeMetrics (NameNodeMetrics.java:<init>(76)) - Initializing NameNodeMeterics using context object:org.apache.hadoop.metrics.spi.NullContext
> java.io.IOException: javax.security.auth.login.LoginException: Login failed: id: cannot find name for group ID 1040
> at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)
> at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:268)
> at org.apache.hadoop.dfs.FSNamesystem.setConfigurationParameters(FSNamesystem.java:330)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:249)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> at org.apache.hadoop.dfs.FSNamesystem.setConfigurationParameters(FSNamesystem.java:332)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:249)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:130)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:175)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:161)
> at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:843)
> at org.apache.hadoop.dfs.NameNode.main(NameNode.java:852)
> {quote}
> And this is true - command "groups" returns the same - id: cannot find name for group ID 1040.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.