You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Alex Loddengaard (JIRA)" <ji...@apache.org> on 2008/10/16 19:03:45 UTC
[jira] Created: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Misconfigured UNIX Groups Break Hadoop
--------------------------------------
Key: HADOOP-4429
URL: https://issues.apache.org/jira/browse/HADOOP-4429
Project: Hadoop Core
Issue Type: Bug
Components: dfs
Environment: UNIX, Linux
Reporter: Alex Loddengaard
Priority: Minor
If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12640563#action_12640563 ]
Doug Cutting commented on HADOOP-4429:
--------------------------------------
> +1 for the return of DrWho !
But what would the default group be? "Tardis"?
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Priority: Minor
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Alex Loddengaard (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alex Loddengaard updated HADOOP-4429:
-------------------------------------
Attachment: drwhointardis_v2.patch
Attaching a new patch that makes the default username and group constants public instead of private.
Agreed that it would be nice to link to these with JavaDoc.
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Assignee: Alex Loddengaard
> Priority: Minor
> Attachments: drwhointardis.patch, drwhointardis_v2.patch
>
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Issue Comment Edited: (HADOOP-4429) Misconfigured UNIX
Groups Break Hadoop
Posted by "Dipanjan Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12640234#action_12640234 ]
dipanjandas edited comment on HADOOP-4429 at 10/16/08 10:36 AM:
-----------------------------------------------------------------
I have been trying to install hadoop on my linux machine to create a development environment, and I have been following instructions on this page:
http://wiki.apache.org/hadoop/Running_Hadoop_On_Ubuntu_Linux_%28Single-Node_Cluster%29
However, I could not proceed with the installation because of a group ID that my system associates with my user name, breaks hadoop. As an example, if I run:
$ bin/hadoop dfs -ls
I get the following error:
08/10/16 13:10:13 WARN fs.FileSystem: uri=hdfs://localhost:54310
javax.security.auth.login.LoginException: Login failed: id: cannot find name for group ID 1106734464
at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)
at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:275)
at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:257)
at org.apache.hadoop.security.UserGroupInformation.login(UserGroupInformation.java:67)
at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1353)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1289)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:203)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:108)
at org.apache.hadoop.fs.FsShell.init(FsShell.java:87)
at org.apache.hadoop.fs.FsShell.run(FsShell.java:1717)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:1866)
Bad connection to FS. command aborted.
Here, "1106734464" is a group ID that my username belongs to. When I type
$ groups
I get
hadoop id: cannot find name for group ID 1106734464
1106734464
Here, "hadoop" is a username that I created for running hadoop. Similarly, if I run:
$ id
I get:
uid=501(hadoop) gid=501(hadoop) groups=501(hadoop),1106734464
Is this a bug in hadoop?
was (Author: dipanjandas):
I have been trying to install hadoop on my linux machine to create a development environment, and I have been following instructions on this page:
http://wiki.apache.org/hadoop/Running_Hadoop_On_Ubuntu_Linux_(Single-Node_Cluster)
However, I could not proceed with the installation because of a group ID that my system associates with my user name, breaks hadoop. As an example, if I run:
$ bin/hadoop dfs -ls
I get the following error:
08/10/16 13:10:13 WARN fs.FileSystem: uri=hdfs://localhost:54310
javax.security.auth.login.LoginException: Login failed: id: cannot find name for group ID 1106734464
at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)
at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:275)
at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:257)
at org.apache.hadoop.security.UserGroupInformation.login(UserGroupInformation.java:67)
at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1353)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1289)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:203)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:108)
at org.apache.hadoop.fs.FsShell.init(FsShell.java:87)
at org.apache.hadoop.fs.FsShell.run(FsShell.java:1717)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:1866)
Bad connection to FS. command aborted.
Here, "1106734464" is a group ID that my username belongs to. When I type
$ groups
I get
hadoop id: cannot find name for group ID 1106734464
1106734464
Here, "hadoop" is a username that I created for running hadoop. Similarly, if I run:
$ id
I get:
uid=501(hadoop) gid=501(hadoop) groups=501(hadoop),1106734464
Is this a bug in hadoop?
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Priority: Minor
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12650446#action_12650446 ]
Chris Douglas commented on HADOOP-4429:
---------------------------------------
I don't think so... in environments where this wouldn't work before, now it doesn't work in a consistent way.
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Assignee: Alex Loddengaard
> Priority: Minor
> Fix For: 0.20.0
>
> Attachments: drwhointardis.patch, drwhointardis_v2.patch
>
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Alex Loddengaard (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12650459#action_12650459 ]
Alex Loddengaard commented on HADOOP-4429:
------------------------------------------
Thanks, Chris. It's exciting to get my first patch in :). Sweeeeeet.
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Assignee: Alex Loddengaard
> Priority: Minor
> Fix For: 0.20.0
>
> Attachments: drwhointardis.patch, drwhointardis_v2.patch
>
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Alex Loddengaard (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12640693#action_12640693 ]
Alex Loddengaard commented on HADOOP-4429:
------------------------------------------
{quote}
One problem with doing diagnostics for configuration failures and errors in the underlying OS/JRE is that they are hard to reliably translate. If you look for strings, your code breaks on every OS/JRE update. If you take a guess, you end up with those windows programs that assume that all failures are due to being out of memory, because that was a common fault. but if it isnt the fault, it is even more misleading.
{quote}
You bring up a great point, Steve. For this reason I'm convinced that perhaps creating a better error message isn't the best solution.
{quote}
What we can do is what you have done: place the stack trace on a bugrep where it is searchable. The next time someone gets this error and searches for it. they will find this page. So we should add the instructions on what to do to make the error message go away.
{quote}
In my case, I was working at a large corporation, and my IT department was unable to resolve the problem. I had to drop the internal Ubuntu derivative, along with LDAP, certain tools, etc, and switch to pure Ubuntu. My solution was rather cumbersome, but I my efforts to Google for solutions to my problem only led to dead ends and frustration. I even sent an email to the users list with no luck.
+1 to DrWho:Tardis :)
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Priority: Minor
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-4429:
----------------------------------
Resolution: Fixed
Fix Version/s: 0.20.0
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
Nevermind. I just committed this. Thanks, Alex
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Assignee: Alex Loddengaard
> Priority: Minor
> Fix For: 0.20.0
>
> Attachments: drwhointardis.patch, drwhointardis_v2.patch
>
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Alex Loddengaard (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alex Loddengaard updated HADOOP-4429:
-------------------------------------
Attachment: drwhointardis.patch
Submitting a patch to set a default name and group if an Exception occurs when fetching these from UNIX. The default username is "DrWho" and the default group is "Tardis".
I am not submitting a test, because UnixUserGroupInformation#getUnixUserName() and UnixUserGroupInformation#getUnixGroups() are static methods, which stops me from extending UnixUserGroupInformation and overwriting these methods to throw Exceptions. I considered creating a test by creating a binary for "whoami" and "groups" and adding these to my PATH, but I figured this was rather cumbersome with such a simple patch. Let me know if you disagree and I can make binaries for these.
I decided to make DEFAULT_USERNAME and DEFAULT_GROUP private constants, just to be sure to not pollute the public interface.
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Priority: Minor
> Attachments: drwhointardis.patch
>
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12640244#action_12640244 ]
Tsz Wo (Nicholas), SZE commented on HADOOP-4429:
------------------------------------------------
> Is this a bug in hadoop?
Currently, "groups" is required external command for Hadoop. So, this is not a bug. See also the [User Identity|http://hadoop.apache.org/core/docs/r0.18.1/hdfs_permissions_guide.html] section in the Permissions User and Administrator Guide.
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Priority: Minor
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Alex Loddengaard (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12640227#action_12640227 ]
Alex Loddengaard commented on HADOOP-4429:
------------------------------------------
I originally stumbled on this problem when using an internal derivative of Ubuntu, with funky LDAP settings. Running Hadoop would generate the following error:
bq. ERROR dfs.NameNode: java.io.IOException: javax.security.auth.login.LoginException: Login failed: id: cannot find name for group ID
The last portion of the error, "Login failed: id: cannot find name of group ID," would also occur when I ran the "groups" binary from a command line.
I propose using a default group in the case that getting a user's groups fails.
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Priority: Minor
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12650388#action_12650388 ]
Chris Douglas commented on HADOOP-4429:
---------------------------------------
Sorry, by references, I meant {{\{@link #DEFAULT_USERNAME\}}} in the javadoc for UnixUserGroupInformation::login
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Assignee: Alex Loddengaard
> Priority: Minor
> Attachments: drwhointardis.patch, drwhointardis_v2.patch
>
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Steve Loughran (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12640486#action_12640486 ]
Steve Loughran commented on HADOOP-4429:
----------------------------------------
One problem with doing diagnostics for configuration failures and errors in the underlying OS/JRE is that they are hard to reliably translate. If you look for strings, your code breaks on every OS/JRE update. If you take a guess, you end up with those windows programs that assume that all failures are due to being out of memory, because that was a common fault. but if it isnt the fault, it is even more misleading.
What we can do is what you have done: place the stack trace on a bugrep where it is searchable. The next time someone gets this error and searches for it. they will find this page. So we should add the instructions on what to do to make the error message go away.
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Priority: Minor
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Alex Loddengaard (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alex Loddengaard updated HADOOP-4429:
-------------------------------------
Assignee: Alex Loddengaard
Status: Patch Available (was: Open)
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Assignee: Alex Loddengaard
> Priority: Minor
> Attachments: drwhointardis.patch
>
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Dipanjan Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12640234#action_12640234 ]
Dipanjan Das commented on HADOOP-4429:
--------------------------------------
I have been trying to install hadoop on my linux machine to create a development environment, and I have been following instructions on this page:
http://wiki.apache.org/hadoop/Running_Hadoop_On_Ubuntu_Linux_(Single-Node_Cluster)
However, I could not proceed with the installation because of a group ID that my system associates with my user name, breaks hadoop. As an example, if I run:
$ bin/hadoop dfs -ls
I get the following error:
08/10/16 13:10:13 WARN fs.FileSystem: uri=hdfs://localhost:54310
javax.security.auth.login.LoginException: Login failed: id: cannot find name for group ID 1106734464
at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:250)
at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:275)
at org.apache.hadoop.security.UnixUserGroupInformation.login(UnixUserGroupInformation.java:257)
at org.apache.hadoop.security.UserGroupInformation.login(UserGroupInformation.java:67)
at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1353)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1289)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:203)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:108)
at org.apache.hadoop.fs.FsShell.init(FsShell.java:87)
at org.apache.hadoop.fs.FsShell.run(FsShell.java:1717)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:1866)
Bad connection to FS. command aborted.
Here, "1106734464" is a group ID that my username belongs to. When I type
$ groups
I get
hadoop id: cannot find name for group ID 1106734464
1106734464
Here, "hadoop" is a username that I created for running hadoop. Similarly, if I run:
$ id
I get:
uid=501(hadoop) gid=501(hadoop) groups=501(hadoop),1106734464
Is this a bug in hadoop?
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Priority: Minor
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Alex Loddengaard (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12640305#action_12640305 ]
Alex Loddengaard commented on HADOOP-4429:
------------------------------------------
Perhaps this isn't a bug, but I still think a simple workaround such as using a default group when 'groups' errs is a good idea. Or at the very least Hadoop should supply a better error message, something along the lines of "Hadoop is unable to get user group information about you." Thoughts?
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Priority: Minor
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12645208#action_12645208 ]
Hadoop QA commented on HADOOP-4429:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12393318/drwhointardis.patch
against trunk revision 711482.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3533/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3533/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3533/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3533/console
This message is automatically generated.
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Assignee: Alex Loddengaard
> Priority: Minor
> Attachments: drwhointardis.patch
>
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12650442#action_12650442 ]
Tsz Wo (Nicholas), SZE commented on HADOOP-4429:
------------------------------------------------
Is this an incompatible change?
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Assignee: Alex Loddengaard
> Priority: Minor
> Fix For: 0.20.0
>
> Attachments: drwhointardis.patch, drwhointardis_v2.patch
>
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12649893#action_12649893 ]
Chris Douglas commented on HADOOP-4429:
---------------------------------------
bq. I decided to make DEFAULT_USERNAME and DEFAULT_GROUP private constants, just to be sure to not pollute the public interface.
It's a little confusing that they're referenced in the javadoc, then... I'd lean towards making them public, but wouldn't insist on it. If public, changing the mentions to be references would also be a good idea.
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Assignee: Alex Loddengaard
> Priority: Minor
> Attachments: drwhointardis.patch
>
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12650677#action_12650677 ]
Hudson commented on HADOOP-4429:
--------------------------------
Integrated in Hadoop-trunk #670 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/670/])
. Set defaults for user, group in UnixUserGroupInformation so
login fails more predictably when misconfigured. Contributed by Alex Loddengaard.
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Assignee: Alex Loddengaard
> Priority: Minor
> Fix For: 0.20.0
>
> Attachments: drwhointardis.patch, drwhointardis_v2.patch
>
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12656743#action_12656743 ]
Allen Wittenauer commented on HADOOP-4429:
------------------------------------------
*cries*
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Assignee: Alex Loddengaard
> Priority: Minor
> Fix For: 0.20.0
>
> Attachments: drwhointardis.patch, drwhointardis_v2.patch
>
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Alex Loddengaard (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12656790#action_12656790 ]
Alex Loddengaard commented on HADOOP-4429:
------------------------------------------
Haha! Are you crying about the choice of defaults or about my first patch being submitted? ;)
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Assignee: Alex Loddengaard
> Priority: Minor
> Fix For: 0.20.0
>
> Attachments: drwhointardis.patch, drwhointardis_v2.patch
>
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4429) Misconfigured UNIX Groups Break
Hadoop
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12640542#action_12640542 ]
Owen O'Malley commented on HADOOP-4429:
---------------------------------------
+1 for the return of DrWho !
Historical background:
Hadoop used to default to "Dr Who" as the user id, if it couldn't figure out your username from the system properties. It was removed because of the space and the assertion that it never happened. Introduced in HADOOP-52 and removed by HADOOP-2833.
> Misconfigured UNIX Groups Break Hadoop
> --------------------------------------
>
> Key: HADOOP-4429
> URL: https://issues.apache.org/jira/browse/HADOOP-4429
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Environment: UNIX, Linux
> Reporter: Alex Loddengaard
> Priority: Minor
>
> If a UNIX user has misconfigured groups, either locally or through LDAP, then Hadoop will not be able to start.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.