You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by John Armstrong <jr...@ccri.com> on 2012/08/09 13:55:41 UTC
HDFS group permissions
I'm having some trouble with permissions on HDFS. I'm trying to create a file in a directory where
the user belongs to a group that has write permissions, but it doesn't seem to be working.
First, the directory:
myuser$ hadoop fs -ls /path/to/parent/
drwxrwxr-x - hdfs myhdfsgroup 0 2012-08-09 07:34 /path/to/parent/directory
so mygroup has all permissions on /path/to/parent/directory. Next I check:
myuser$ groups
myuser [...] myhdfsgroup
so myuser is a member of myhdfsgroup. I should be able to put a file into this directory, no?
myuser$ hadoop fs -put testFile.txt /path/to/parent/directory/testfile.txt
put: org.apache.hadoop.security.AccessControlException: Permission denied: user=myuser,
access=WRITE, inode="directory":hdfs:myhdfsgroup:rwxrwxr-x
I don't even see a mention of the group in this exception message. Do group permissions just not
work? And if not, why are they included in the documentation?
In case it matters, I'm using Hadoop 0.20.2 plus some patches.
tia
Re: HDFS group permissions
Posted by Wellington Chevreuil <we...@gmail.com>.
That's not the same, as you could pool only special users (like
administrator or system users) on the group which is the supergroup.
Other users would not be in that group, then they would not have
rwxrwxrwx access in whole HDFS.
2012/8/9 John Armstrong <jr...@ccri.com>:
> On 08/09/2012 09:48 AM, Wellington Chevreuil wrote:
>>
>> Have you tried set this myhdfsgroup group in
>> dfs.permissions.superusergroup property? If you set this property in
>> your hdfs-site.xml file, this group will be a super user group, and
>> should have full permissions in any HDFS place.
>
>
> Unfortunately in deployment we can't reconfigure all of HDFS like that.
> Besides, if I'm to pull out a broadsword like that it's easier to just set
> the directory's permissions to rwxrwxrwx, which DOES work.
Re: HDFS group permissions
Posted by Wellington Chevreuil <we...@gmail.com>.
That's not the same, as you could pool only special users (like
administrator or system users) on the group which is the supergroup.
Other users would not be in that group, then they would not have
rwxrwxrwx access in whole HDFS.
2012/8/9 John Armstrong <jr...@ccri.com>:
> On 08/09/2012 09:48 AM, Wellington Chevreuil wrote:
>>
>> Have you tried set this myhdfsgroup group in
>> dfs.permissions.superusergroup property? If you set this property in
>> your hdfs-site.xml file, this group will be a super user group, and
>> should have full permissions in any HDFS place.
>
>
> Unfortunately in deployment we can't reconfigure all of HDFS like that.
> Besides, if I'm to pull out a broadsword like that it's easier to just set
> the directory's permissions to rwxrwxrwx, which DOES work.
Re: HDFS group permissions
Posted by Wellington Chevreuil <we...@gmail.com>.
That's not the same, as you could pool only special users (like
administrator or system users) on the group which is the supergroup.
Other users would not be in that group, then they would not have
rwxrwxrwx access in whole HDFS.
2012/8/9 John Armstrong <jr...@ccri.com>:
> On 08/09/2012 09:48 AM, Wellington Chevreuil wrote:
>>
>> Have you tried set this myhdfsgroup group in
>> dfs.permissions.superusergroup property? If you set this property in
>> your hdfs-site.xml file, this group will be a super user group, and
>> should have full permissions in any HDFS place.
>
>
> Unfortunately in deployment we can't reconfigure all of HDFS like that.
> Besides, if I'm to pull out a broadsword like that it's easier to just set
> the directory's permissions to rwxrwxrwx, which DOES work.
Re: HDFS group permissions
Posted by Wellington Chevreuil <we...@gmail.com>.
That's not the same, as you could pool only special users (like
administrator or system users) on the group which is the supergroup.
Other users would not be in that group, then they would not have
rwxrwxrwx access in whole HDFS.
2012/8/9 John Armstrong <jr...@ccri.com>:
> On 08/09/2012 09:48 AM, Wellington Chevreuil wrote:
>>
>> Have you tried set this myhdfsgroup group in
>> dfs.permissions.superusergroup property? If you set this property in
>> your hdfs-site.xml file, this group will be a super user group, and
>> should have full permissions in any HDFS place.
>
>
> Unfortunately in deployment we can't reconfigure all of HDFS like that.
> Besides, if I'm to pull out a broadsword like that it's easier to just set
> the directory's permissions to rwxrwxrwx, which DOES work.
Re: HDFS group permissions
Posted by John Armstrong <jr...@ccri.com>.
On 08/09/2012 09:48 AM, Wellington Chevreuil wrote:
> Have you tried set this myhdfsgroup group in
> dfs.permissions.superusergroup property? If you set this property in
> your hdfs-site.xml file, this group will be a super user group, and
> should have full permissions in any HDFS place.
Unfortunately in deployment we can't reconfigure all of HDFS like that. Besides, if I'm to pull out
a broadsword like that it's easier to just set the directory's permissions to rwxrwxrwx, which DOES
work.
Re: HDFS group permissions
Posted by John Armstrong <jr...@ccri.com>.
On 08/09/2012 09:48 AM, Wellington Chevreuil wrote:
> Have you tried set this myhdfsgroup group in
> dfs.permissions.superusergroup property? If you set this property in
> your hdfs-site.xml file, this group will be a super user group, and
> should have full permissions in any HDFS place.
Unfortunately in deployment we can't reconfigure all of HDFS like that. Besides, if I'm to pull out
a broadsword like that it's easier to just set the directory's permissions to rwxrwxrwx, which DOES
work.
Re: HDFS group permissions
Posted by John Armstrong <jr...@ccri.com>.
On 08/09/2012 09:48 AM, Wellington Chevreuil wrote:
> Have you tried set this myhdfsgroup group in
> dfs.permissions.superusergroup property? If you set this property in
> your hdfs-site.xml file, this group will be a super user group, and
> should have full permissions in any HDFS place.
Unfortunately in deployment we can't reconfigure all of HDFS like that. Besides, if I'm to pull out
a broadsword like that it's easier to just set the directory's permissions to rwxrwxrwx, which DOES
work.
Re: HDFS group permissions
Posted by John Armstrong <jr...@ccri.com>.
On 08/09/2012 09:48 AM, Wellington Chevreuil wrote:
> Have you tried set this myhdfsgroup group in
> dfs.permissions.superusergroup property? If you set this property in
> your hdfs-site.xml file, this group will be a super user group, and
> should have full permissions in any HDFS place.
Unfortunately in deployment we can't reconfigure all of HDFS like that. Besides, if I'm to pull out
a broadsword like that it's easier to just set the directory's permissions to rwxrwxrwx, which DOES
work.
Re: HDFS group permissions
Posted by Wellington Chevreuil <we...@gmail.com>.
Hi John,
Have you tried set this myhdfsgroup group in
dfs.permissions.superusergroup property? If you set this property in
your hdfs-site.xml file, this group will be a super user group, and
should have full permissions in any HDFS place.
Ex:
<property>
<name>dfs.permissions.superusergroup</name>
<value>myhdfsgroup</value>
</property>
Regards,
Wellington.
2012/8/9 Justin Woody <ju...@gmail.com>:
> John,
>
> Hadoop group permissions follow the BSD model, which is outlined in
> the documentation. I think your settings are correct on that
> directory, but you may want to check the higher level directories as
> well (/path, /path/to, etc).
>
> Hope that helps.
> Justin
>
> On Thu, Aug 9, 2012 at 7:55 AM, John Armstrong <jr...@ccri.com> wrote:
>> I'm having some trouble with permissions on HDFS. I'm trying to create a
>> file in a directory where the user belongs to a group that has write
>> permissions, but it doesn't seem to be working.
>>
>> First, the directory:
>>
>> myuser$ hadoop fs -ls /path/to/parent/
>> drwxrwxr-x - hdfs myhdfsgroup 0 2012-08-09 07:34
>> /path/to/parent/directory
>>
>> so mygroup has all permissions on /path/to/parent/directory. Next I check:
>>
>> myuser$ groups
>> myuser [...] myhdfsgroup
>>
>> so myuser is a member of myhdfsgroup. I should be able to put a file into
>> this directory, no?
>>
>> myuser$ hadoop fs -put testFile.txt /path/to/parent/directory/testfile.txt
>> put: org.apache.hadoop.security.AccessControlException: Permission denied:
>> user=myuser, access=WRITE, inode="directory":hdfs:myhdfsgroup:rwxrwxr-x
>>
>> I don't even see a mention of the group in this exception message. Do group
>> permissions just not work? And if not, why are they included in the
>> documentation?
>>
>> In case it matters, I'm using Hadoop 0.20.2 plus some patches.
>>
>> tia
Re: HDFS group permissions
Posted by Andrew Wright <ag...@gmail.com>.
Thanks for the detailled explanation on this. I have been fighting with
this off and on in 0.20.203.
Cheers,
Andrew
On Aug 9, 2012 1:55 PM, "John Armstrong" <jr...@ccri.com> wrote:
> On 08/09/2012 01:52 PM, Justin Woody wrote:
>
>> Just to close the thread, the problem was that the user and group were
>> not present on the name node which is why the ACE was thrown. Once he
>> added them to the NN, everything was good.
>>
>
> Yes, thanks again (you beat me to finding the thread to reply). The fact
> that the NameNode is what makes the check could be made clearer in the
> documentation, in case anyone else runs into this in the future.
>
Re: HDFS group permissions
Posted by Andrew Wright <ag...@gmail.com>.
Thanks for the detailled explanation on this. I have been fighting with
this off and on in 0.20.203.
Cheers,
Andrew
On Aug 9, 2012 1:55 PM, "John Armstrong" <jr...@ccri.com> wrote:
> On 08/09/2012 01:52 PM, Justin Woody wrote:
>
>> Just to close the thread, the problem was that the user and group were
>> not present on the name node which is why the ACE was thrown. Once he
>> added them to the NN, everything was good.
>>
>
> Yes, thanks again (you beat me to finding the thread to reply). The fact
> that the NameNode is what makes the check could be made clearer in the
> documentation, in case anyone else runs into this in the future.
>
Re: HDFS group permissions
Posted by Andrew Wright <ag...@gmail.com>.
Thanks for the detailled explanation on this. I have been fighting with
this off and on in 0.20.203.
Cheers,
Andrew
On Aug 9, 2012 1:55 PM, "John Armstrong" <jr...@ccri.com> wrote:
> On 08/09/2012 01:52 PM, Justin Woody wrote:
>
>> Just to close the thread, the problem was that the user and group were
>> not present on the name node which is why the ACE was thrown. Once he
>> added them to the NN, everything was good.
>>
>
> Yes, thanks again (you beat me to finding the thread to reply). The fact
> that the NameNode is what makes the check could be made clearer in the
> documentation, in case anyone else runs into this in the future.
>
Re: HDFS group permissions
Posted by Andrew Wright <ag...@gmail.com>.
Thanks for the detailled explanation on this. I have been fighting with
this off and on in 0.20.203.
Cheers,
Andrew
On Aug 9, 2012 1:55 PM, "John Armstrong" <jr...@ccri.com> wrote:
> On 08/09/2012 01:52 PM, Justin Woody wrote:
>
>> Just to close the thread, the problem was that the user and group were
>> not present on the name node which is why the ACE was thrown. Once he
>> added them to the NN, everything was good.
>>
>
> Yes, thanks again (you beat me to finding the thread to reply). The fact
> that the NameNode is what makes the check could be made clearer in the
> documentation, in case anyone else runs into this in the future.
>
Re: HDFS group permissions
Posted by John Armstrong <jr...@ccri.com>.
On 08/09/2012 01:52 PM, Justin Woody wrote:
> Just to close the thread, the problem was that the user and group were
> not present on the name node which is why the ACE was thrown. Once he
> added them to the NN, everything was good.
Yes, thanks again (you beat me to finding the thread to reply). The fact that the NameNode is what
makes the check could be made clearer in the documentation, in case anyone else runs into this in
the future.
Re: HDFS group permissions
Posted by John Armstrong <jr...@ccri.com>.
On 08/09/2012 01:52 PM, Justin Woody wrote:
> Just to close the thread, the problem was that the user and group were
> not present on the name node which is why the ACE was thrown. Once he
> added them to the NN, everything was good.
Yes, thanks again (you beat me to finding the thread to reply). The fact that the NameNode is what
makes the check could be made clearer in the documentation, in case anyone else runs into this in
the future.
Re: HDFS group permissions
Posted by John Armstrong <jr...@ccri.com>.
On 08/09/2012 01:52 PM, Justin Woody wrote:
> Just to close the thread, the problem was that the user and group were
> not present on the name node which is why the ACE was thrown. Once he
> added them to the NN, everything was good.
Yes, thanks again (you beat me to finding the thread to reply). The fact that the NameNode is what
makes the check could be made clearer in the documentation, in case anyone else runs into this in
the future.
Re: HDFS group permissions
Posted by John Armstrong <jr...@ccri.com>.
On 08/09/2012 01:52 PM, Justin Woody wrote:
> Just to close the thread, the problem was that the user and group were
> not present on the name node which is why the ACE was thrown. Once he
> added them to the NN, everything was good.
Yes, thanks again (you beat me to finding the thread to reply). The fact that the NameNode is what
makes the check could be made clearer in the documentation, in case anyone else runs into this in
the future.
Re: HDFS group permissions
Posted by Justin Woody <ju...@gmail.com>.
All,
Just to close the thread, the problem was that the user and group were
not present on the name node which is why the ACE was thrown. Once he
added them to the NN, everything was good.
Cheers,
Justin
On Thu, Aug 9, 2012 at 8:00 AM, Justin Woody <ju...@gmail.com> wrote:
> John,
>
> Hadoop group permissions follow the BSD model, which is outlined in
> the documentation. I think your settings are correct on that
> directory, but you may want to check the higher level directories as
> well (/path, /path/to, etc).
>
> Hope that helps.
> Justin
>
> On Thu, Aug 9, 2012 at 7:55 AM, John Armstrong <jr...@ccri.com> wrote:
>> I'm having some trouble with permissions on HDFS. I'm trying to create a
>> file in a directory where the user belongs to a group that has write
>> permissions, but it doesn't seem to be working.
>>
>> First, the directory:
>>
>> myuser$ hadoop fs -ls /path/to/parent/
>> drwxrwxr-x - hdfs myhdfsgroup 0 2012-08-09 07:34
>> /path/to/parent/directory
>>
>> so mygroup has all permissions on /path/to/parent/directory. Next I check:
>>
>> myuser$ groups
>> myuser [...] myhdfsgroup
>>
>> so myuser is a member of myhdfsgroup. I should be able to put a file into
>> this directory, no?
>>
>> myuser$ hadoop fs -put testFile.txt /path/to/parent/directory/testfile.txt
>> put: org.apache.hadoop.security.AccessControlException: Permission denied:
>> user=myuser, access=WRITE, inode="directory":hdfs:myhdfsgroup:rwxrwxr-x
>>
>> I don't even see a mention of the group in this exception message. Do group
>> permissions just not work? And if not, why are they included in the
>> documentation?
>>
>> In case it matters, I'm using Hadoop 0.20.2 plus some patches.
>>
>> tia
Re: HDFS group permissions
Posted by Wellington Chevreuil <we...@gmail.com>.
Hi John,
Have you tried set this myhdfsgroup group in
dfs.permissions.superusergroup property? If you set this property in
your hdfs-site.xml file, this group will be a super user group, and
should have full permissions in any HDFS place.
Ex:
<property>
<name>dfs.permissions.superusergroup</name>
<value>myhdfsgroup</value>
</property>
Regards,
Wellington.
2012/8/9 Justin Woody <ju...@gmail.com>:
> John,
>
> Hadoop group permissions follow the BSD model, which is outlined in
> the documentation. I think your settings are correct on that
> directory, but you may want to check the higher level directories as
> well (/path, /path/to, etc).
>
> Hope that helps.
> Justin
>
> On Thu, Aug 9, 2012 at 7:55 AM, John Armstrong <jr...@ccri.com> wrote:
>> I'm having some trouble with permissions on HDFS. I'm trying to create a
>> file in a directory where the user belongs to a group that has write
>> permissions, but it doesn't seem to be working.
>>
>> First, the directory:
>>
>> myuser$ hadoop fs -ls /path/to/parent/
>> drwxrwxr-x - hdfs myhdfsgroup 0 2012-08-09 07:34
>> /path/to/parent/directory
>>
>> so mygroup has all permissions on /path/to/parent/directory. Next I check:
>>
>> myuser$ groups
>> myuser [...] myhdfsgroup
>>
>> so myuser is a member of myhdfsgroup. I should be able to put a file into
>> this directory, no?
>>
>> myuser$ hadoop fs -put testFile.txt /path/to/parent/directory/testfile.txt
>> put: org.apache.hadoop.security.AccessControlException: Permission denied:
>> user=myuser, access=WRITE, inode="directory":hdfs:myhdfsgroup:rwxrwxr-x
>>
>> I don't even see a mention of the group in this exception message. Do group
>> permissions just not work? And if not, why are they included in the
>> documentation?
>>
>> In case it matters, I'm using Hadoop 0.20.2 plus some patches.
>>
>> tia
Re: HDFS group permissions
Posted by Justin Woody <ju...@gmail.com>.
All,
Just to close the thread, the problem was that the user and group were
not present on the name node which is why the ACE was thrown. Once he
added them to the NN, everything was good.
Cheers,
Justin
On Thu, Aug 9, 2012 at 8:00 AM, Justin Woody <ju...@gmail.com> wrote:
> John,
>
> Hadoop group permissions follow the BSD model, which is outlined in
> the documentation. I think your settings are correct on that
> directory, but you may want to check the higher level directories as
> well (/path, /path/to, etc).
>
> Hope that helps.
> Justin
>
> On Thu, Aug 9, 2012 at 7:55 AM, John Armstrong <jr...@ccri.com> wrote:
>> I'm having some trouble with permissions on HDFS. I'm trying to create a
>> file in a directory where the user belongs to a group that has write
>> permissions, but it doesn't seem to be working.
>>
>> First, the directory:
>>
>> myuser$ hadoop fs -ls /path/to/parent/
>> drwxrwxr-x - hdfs myhdfsgroup 0 2012-08-09 07:34
>> /path/to/parent/directory
>>
>> so mygroup has all permissions on /path/to/parent/directory. Next I check:
>>
>> myuser$ groups
>> myuser [...] myhdfsgroup
>>
>> so myuser is a member of myhdfsgroup. I should be able to put a file into
>> this directory, no?
>>
>> myuser$ hadoop fs -put testFile.txt /path/to/parent/directory/testfile.txt
>> put: org.apache.hadoop.security.AccessControlException: Permission denied:
>> user=myuser, access=WRITE, inode="directory":hdfs:myhdfsgroup:rwxrwxr-x
>>
>> I don't even see a mention of the group in this exception message. Do group
>> permissions just not work? And if not, why are they included in the
>> documentation?
>>
>> In case it matters, I'm using Hadoop 0.20.2 plus some patches.
>>
>> tia
Re: HDFS group permissions
Posted by Wellington Chevreuil <we...@gmail.com>.
Hi John,
Have you tried set this myhdfsgroup group in
dfs.permissions.superusergroup property? If you set this property in
your hdfs-site.xml file, this group will be a super user group, and
should have full permissions in any HDFS place.
Ex:
<property>
<name>dfs.permissions.superusergroup</name>
<value>myhdfsgroup</value>
</property>
Regards,
Wellington.
2012/8/9 Justin Woody <ju...@gmail.com>:
> John,
>
> Hadoop group permissions follow the BSD model, which is outlined in
> the documentation. I think your settings are correct on that
> directory, but you may want to check the higher level directories as
> well (/path, /path/to, etc).
>
> Hope that helps.
> Justin
>
> On Thu, Aug 9, 2012 at 7:55 AM, John Armstrong <jr...@ccri.com> wrote:
>> I'm having some trouble with permissions on HDFS. I'm trying to create a
>> file in a directory where the user belongs to a group that has write
>> permissions, but it doesn't seem to be working.
>>
>> First, the directory:
>>
>> myuser$ hadoop fs -ls /path/to/parent/
>> drwxrwxr-x - hdfs myhdfsgroup 0 2012-08-09 07:34
>> /path/to/parent/directory
>>
>> so mygroup has all permissions on /path/to/parent/directory. Next I check:
>>
>> myuser$ groups
>> myuser [...] myhdfsgroup
>>
>> so myuser is a member of myhdfsgroup. I should be able to put a file into
>> this directory, no?
>>
>> myuser$ hadoop fs -put testFile.txt /path/to/parent/directory/testfile.txt
>> put: org.apache.hadoop.security.AccessControlException: Permission denied:
>> user=myuser, access=WRITE, inode="directory":hdfs:myhdfsgroup:rwxrwxr-x
>>
>> I don't even see a mention of the group in this exception message. Do group
>> permissions just not work? And if not, why are they included in the
>> documentation?
>>
>> In case it matters, I'm using Hadoop 0.20.2 plus some patches.
>>
>> tia
Re: HDFS group permissions
Posted by Wellington Chevreuil <we...@gmail.com>.
Hi John,
Have you tried set this myhdfsgroup group in
dfs.permissions.superusergroup property? If you set this property in
your hdfs-site.xml file, this group will be a super user group, and
should have full permissions in any HDFS place.
Ex:
<property>
<name>dfs.permissions.superusergroup</name>
<value>myhdfsgroup</value>
</property>
Regards,
Wellington.
2012/8/9 Justin Woody <ju...@gmail.com>:
> John,
>
> Hadoop group permissions follow the BSD model, which is outlined in
> the documentation. I think your settings are correct on that
> directory, but you may want to check the higher level directories as
> well (/path, /path/to, etc).
>
> Hope that helps.
> Justin
>
> On Thu, Aug 9, 2012 at 7:55 AM, John Armstrong <jr...@ccri.com> wrote:
>> I'm having some trouble with permissions on HDFS. I'm trying to create a
>> file in a directory where the user belongs to a group that has write
>> permissions, but it doesn't seem to be working.
>>
>> First, the directory:
>>
>> myuser$ hadoop fs -ls /path/to/parent/
>> drwxrwxr-x - hdfs myhdfsgroup 0 2012-08-09 07:34
>> /path/to/parent/directory
>>
>> so mygroup has all permissions on /path/to/parent/directory. Next I check:
>>
>> myuser$ groups
>> myuser [...] myhdfsgroup
>>
>> so myuser is a member of myhdfsgroup. I should be able to put a file into
>> this directory, no?
>>
>> myuser$ hadoop fs -put testFile.txt /path/to/parent/directory/testfile.txt
>> put: org.apache.hadoop.security.AccessControlException: Permission denied:
>> user=myuser, access=WRITE, inode="directory":hdfs:myhdfsgroup:rwxrwxr-x
>>
>> I don't even see a mention of the group in this exception message. Do group
>> permissions just not work? And if not, why are they included in the
>> documentation?
>>
>> In case it matters, I'm using Hadoop 0.20.2 plus some patches.
>>
>> tia
Re: HDFS group permissions
Posted by Justin Woody <ju...@gmail.com>.
All,
Just to close the thread, the problem was that the user and group were
not present on the name node which is why the ACE was thrown. Once he
added them to the NN, everything was good.
Cheers,
Justin
On Thu, Aug 9, 2012 at 8:00 AM, Justin Woody <ju...@gmail.com> wrote:
> John,
>
> Hadoop group permissions follow the BSD model, which is outlined in
> the documentation. I think your settings are correct on that
> directory, but you may want to check the higher level directories as
> well (/path, /path/to, etc).
>
> Hope that helps.
> Justin
>
> On Thu, Aug 9, 2012 at 7:55 AM, John Armstrong <jr...@ccri.com> wrote:
>> I'm having some trouble with permissions on HDFS. I'm trying to create a
>> file in a directory where the user belongs to a group that has write
>> permissions, but it doesn't seem to be working.
>>
>> First, the directory:
>>
>> myuser$ hadoop fs -ls /path/to/parent/
>> drwxrwxr-x - hdfs myhdfsgroup 0 2012-08-09 07:34
>> /path/to/parent/directory
>>
>> so mygroup has all permissions on /path/to/parent/directory. Next I check:
>>
>> myuser$ groups
>> myuser [...] myhdfsgroup
>>
>> so myuser is a member of myhdfsgroup. I should be able to put a file into
>> this directory, no?
>>
>> myuser$ hadoop fs -put testFile.txt /path/to/parent/directory/testfile.txt
>> put: org.apache.hadoop.security.AccessControlException: Permission denied:
>> user=myuser, access=WRITE, inode="directory":hdfs:myhdfsgroup:rwxrwxr-x
>>
>> I don't even see a mention of the group in this exception message. Do group
>> permissions just not work? And if not, why are they included in the
>> documentation?
>>
>> In case it matters, I'm using Hadoop 0.20.2 plus some patches.
>>
>> tia
Re: HDFS group permissions
Posted by Justin Woody <ju...@gmail.com>.
All,
Just to close the thread, the problem was that the user and group were
not present on the name node which is why the ACE was thrown. Once he
added them to the NN, everything was good.
Cheers,
Justin
On Thu, Aug 9, 2012 at 8:00 AM, Justin Woody <ju...@gmail.com> wrote:
> John,
>
> Hadoop group permissions follow the BSD model, which is outlined in
> the documentation. I think your settings are correct on that
> directory, but you may want to check the higher level directories as
> well (/path, /path/to, etc).
>
> Hope that helps.
> Justin
>
> On Thu, Aug 9, 2012 at 7:55 AM, John Armstrong <jr...@ccri.com> wrote:
>> I'm having some trouble with permissions on HDFS. I'm trying to create a
>> file in a directory where the user belongs to a group that has write
>> permissions, but it doesn't seem to be working.
>>
>> First, the directory:
>>
>> myuser$ hadoop fs -ls /path/to/parent/
>> drwxrwxr-x - hdfs myhdfsgroup 0 2012-08-09 07:34
>> /path/to/parent/directory
>>
>> so mygroup has all permissions on /path/to/parent/directory. Next I check:
>>
>> myuser$ groups
>> myuser [...] myhdfsgroup
>>
>> so myuser is a member of myhdfsgroup. I should be able to put a file into
>> this directory, no?
>>
>> myuser$ hadoop fs -put testFile.txt /path/to/parent/directory/testfile.txt
>> put: org.apache.hadoop.security.AccessControlException: Permission denied:
>> user=myuser, access=WRITE, inode="directory":hdfs:myhdfsgroup:rwxrwxr-x
>>
>> I don't even see a mention of the group in this exception message. Do group
>> permissions just not work? And if not, why are they included in the
>> documentation?
>>
>> In case it matters, I'm using Hadoop 0.20.2 plus some patches.
>>
>> tia
Re: HDFS group permissions
Posted by Justin Woody <ju...@gmail.com>.
John,
Hadoop group permissions follow the BSD model, which is outlined in
the documentation. I think your settings are correct on that
directory, but you may want to check the higher level directories as
well (/path, /path/to, etc).
Hope that helps.
Justin
On Thu, Aug 9, 2012 at 7:55 AM, John Armstrong <jr...@ccri.com> wrote:
> I'm having some trouble with permissions on HDFS. I'm trying to create a
> file in a directory where the user belongs to a group that has write
> permissions, but it doesn't seem to be working.
>
> First, the directory:
>
> myuser$ hadoop fs -ls /path/to/parent/
> drwxrwxr-x - hdfs myhdfsgroup 0 2012-08-09 07:34
> /path/to/parent/directory
>
> so mygroup has all permissions on /path/to/parent/directory. Next I check:
>
> myuser$ groups
> myuser [...] myhdfsgroup
>
> so myuser is a member of myhdfsgroup. I should be able to put a file into
> this directory, no?
>
> myuser$ hadoop fs -put testFile.txt /path/to/parent/directory/testfile.txt
> put: org.apache.hadoop.security.AccessControlException: Permission denied:
> user=myuser, access=WRITE, inode="directory":hdfs:myhdfsgroup:rwxrwxr-x
>
> I don't even see a mention of the group in this exception message. Do group
> permissions just not work? And if not, why are they included in the
> documentation?
>
> In case it matters, I'm using Hadoop 0.20.2 plus some patches.
>
> tia
Re: HDFS group permissions
Posted by Justin Woody <ju...@gmail.com>.
John,
Hadoop group permissions follow the BSD model, which is outlined in
the documentation. I think your settings are correct on that
directory, but you may want to check the higher level directories as
well (/path, /path/to, etc).
Hope that helps.
Justin
On Thu, Aug 9, 2012 at 7:55 AM, John Armstrong <jr...@ccri.com> wrote:
> I'm having some trouble with permissions on HDFS. I'm trying to create a
> file in a directory where the user belongs to a group that has write
> permissions, but it doesn't seem to be working.
>
> First, the directory:
>
> myuser$ hadoop fs -ls /path/to/parent/
> drwxrwxr-x - hdfs myhdfsgroup 0 2012-08-09 07:34
> /path/to/parent/directory
>
> so mygroup has all permissions on /path/to/parent/directory. Next I check:
>
> myuser$ groups
> myuser [...] myhdfsgroup
>
> so myuser is a member of myhdfsgroup. I should be able to put a file into
> this directory, no?
>
> myuser$ hadoop fs -put testFile.txt /path/to/parent/directory/testfile.txt
> put: org.apache.hadoop.security.AccessControlException: Permission denied:
> user=myuser, access=WRITE, inode="directory":hdfs:myhdfsgroup:rwxrwxr-x
>
> I don't even see a mention of the group in this exception message. Do group
> permissions just not work? And if not, why are they included in the
> documentation?
>
> In case it matters, I'm using Hadoop 0.20.2 plus some patches.
>
> tia
Re: HDFS group permissions
Posted by Justin Woody <ju...@gmail.com>.
John,
Hadoop group permissions follow the BSD model, which is outlined in
the documentation. I think your settings are correct on that
directory, but you may want to check the higher level directories as
well (/path, /path/to, etc).
Hope that helps.
Justin
On Thu, Aug 9, 2012 at 7:55 AM, John Armstrong <jr...@ccri.com> wrote:
> I'm having some trouble with permissions on HDFS. I'm trying to create a
> file in a directory where the user belongs to a group that has write
> permissions, but it doesn't seem to be working.
>
> First, the directory:
>
> myuser$ hadoop fs -ls /path/to/parent/
> drwxrwxr-x - hdfs myhdfsgroup 0 2012-08-09 07:34
> /path/to/parent/directory
>
> so mygroup has all permissions on /path/to/parent/directory. Next I check:
>
> myuser$ groups
> myuser [...] myhdfsgroup
>
> so myuser is a member of myhdfsgroup. I should be able to put a file into
> this directory, no?
>
> myuser$ hadoop fs -put testFile.txt /path/to/parent/directory/testfile.txt
> put: org.apache.hadoop.security.AccessControlException: Permission denied:
> user=myuser, access=WRITE, inode="directory":hdfs:myhdfsgroup:rwxrwxr-x
>
> I don't even see a mention of the group in this exception message. Do group
> permissions just not work? And if not, why are they included in the
> documentation?
>
> In case it matters, I'm using Hadoop 0.20.2 plus some patches.
>
> tia
Re: HDFS group permissions
Posted by Justin Woody <ju...@gmail.com>.
John,
Hadoop group permissions follow the BSD model, which is outlined in
the documentation. I think your settings are correct on that
directory, but you may want to check the higher level directories as
well (/path, /path/to, etc).
Hope that helps.
Justin
On Thu, Aug 9, 2012 at 7:55 AM, John Armstrong <jr...@ccri.com> wrote:
> I'm having some trouble with permissions on HDFS. I'm trying to create a
> file in a directory where the user belongs to a group that has write
> permissions, but it doesn't seem to be working.
>
> First, the directory:
>
> myuser$ hadoop fs -ls /path/to/parent/
> drwxrwxr-x - hdfs myhdfsgroup 0 2012-08-09 07:34
> /path/to/parent/directory
>
> so mygroup has all permissions on /path/to/parent/directory. Next I check:
>
> myuser$ groups
> myuser [...] myhdfsgroup
>
> so myuser is a member of myhdfsgroup. I should be able to put a file into
> this directory, no?
>
> myuser$ hadoop fs -put testFile.txt /path/to/parent/directory/testfile.txt
> put: org.apache.hadoop.security.AccessControlException: Permission denied:
> user=myuser, access=WRITE, inode="directory":hdfs:myhdfsgroup:rwxrwxr-x
>
> I don't even see a mention of the group in this exception message. Do group
> permissions just not work? And if not, why are they included in the
> documentation?
>
> In case it matters, I'm using Hadoop 0.20.2 plus some patches.
>
> tia