You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by "Gangavarapu, Venkata" <Ve...@bcbsa.com> on 2015/07/24 22:00:15 UTC

dfs.permissions.superusergroup not working

Hi,

I have add two groups under dfs.permissions.superusergroup property as below
<property>
      <name>dfs.cluster.administrators</name>
      <value> hdfs,hdpdadmngrp</value>
    </property>

Restarted the HDFS after the change.

But I am not able to run the below command
hdfs dfsadmin -refreshNodes


Error says I don't have privilege to run the above command

My cluster is kerberized. I have principal for my user id.

Hdfs user:
uid=504(hdfs) gid=501(hadoop) groups=501(hadoop),503(hdfs),506(hdpdadmngrp)

New admin user:
uid=1007(gv07680) gid=506(hdpdadmngrp) groups=506(hdpdadmngrp)

I am using hadoop-2.6.0

Please help me with this.

Thanks,
Venkat

Re: dfs.permissions.superusergroup not working

Posted by Harsh J <ha...@cloudera.com>.
That is correct, that specific property currently accepts only one value.

On Mon, Jul 27, 2015 at 8:33 AM Gangavarapu, Venkata <
Venkata.Gangavarapu@bcbsa.com> wrote:

>  Hey Harsh,
>
> Thanks for responding.
>
>
>
> Sorry about that. It was a typo.
>
>
>
> It was set as below
>
>
>
> <property>
>
>       <name> dfs.permissions.superusergroup </name>
>
>       <value>hdfs,hdpdadmngrp</value>
>
>     </property>
>
>
>
> I changed it as below and it is working
>
>
>
> <property>
>
>       <name> dfs.permissions.superusergroup </name>
>
>       <value>hdpdadmngrp</value>
>
>     </property>
>
>
>
> Looks like it accepts only one group as value. If that’s not true, please
> advise me whar would have went wrong
>
>
>
> Thanks,
>
> Venkat
>
>
>
>
>
> *From:* Harsh J [mailto:harsh@cloudera.com]
> *Sent:* Friday, July 24, 2015 9:26 PM
> *To:* user@hadoop.apache.org
> *Subject:* Re: dfs.permissions.superusergroup not working
>
>
>
> Is there a typo in your email, or did you set dfs.cluster.administrators
> instead of intending to set dfs.permissions.superusergroup?
>
>
>
> Also, are your id outputs from the NameNode machines? Cause by default the
> group lookups happen local to your NameNode machine.
>
>
>
> On Sat, Jul 25, 2015 at 1:31 AM Gangavarapu, Venkata <
> Venkata.Gangavarapu@bcbsa.com> wrote:
>
>  Hi,
>
>
>
> I have add two groups under dfs.permissions.superusergroup property as
> below
>
> <property>
>
>       <name>dfs.cluster.administrators</name>
>
>       <value> hdfs,hdpdadmngrp</value>
>
>     </property>
>
>
>
> Restarted the HDFS after the change.
>
>
>
> But I am not able to run the below command
>
> hdfs dfsadmin –refreshNodes
>
>
>
>
>
> Error says I don’t have privilege to run the above command
>
>
>
> My cluster is kerberized. I have principal for my user id.
>
>
>
> Hdfs user:
>
> uid=504(hdfs) gid=501(hadoop) groups=501(hadoop),503(hdfs),506(hdpdadmngrp)
>
>
>
> New admin user:
>
> uid=1007(gv07680) gid=506(hdpdadmngrp) groups=506(hdpdadmngrp)
>
>
>
> I am using hadoop-2.6.0
>
>
>
> Please help me with this.
>
>
>
> Thanks,
>
> Venkat
>
>

Re: dfs.permissions.superusergroup not working

Posted by Harsh J <ha...@cloudera.com>.
That is correct, that specific property currently accepts only one value.

On Mon, Jul 27, 2015 at 8:33 AM Gangavarapu, Venkata <
Venkata.Gangavarapu@bcbsa.com> wrote:

>  Hey Harsh,
>
> Thanks for responding.
>
>
>
> Sorry about that. It was a typo.
>
>
>
> It was set as below
>
>
>
> <property>
>
>       <name> dfs.permissions.superusergroup </name>
>
>       <value>hdfs,hdpdadmngrp</value>
>
>     </property>
>
>
>
> I changed it as below and it is working
>
>
>
> <property>
>
>       <name> dfs.permissions.superusergroup </name>
>
>       <value>hdpdadmngrp</value>
>
>     </property>
>
>
>
> Looks like it accepts only one group as value. If that’s not true, please
> advise me whar would have went wrong
>
>
>
> Thanks,
>
> Venkat
>
>
>
>
>
> *From:* Harsh J [mailto:harsh@cloudera.com]
> *Sent:* Friday, July 24, 2015 9:26 PM
> *To:* user@hadoop.apache.org
> *Subject:* Re: dfs.permissions.superusergroup not working
>
>
>
> Is there a typo in your email, or did you set dfs.cluster.administrators
> instead of intending to set dfs.permissions.superusergroup?
>
>
>
> Also, are your id outputs from the NameNode machines? Cause by default the
> group lookups happen local to your NameNode machine.
>
>
>
> On Sat, Jul 25, 2015 at 1:31 AM Gangavarapu, Venkata <
> Venkata.Gangavarapu@bcbsa.com> wrote:
>
>  Hi,
>
>
>
> I have add two groups under dfs.permissions.superusergroup property as
> below
>
> <property>
>
>       <name>dfs.cluster.administrators</name>
>
>       <value> hdfs,hdpdadmngrp</value>
>
>     </property>
>
>
>
> Restarted the HDFS after the change.
>
>
>
> But I am not able to run the below command
>
> hdfs dfsadmin –refreshNodes
>
>
>
>
>
> Error says I don’t have privilege to run the above command
>
>
>
> My cluster is kerberized. I have principal for my user id.
>
>
>
> Hdfs user:
>
> uid=504(hdfs) gid=501(hadoop) groups=501(hadoop),503(hdfs),506(hdpdadmngrp)
>
>
>
> New admin user:
>
> uid=1007(gv07680) gid=506(hdpdadmngrp) groups=506(hdpdadmngrp)
>
>
>
> I am using hadoop-2.6.0
>
>
>
> Please help me with this.
>
>
>
> Thanks,
>
> Venkat
>
>

Re: dfs.permissions.superusergroup not working

Posted by Harsh J <ha...@cloudera.com>.
That is correct, that specific property currently accepts only one value.

On Mon, Jul 27, 2015 at 8:33 AM Gangavarapu, Venkata <
Venkata.Gangavarapu@bcbsa.com> wrote:

>  Hey Harsh,
>
> Thanks for responding.
>
>
>
> Sorry about that. It was a typo.
>
>
>
> It was set as below
>
>
>
> <property>
>
>       <name> dfs.permissions.superusergroup </name>
>
>       <value>hdfs,hdpdadmngrp</value>
>
>     </property>
>
>
>
> I changed it as below and it is working
>
>
>
> <property>
>
>       <name> dfs.permissions.superusergroup </name>
>
>       <value>hdpdadmngrp</value>
>
>     </property>
>
>
>
> Looks like it accepts only one group as value. If that’s not true, please
> advise me whar would have went wrong
>
>
>
> Thanks,
>
> Venkat
>
>
>
>
>
> *From:* Harsh J [mailto:harsh@cloudera.com]
> *Sent:* Friday, July 24, 2015 9:26 PM
> *To:* user@hadoop.apache.org
> *Subject:* Re: dfs.permissions.superusergroup not working
>
>
>
> Is there a typo in your email, or did you set dfs.cluster.administrators
> instead of intending to set dfs.permissions.superusergroup?
>
>
>
> Also, are your id outputs from the NameNode machines? Cause by default the
> group lookups happen local to your NameNode machine.
>
>
>
> On Sat, Jul 25, 2015 at 1:31 AM Gangavarapu, Venkata <
> Venkata.Gangavarapu@bcbsa.com> wrote:
>
>  Hi,
>
>
>
> I have add two groups under dfs.permissions.superusergroup property as
> below
>
> <property>
>
>       <name>dfs.cluster.administrators</name>
>
>       <value> hdfs,hdpdadmngrp</value>
>
>     </property>
>
>
>
> Restarted the HDFS after the change.
>
>
>
> But I am not able to run the below command
>
> hdfs dfsadmin –refreshNodes
>
>
>
>
>
> Error says I don’t have privilege to run the above command
>
>
>
> My cluster is kerberized. I have principal for my user id.
>
>
>
> Hdfs user:
>
> uid=504(hdfs) gid=501(hadoop) groups=501(hadoop),503(hdfs),506(hdpdadmngrp)
>
>
>
> New admin user:
>
> uid=1007(gv07680) gid=506(hdpdadmngrp) groups=506(hdpdadmngrp)
>
>
>
> I am using hadoop-2.6.0
>
>
>
> Please help me with this.
>
>
>
> Thanks,
>
> Venkat
>
>

Re: dfs.permissions.superusergroup not working

Posted by Harsh J <ha...@cloudera.com>.
That is correct, that specific property currently accepts only one value.

On Mon, Jul 27, 2015 at 8:33 AM Gangavarapu, Venkata <
Venkata.Gangavarapu@bcbsa.com> wrote:

>  Hey Harsh,
>
> Thanks for responding.
>
>
>
> Sorry about that. It was a typo.
>
>
>
> It was set as below
>
>
>
> <property>
>
>       <name> dfs.permissions.superusergroup </name>
>
>       <value>hdfs,hdpdadmngrp</value>
>
>     </property>
>
>
>
> I changed it as below and it is working
>
>
>
> <property>
>
>       <name> dfs.permissions.superusergroup </name>
>
>       <value>hdpdadmngrp</value>
>
>     </property>
>
>
>
> Looks like it accepts only one group as value. If that’s not true, please
> advise me whar would have went wrong
>
>
>
> Thanks,
>
> Venkat
>
>
>
>
>
> *From:* Harsh J [mailto:harsh@cloudera.com]
> *Sent:* Friday, July 24, 2015 9:26 PM
> *To:* user@hadoop.apache.org
> *Subject:* Re: dfs.permissions.superusergroup not working
>
>
>
> Is there a typo in your email, or did you set dfs.cluster.administrators
> instead of intending to set dfs.permissions.superusergroup?
>
>
>
> Also, are your id outputs from the NameNode machines? Cause by default the
> group lookups happen local to your NameNode machine.
>
>
>
> On Sat, Jul 25, 2015 at 1:31 AM Gangavarapu, Venkata <
> Venkata.Gangavarapu@bcbsa.com> wrote:
>
>  Hi,
>
>
>
> I have add two groups under dfs.permissions.superusergroup property as
> below
>
> <property>
>
>       <name>dfs.cluster.administrators</name>
>
>       <value> hdfs,hdpdadmngrp</value>
>
>     </property>
>
>
>
> Restarted the HDFS after the change.
>
>
>
> But I am not able to run the below command
>
> hdfs dfsadmin –refreshNodes
>
>
>
>
>
> Error says I don’t have privilege to run the above command
>
>
>
> My cluster is kerberized. I have principal for my user id.
>
>
>
> Hdfs user:
>
> uid=504(hdfs) gid=501(hadoop) groups=501(hadoop),503(hdfs),506(hdpdadmngrp)
>
>
>
> New admin user:
>
> uid=1007(gv07680) gid=506(hdpdadmngrp) groups=506(hdpdadmngrp)
>
>
>
> I am using hadoop-2.6.0
>
>
>
> Please help me with this.
>
>
>
> Thanks,
>
> Venkat
>
>

RE: dfs.permissions.superusergroup not working

Posted by "Gangavarapu, Venkata" <Ve...@bcbsa.com>.
Hey Harsh,
Thanks for responding.

Sorry about that. It was a typo.

It was set as below

<property>
      <name> dfs.permissions.superusergroup </name>
      <value>hdfs,hdpdadmngrp</value>
    </property>

I changed it as below and it is working

<property>
      <name> dfs.permissions.superusergroup </name>
      <value>hdpdadmngrp</value>
    </property>

Looks like it accepts only one group as value. If that’s not true, please advise me whar would have went wrong

Thanks,
Venkat


From: Harsh J [mailto:harsh@cloudera.com]
Sent: Friday, July 24, 2015 9:26 PM
To: user@hadoop.apache.org
Subject: Re: dfs.permissions.superusergroup not working

Is there a typo in your email, or did you set dfs.cluster.administrators instead of intending to set dfs.permissions.superusergroup?

Also, are your id outputs from the NameNode machines? Cause by default the group lookups happen local to your NameNode machine.

On Sat, Jul 25, 2015 at 1:31 AM Gangavarapu, Venkata <Ve...@bcbsa.com>> wrote:
Hi,

I have add two groups under dfs.permissions.superusergroup property as below
<property>
      <name>dfs.cluster.administrators</name>
      <value> hdfs,hdpdadmngrp</value>
    </property>

Restarted the HDFS after the change.

But I am not able to run the below command
hdfs dfsadmin –refreshNodes


Error says I don’t have privilege to run the above command

My cluster is kerberized. I have principal for my user id.

Hdfs user:
uid=504(hdfs) gid=501(hadoop) groups=501(hadoop),503(hdfs),506(hdpdadmngrp)

New admin user:
uid=1007(gv07680) gid=506(hdpdadmngrp) groups=506(hdpdadmngrp)

I am using hadoop-2.6.0

Please help me with this.

Thanks,
Venkat

RE: dfs.permissions.superusergroup not working

Posted by "Gangavarapu, Venkata" <Ve...@bcbsa.com>.
Hey Harsh,
Thanks for responding.

Sorry about that. It was a typo.

It was set as below

<property>
      <name> dfs.permissions.superusergroup </name>
      <value>hdfs,hdpdadmngrp</value>
    </property>

I changed it as below and it is working

<property>
      <name> dfs.permissions.superusergroup </name>
      <value>hdpdadmngrp</value>
    </property>

Looks like it accepts only one group as value. If that’s not true, please advise me whar would have went wrong

Thanks,
Venkat


From: Harsh J [mailto:harsh@cloudera.com]
Sent: Friday, July 24, 2015 9:26 PM
To: user@hadoop.apache.org
Subject: Re: dfs.permissions.superusergroup not working

Is there a typo in your email, or did you set dfs.cluster.administrators instead of intending to set dfs.permissions.superusergroup?

Also, are your id outputs from the NameNode machines? Cause by default the group lookups happen local to your NameNode machine.

On Sat, Jul 25, 2015 at 1:31 AM Gangavarapu, Venkata <Ve...@bcbsa.com>> wrote:
Hi,

I have add two groups under dfs.permissions.superusergroup property as below
<property>
      <name>dfs.cluster.administrators</name>
      <value> hdfs,hdpdadmngrp</value>
    </property>

Restarted the HDFS after the change.

But I am not able to run the below command
hdfs dfsadmin –refreshNodes


Error says I don’t have privilege to run the above command

My cluster is kerberized. I have principal for my user id.

Hdfs user:
uid=504(hdfs) gid=501(hadoop) groups=501(hadoop),503(hdfs),506(hdpdadmngrp)

New admin user:
uid=1007(gv07680) gid=506(hdpdadmngrp) groups=506(hdpdadmngrp)

I am using hadoop-2.6.0

Please help me with this.

Thanks,
Venkat

RE: dfs.permissions.superusergroup not working

Posted by "Gangavarapu, Venkata" <Ve...@bcbsa.com>.
Hey Harsh,
Thanks for responding.

Sorry about that. It was a typo.

It was set as below

<property>
      <name> dfs.permissions.superusergroup </name>
      <value>hdfs,hdpdadmngrp</value>
    </property>

I changed it as below and it is working

<property>
      <name> dfs.permissions.superusergroup </name>
      <value>hdpdadmngrp</value>
    </property>

Looks like it accepts only one group as value. If that’s not true, please advise me whar would have went wrong

Thanks,
Venkat


From: Harsh J [mailto:harsh@cloudera.com]
Sent: Friday, July 24, 2015 9:26 PM
To: user@hadoop.apache.org
Subject: Re: dfs.permissions.superusergroup not working

Is there a typo in your email, or did you set dfs.cluster.administrators instead of intending to set dfs.permissions.superusergroup?

Also, are your id outputs from the NameNode machines? Cause by default the group lookups happen local to your NameNode machine.

On Sat, Jul 25, 2015 at 1:31 AM Gangavarapu, Venkata <Ve...@bcbsa.com>> wrote:
Hi,

I have add two groups under dfs.permissions.superusergroup property as below
<property>
      <name>dfs.cluster.administrators</name>
      <value> hdfs,hdpdadmngrp</value>
    </property>

Restarted the HDFS after the change.

But I am not able to run the below command
hdfs dfsadmin –refreshNodes


Error says I don’t have privilege to run the above command

My cluster is kerberized. I have principal for my user id.

Hdfs user:
uid=504(hdfs) gid=501(hadoop) groups=501(hadoop),503(hdfs),506(hdpdadmngrp)

New admin user:
uid=1007(gv07680) gid=506(hdpdadmngrp) groups=506(hdpdadmngrp)

I am using hadoop-2.6.0

Please help me with this.

Thanks,
Venkat

RE: dfs.permissions.superusergroup not working

Posted by "Gangavarapu, Venkata" <Ve...@bcbsa.com>.
Hey Harsh,
Thanks for responding.

Sorry about that. It was a typo.

It was set as below

<property>
      <name> dfs.permissions.superusergroup </name>
      <value>hdfs,hdpdadmngrp</value>
    </property>

I changed it as below and it is working

<property>
      <name> dfs.permissions.superusergroup </name>
      <value>hdpdadmngrp</value>
    </property>

Looks like it accepts only one group as value. If that’s not true, please advise me whar would have went wrong

Thanks,
Venkat


From: Harsh J [mailto:harsh@cloudera.com]
Sent: Friday, July 24, 2015 9:26 PM
To: user@hadoop.apache.org
Subject: Re: dfs.permissions.superusergroup not working

Is there a typo in your email, or did you set dfs.cluster.administrators instead of intending to set dfs.permissions.superusergroup?

Also, are your id outputs from the NameNode machines? Cause by default the group lookups happen local to your NameNode machine.

On Sat, Jul 25, 2015 at 1:31 AM Gangavarapu, Venkata <Ve...@bcbsa.com>> wrote:
Hi,

I have add two groups under dfs.permissions.superusergroup property as below
<property>
      <name>dfs.cluster.administrators</name>
      <value> hdfs,hdpdadmngrp</value>
    </property>

Restarted the HDFS after the change.

But I am not able to run the below command
hdfs dfsadmin –refreshNodes


Error says I don’t have privilege to run the above command

My cluster is kerberized. I have principal for my user id.

Hdfs user:
uid=504(hdfs) gid=501(hadoop) groups=501(hadoop),503(hdfs),506(hdpdadmngrp)

New admin user:
uid=1007(gv07680) gid=506(hdpdadmngrp) groups=506(hdpdadmngrp)

I am using hadoop-2.6.0

Please help me with this.

Thanks,
Venkat

Re: dfs.permissions.superusergroup not working

Posted by Harsh J <ha...@cloudera.com>.
Is there a typo in your email, or did you set dfs.cluster.administrators
instead of intending to set dfs.permissions.superusergroup?

Also, are your id outputs from the NameNode machines? Cause by default the
group lookups happen local to your NameNode machine.

On Sat, Jul 25, 2015 at 1:31 AM Gangavarapu, Venkata <
Venkata.Gangavarapu@bcbsa.com> wrote:

>  Hi,
>
>
>
> I have add two groups under dfs.permissions.superusergroup property as
> below
>
> <property>
>
>       <name>dfs.cluster.administrators</name>
>
>       <value> hdfs,hdpdadmngrp</value>
>
>     </property>
>
>
>
> Restarted the HDFS after the change.
>
>
>
> But I am not able to run the below command
>
> hdfs dfsadmin –refreshNodes
>
>
>
>
>
> Error says I don’t have privilege to run the above command
>
>
>
> My cluster is kerberized. I have principal for my user id.
>
>
>
> Hdfs user:
>
> uid=504(hdfs) gid=501(hadoop) groups=501(hadoop),503(hdfs),506(hdpdadmngrp)
>
>
>
> New admin user:
>
> uid=1007(gv07680) gid=506(hdpdadmngrp) groups=506(hdpdadmngrp)
>
>
>
> I am using hadoop-2.6.0
>
>
>
> Please help me with this.
>
>
>
> Thanks,
>
> Venkat
>

Re: dfs.permissions.superusergroup not working

Posted by Harsh J <ha...@cloudera.com>.
Is there a typo in your email, or did you set dfs.cluster.administrators
instead of intending to set dfs.permissions.superusergroup?

Also, are your id outputs from the NameNode machines? Cause by default the
group lookups happen local to your NameNode machine.

On Sat, Jul 25, 2015 at 1:31 AM Gangavarapu, Venkata <
Venkata.Gangavarapu@bcbsa.com> wrote:

>  Hi,
>
>
>
> I have add two groups under dfs.permissions.superusergroup property as
> below
>
> <property>
>
>       <name>dfs.cluster.administrators</name>
>
>       <value> hdfs,hdpdadmngrp</value>
>
>     </property>
>
>
>
> Restarted the HDFS after the change.
>
>
>
> But I am not able to run the below command
>
> hdfs dfsadmin –refreshNodes
>
>
>
>
>
> Error says I don’t have privilege to run the above command
>
>
>
> My cluster is kerberized. I have principal for my user id.
>
>
>
> Hdfs user:
>
> uid=504(hdfs) gid=501(hadoop) groups=501(hadoop),503(hdfs),506(hdpdadmngrp)
>
>
>
> New admin user:
>
> uid=1007(gv07680) gid=506(hdpdadmngrp) groups=506(hdpdadmngrp)
>
>
>
> I am using hadoop-2.6.0
>
>
>
> Please help me with this.
>
>
>
> Thanks,
>
> Venkat
>

Re: dfs.permissions.superusergroup not working

Posted by Harsh J <ha...@cloudera.com>.
Is there a typo in your email, or did you set dfs.cluster.administrators
instead of intending to set dfs.permissions.superusergroup?

Also, are your id outputs from the NameNode machines? Cause by default the
group lookups happen local to your NameNode machine.

On Sat, Jul 25, 2015 at 1:31 AM Gangavarapu, Venkata <
Venkata.Gangavarapu@bcbsa.com> wrote:

>  Hi,
>
>
>
> I have add two groups under dfs.permissions.superusergroup property as
> below
>
> <property>
>
>       <name>dfs.cluster.administrators</name>
>
>       <value> hdfs,hdpdadmngrp</value>
>
>     </property>
>
>
>
> Restarted the HDFS after the change.
>
>
>
> But I am not able to run the below command
>
> hdfs dfsadmin –refreshNodes
>
>
>
>
>
> Error says I don’t have privilege to run the above command
>
>
>
> My cluster is kerberized. I have principal for my user id.
>
>
>
> Hdfs user:
>
> uid=504(hdfs) gid=501(hadoop) groups=501(hadoop),503(hdfs),506(hdpdadmngrp)
>
>
>
> New admin user:
>
> uid=1007(gv07680) gid=506(hdpdadmngrp) groups=506(hdpdadmngrp)
>
>
>
> I am using hadoop-2.6.0
>
>
>
> Please help me with this.
>
>
>
> Thanks,
>
> Venkat
>

Re: dfs.permissions.superusergroup not working

Posted by Harsh J <ha...@cloudera.com>.
Is there a typo in your email, or did you set dfs.cluster.administrators
instead of intending to set dfs.permissions.superusergroup?

Also, are your id outputs from the NameNode machines? Cause by default the
group lookups happen local to your NameNode machine.

On Sat, Jul 25, 2015 at 1:31 AM Gangavarapu, Venkata <
Venkata.Gangavarapu@bcbsa.com> wrote:

>  Hi,
>
>
>
> I have add two groups under dfs.permissions.superusergroup property as
> below
>
> <property>
>
>       <name>dfs.cluster.administrators</name>
>
>       <value> hdfs,hdpdadmngrp</value>
>
>     </property>
>
>
>
> Restarted the HDFS after the change.
>
>
>
> But I am not able to run the below command
>
> hdfs dfsadmin –refreshNodes
>
>
>
>
>
> Error says I don’t have privilege to run the above command
>
>
>
> My cluster is kerberized. I have principal for my user id.
>
>
>
> Hdfs user:
>
> uid=504(hdfs) gid=501(hadoop) groups=501(hadoop),503(hdfs),506(hdpdadmngrp)
>
>
>
> New admin user:
>
> uid=1007(gv07680) gid=506(hdpdadmngrp) groups=506(hdpdadmngrp)
>
>
>
> I am using hadoop-2.6.0
>
>
>
> Please help me with this.
>
>
>
> Thanks,
>
> Venkat
>