You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Hadoop Raj <ha...@yahoo.com> on 2013/08/29 06:51:06 UTC
Hadoop client user
Hi,
I have a hadoop learning environment on a pseudo distributed mode. It is owned by the user 'hadoop'.
I am trying to get an understanding on how can another user on this box can act as a Hadoop client and able to create HDFS files and run Map Reduce jobs. Say I have a Linux user 'user1'.
What permissions , privileges and configuration settings are required for 'user1' to act as a Hadoop client?
Thanks,
Raj
Re: Hadoop client user
Posted by Shekhar Sharma <sh...@gmail.com>.
Put that user in hadoop group...
And if the user wants to hadoop client, then the use should be aware
of two properties fs.default.name which is the address of NameNode and
mapred.job.tracker which is the address of job tracker
Regards,
Som Shekhar Sharma
+91-8197243810
On Thu, Aug 29, 2013 at 10:55 AM, Harsh J <ha...@cloudera.com> wrote:
> The user1 will mainly require a home directory on the HDFS, created by
> the HDFS administrator user ('hadoop' in your case): sudo -u hadoop
> hadoop fs -mkdir /user/user1; sudo -u hadoop hadoop fs -chown
> user1:user1 /user/user1. After this, the user should be able to run
> jobs and manipulate files in their own directory.
>
> On Thu, Aug 29, 2013 at 10:21 AM, Hadoop Raj <ha...@yahoo.com> wrote:
>> Hi,
>>
>> I have a hadoop learning environment on a pseudo distributed mode. It is owned by the user 'hadoop'.
>>
>> I am trying to get an understanding on how can another user on this box can act as a Hadoop client and able to create HDFS files and run Map Reduce jobs. Say I have a Linux user 'user1'.
>>
>> What permissions , privileges and configuration settings are required for 'user1' to act as a Hadoop client?
>>
>> Thanks,
>> Raj
>
>
>
> --
> Harsh J
Re: Hadoop client user
Posted by Shekhar Sharma <sh...@gmail.com>.
Put that user in hadoop group...
And if the user wants to hadoop client, then the use should be aware
of two properties fs.default.name which is the address of NameNode and
mapred.job.tracker which is the address of job tracker
Regards,
Som Shekhar Sharma
+91-8197243810
On Thu, Aug 29, 2013 at 10:55 AM, Harsh J <ha...@cloudera.com> wrote:
> The user1 will mainly require a home directory on the HDFS, created by
> the HDFS administrator user ('hadoop' in your case): sudo -u hadoop
> hadoop fs -mkdir /user/user1; sudo -u hadoop hadoop fs -chown
> user1:user1 /user/user1. After this, the user should be able to run
> jobs and manipulate files in their own directory.
>
> On Thu, Aug 29, 2013 at 10:21 AM, Hadoop Raj <ha...@yahoo.com> wrote:
>> Hi,
>>
>> I have a hadoop learning environment on a pseudo distributed mode. It is owned by the user 'hadoop'.
>>
>> I am trying to get an understanding on how can another user on this box can act as a Hadoop client and able to create HDFS files and run Map Reduce jobs. Say I have a Linux user 'user1'.
>>
>> What permissions , privileges and configuration settings are required for 'user1' to act as a Hadoop client?
>>
>> Thanks,
>> Raj
>
>
>
> --
> Harsh J
Re: Hadoop client user
Posted by Raj Hadoop <ha...@yahoo.com>.
Thanks Harsh. That is a very good explanation.
I am trying to understand how in a production cluster, hadoop user and hadoop clients would be.
What users should exist in NN, JT, DN ?
Regards,
Rajendra
________________________________
From: Harsh J <ha...@cloudera.com>
To: "<us...@hadoop.apache.org>" <us...@hadoop.apache.org>
Sent: Thursday, August 29, 2013 1:25 AM
Subject: Re: Hadoop client user
The user1 will mainly require a home directory on the HDFS, created by
the HDFS administrator user ('hadoop' in your case): sudo -u hadoop
hadoop fs -mkdir /user/user1; sudo -u hadoop hadoop fs -chown
user1:user1 /user/user1. After this, the user should be able to run
jobs and manipulate files in their own directory.
On Thu, Aug 29, 2013 at 10:21 AM, Hadoop Raj <ha...@yahoo.com> wrote:
> Hi,
>
> I have a hadoop learning environment on a pseudo distributed mode. It is owned by the user 'hadoop'.
>
> I am trying to get an understanding on how can another user on this box can act as a Hadoop client and able to create HDFS files and run Map Reduce jobs. Say I have a Linux user 'user1'.
>
> What permissions , privileges and configuration settings are required for 'user1' to act as a Hadoop client?
>
> Thanks,
> Raj
--
Harsh J
Re: Hadoop client user
Posted by Raj Hadoop <ha...@yahoo.com>.
Thanks Harsh. That is a very good explanation.
I am trying to understand how in a production cluster, hadoop user and hadoop clients would be.
What users should exist in NN, JT, DN ?
Regards,
Rajendra
________________________________
From: Harsh J <ha...@cloudera.com>
To: "<us...@hadoop.apache.org>" <us...@hadoop.apache.org>
Sent: Thursday, August 29, 2013 1:25 AM
Subject: Re: Hadoop client user
The user1 will mainly require a home directory on the HDFS, created by
the HDFS administrator user ('hadoop' in your case): sudo -u hadoop
hadoop fs -mkdir /user/user1; sudo -u hadoop hadoop fs -chown
user1:user1 /user/user1. After this, the user should be able to run
jobs and manipulate files in their own directory.
On Thu, Aug 29, 2013 at 10:21 AM, Hadoop Raj <ha...@yahoo.com> wrote:
> Hi,
>
> I have a hadoop learning environment on a pseudo distributed mode. It is owned by the user 'hadoop'.
>
> I am trying to get an understanding on how can another user on this box can act as a Hadoop client and able to create HDFS files and run Map Reduce jobs. Say I have a Linux user 'user1'.
>
> What permissions , privileges and configuration settings are required for 'user1' to act as a Hadoop client?
>
> Thanks,
> Raj
--
Harsh J
Re: Hadoop client user
Posted by Shekhar Sharma <sh...@gmail.com>.
Put that user in hadoop group...
And if the user wants to hadoop client, then the use should be aware
of two properties fs.default.name which is the address of NameNode and
mapred.job.tracker which is the address of job tracker
Regards,
Som Shekhar Sharma
+91-8197243810
On Thu, Aug 29, 2013 at 10:55 AM, Harsh J <ha...@cloudera.com> wrote:
> The user1 will mainly require a home directory on the HDFS, created by
> the HDFS administrator user ('hadoop' in your case): sudo -u hadoop
> hadoop fs -mkdir /user/user1; sudo -u hadoop hadoop fs -chown
> user1:user1 /user/user1. After this, the user should be able to run
> jobs and manipulate files in their own directory.
>
> On Thu, Aug 29, 2013 at 10:21 AM, Hadoop Raj <ha...@yahoo.com> wrote:
>> Hi,
>>
>> I have a hadoop learning environment on a pseudo distributed mode. It is owned by the user 'hadoop'.
>>
>> I am trying to get an understanding on how can another user on this box can act as a Hadoop client and able to create HDFS files and run Map Reduce jobs. Say I have a Linux user 'user1'.
>>
>> What permissions , privileges and configuration settings are required for 'user1' to act as a Hadoop client?
>>
>> Thanks,
>> Raj
>
>
>
> --
> Harsh J
Re: Hadoop client user
Posted by Shekhar Sharma <sh...@gmail.com>.
Put that user in hadoop group...
And if the user wants to hadoop client, then the use should be aware
of two properties fs.default.name which is the address of NameNode and
mapred.job.tracker which is the address of job tracker
Regards,
Som Shekhar Sharma
+91-8197243810
On Thu, Aug 29, 2013 at 10:55 AM, Harsh J <ha...@cloudera.com> wrote:
> The user1 will mainly require a home directory on the HDFS, created by
> the HDFS administrator user ('hadoop' in your case): sudo -u hadoop
> hadoop fs -mkdir /user/user1; sudo -u hadoop hadoop fs -chown
> user1:user1 /user/user1. After this, the user should be able to run
> jobs and manipulate files in their own directory.
>
> On Thu, Aug 29, 2013 at 10:21 AM, Hadoop Raj <ha...@yahoo.com> wrote:
>> Hi,
>>
>> I have a hadoop learning environment on a pseudo distributed mode. It is owned by the user 'hadoop'.
>>
>> I am trying to get an understanding on how can another user on this box can act as a Hadoop client and able to create HDFS files and run Map Reduce jobs. Say I have a Linux user 'user1'.
>>
>> What permissions , privileges and configuration settings are required for 'user1' to act as a Hadoop client?
>>
>> Thanks,
>> Raj
>
>
>
> --
> Harsh J
Re: Hadoop client user
Posted by Raj Hadoop <ha...@yahoo.com>.
Thanks Harsh. That is a very good explanation.
I am trying to understand how in a production cluster, hadoop user and hadoop clients would be.
What users should exist in NN, JT, DN ?
Regards,
Rajendra
________________________________
From: Harsh J <ha...@cloudera.com>
To: "<us...@hadoop.apache.org>" <us...@hadoop.apache.org>
Sent: Thursday, August 29, 2013 1:25 AM
Subject: Re: Hadoop client user
The user1 will mainly require a home directory on the HDFS, created by
the HDFS administrator user ('hadoop' in your case): sudo -u hadoop
hadoop fs -mkdir /user/user1; sudo -u hadoop hadoop fs -chown
user1:user1 /user/user1. After this, the user should be able to run
jobs and manipulate files in their own directory.
On Thu, Aug 29, 2013 at 10:21 AM, Hadoop Raj <ha...@yahoo.com> wrote:
> Hi,
>
> I have a hadoop learning environment on a pseudo distributed mode. It is owned by the user 'hadoop'.
>
> I am trying to get an understanding on how can another user on this box can act as a Hadoop client and able to create HDFS files and run Map Reduce jobs. Say I have a Linux user 'user1'.
>
> What permissions , privileges and configuration settings are required for 'user1' to act as a Hadoop client?
>
> Thanks,
> Raj
--
Harsh J
Re: Hadoop client user
Posted by Raj Hadoop <ha...@yahoo.com>.
Thanks Harsh. That is a very good explanation.
I am trying to understand how in a production cluster, hadoop user and hadoop clients would be.
What users should exist in NN, JT, DN ?
Regards,
Rajendra
________________________________
From: Harsh J <ha...@cloudera.com>
To: "<us...@hadoop.apache.org>" <us...@hadoop.apache.org>
Sent: Thursday, August 29, 2013 1:25 AM
Subject: Re: Hadoop client user
The user1 will mainly require a home directory on the HDFS, created by
the HDFS administrator user ('hadoop' in your case): sudo -u hadoop
hadoop fs -mkdir /user/user1; sudo -u hadoop hadoop fs -chown
user1:user1 /user/user1. After this, the user should be able to run
jobs and manipulate files in their own directory.
On Thu, Aug 29, 2013 at 10:21 AM, Hadoop Raj <ha...@yahoo.com> wrote:
> Hi,
>
> I have a hadoop learning environment on a pseudo distributed mode. It is owned by the user 'hadoop'.
>
> I am trying to get an understanding on how can another user on this box can act as a Hadoop client and able to create HDFS files and run Map Reduce jobs. Say I have a Linux user 'user1'.
>
> What permissions , privileges and configuration settings are required for 'user1' to act as a Hadoop client?
>
> Thanks,
> Raj
--
Harsh J
Re: Hadoop client user
Posted by Harsh J <ha...@cloudera.com>.
The user1 will mainly require a home directory on the HDFS, created by
the HDFS administrator user ('hadoop' in your case): sudo -u hadoop
hadoop fs -mkdir /user/user1; sudo -u hadoop hadoop fs -chown
user1:user1 /user/user1. After this, the user should be able to run
jobs and manipulate files in their own directory.
On Thu, Aug 29, 2013 at 10:21 AM, Hadoop Raj <ha...@yahoo.com> wrote:
> Hi,
>
> I have a hadoop learning environment on a pseudo distributed mode. It is owned by the user 'hadoop'.
>
> I am trying to get an understanding on how can another user on this box can act as a Hadoop client and able to create HDFS files and run Map Reduce jobs. Say I have a Linux user 'user1'.
>
> What permissions , privileges and configuration settings are required for 'user1' to act as a Hadoop client?
>
> Thanks,
> Raj
--
Harsh J
Re: Hadoop client user
Posted by Harsh J <ha...@cloudera.com>.
The user1 will mainly require a home directory on the HDFS, created by
the HDFS administrator user ('hadoop' in your case): sudo -u hadoop
hadoop fs -mkdir /user/user1; sudo -u hadoop hadoop fs -chown
user1:user1 /user/user1. After this, the user should be able to run
jobs and manipulate files in their own directory.
On Thu, Aug 29, 2013 at 10:21 AM, Hadoop Raj <ha...@yahoo.com> wrote:
> Hi,
>
> I have a hadoop learning environment on a pseudo distributed mode. It is owned by the user 'hadoop'.
>
> I am trying to get an understanding on how can another user on this box can act as a Hadoop client and able to create HDFS files and run Map Reduce jobs. Say I have a Linux user 'user1'.
>
> What permissions , privileges and configuration settings are required for 'user1' to act as a Hadoop client?
>
> Thanks,
> Raj
--
Harsh J
Re: Hadoop client user
Posted by Harsh J <ha...@cloudera.com>.
The user1 will mainly require a home directory on the HDFS, created by
the HDFS administrator user ('hadoop' in your case): sudo -u hadoop
hadoop fs -mkdir /user/user1; sudo -u hadoop hadoop fs -chown
user1:user1 /user/user1. After this, the user should be able to run
jobs and manipulate files in their own directory.
On Thu, Aug 29, 2013 at 10:21 AM, Hadoop Raj <ha...@yahoo.com> wrote:
> Hi,
>
> I have a hadoop learning environment on a pseudo distributed mode. It is owned by the user 'hadoop'.
>
> I am trying to get an understanding on how can another user on this box can act as a Hadoop client and able to create HDFS files and run Map Reduce jobs. Say I have a Linux user 'user1'.
>
> What permissions , privileges and configuration settings are required for 'user1' to act as a Hadoop client?
>
> Thanks,
> Raj
--
Harsh J
Re: Hadoop client user
Posted by Harsh J <ha...@cloudera.com>.
The user1 will mainly require a home directory on the HDFS, created by
the HDFS administrator user ('hadoop' in your case): sudo -u hadoop
hadoop fs -mkdir /user/user1; sudo -u hadoop hadoop fs -chown
user1:user1 /user/user1. After this, the user should be able to run
jobs and manipulate files in their own directory.
On Thu, Aug 29, 2013 at 10:21 AM, Hadoop Raj <ha...@yahoo.com> wrote:
> Hi,
>
> I have a hadoop learning environment on a pseudo distributed mode. It is owned by the user 'hadoop'.
>
> I am trying to get an understanding on how can another user on this box can act as a Hadoop client and able to create HDFS files and run Map Reduce jobs. Say I have a Linux user 'user1'.
>
> What permissions , privileges and configuration settings are required for 'user1' to act as a Hadoop client?
>
> Thanks,
> Raj
--
Harsh J