You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by rab ra <ra...@gmail.com> on 2013/11/11 17:37:51 UTC
Hadoop on multiple user mode?
---------- Forwarded message ----------
From: "rab ra" <ra...@gmail.com>
Date: 11 Nov 2013 20:11
Subject: Hadoop on multiple user mode
To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
Hello
I want to configure hadoop so that it is started as user admin and more
than one user can launch job. I notice that while i submit job as a guest
user, the map process is executed as admin user. I print user home in my
main code as well as inside map process. Is there a way span map process a
job submitting user?
Re: Hadoop on multiple user mode?
Posted by Harsh J <ha...@cloudera.com>.
Hi,
In MR2 over YARN, you'll need to configure the LinuxContainerExecutor
instead.
On Tue, Nov 12, 2013 at 2:11 PM, rab ra <ra...@gmail.com> wrote:
> Thanks for the response. However I could not find LinuxTaskController in
> hadoop 2.2.0.
> On 12 Nov 2013 03:10, "Harsh J" <ha...@cloudera.com> wrote:
>
>> If you'd like the tasks to use the actual submitting user accounts,
>> you'll need to turn on security, or more specifically use the
>> LinuxTaskController instead of the DefaultTaskController.
>>
>> On Mon, Nov 11, 2013 at 10:07 PM, rab ra <ra...@gmail.com> wrote:
>> > ---------- Forwarded message ----------
>> > From: "rab ra" <ra...@gmail.com>
>> > Date: 11 Nov 2013 20:11
>> > Subject: Hadoop on multiple user mode
>> > To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
>> >
>> > Hello
>> >
>> > I want to configure hadoop so that it is started as user admin and more
>> than
>> > one user can launch job. I notice that while i submit job as a guest
>> user,
>> > the map process is executed as admin user. I print user home in my main
>> code
>> > as well as inside map process. Is there a way span map process a job
>> > submitting user?
>>
>>
>>
>> --
>> Harsh J
>>
>
--
Harsh J
Re: Hadoop on multiple user mode?
Posted by Harsh J <ha...@cloudera.com>.
Hi,
In MR2 over YARN, you'll need to configure the LinuxContainerExecutor
instead.
On Tue, Nov 12, 2013 at 2:11 PM, rab ra <ra...@gmail.com> wrote:
> Thanks for the response. However I could not find LinuxTaskController in
> hadoop 2.2.0.
> On 12 Nov 2013 03:10, "Harsh J" <ha...@cloudera.com> wrote:
>
>> If you'd like the tasks to use the actual submitting user accounts,
>> you'll need to turn on security, or more specifically use the
>> LinuxTaskController instead of the DefaultTaskController.
>>
>> On Mon, Nov 11, 2013 at 10:07 PM, rab ra <ra...@gmail.com> wrote:
>> > ---------- Forwarded message ----------
>> > From: "rab ra" <ra...@gmail.com>
>> > Date: 11 Nov 2013 20:11
>> > Subject: Hadoop on multiple user mode
>> > To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
>> >
>> > Hello
>> >
>> > I want to configure hadoop so that it is started as user admin and more
>> than
>> > one user can launch job. I notice that while i submit job as a guest
>> user,
>> > the map process is executed as admin user. I print user home in my main
>> code
>> > as well as inside map process. Is there a way span map process a job
>> > submitting user?
>>
>>
>>
>> --
>> Harsh J
>>
>
--
Harsh J
Re: Hadoop on multiple user mode?
Posted by Harsh J <ha...@cloudera.com>.
Hi,
In MR2 over YARN, you'll need to configure the LinuxContainerExecutor
instead.
On Tue, Nov 12, 2013 at 2:11 PM, rab ra <ra...@gmail.com> wrote:
> Thanks for the response. However I could not find LinuxTaskController in
> hadoop 2.2.0.
> On 12 Nov 2013 03:10, "Harsh J" <ha...@cloudera.com> wrote:
>
>> If you'd like the tasks to use the actual submitting user accounts,
>> you'll need to turn on security, or more specifically use the
>> LinuxTaskController instead of the DefaultTaskController.
>>
>> On Mon, Nov 11, 2013 at 10:07 PM, rab ra <ra...@gmail.com> wrote:
>> > ---------- Forwarded message ----------
>> > From: "rab ra" <ra...@gmail.com>
>> > Date: 11 Nov 2013 20:11
>> > Subject: Hadoop on multiple user mode
>> > To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
>> >
>> > Hello
>> >
>> > I want to configure hadoop so that it is started as user admin and more
>> than
>> > one user can launch job. I notice that while i submit job as a guest
>> user,
>> > the map process is executed as admin user. I print user home in my main
>> code
>> > as well as inside map process. Is there a way span map process a job
>> > submitting user?
>>
>>
>>
>> --
>> Harsh J
>>
>
--
Harsh J
Re: Hadoop on multiple user mode?
Posted by Harsh J <ha...@cloudera.com>.
Hi,
In MR2 over YARN, you'll need to configure the LinuxContainerExecutor
instead.
On Tue, Nov 12, 2013 at 2:11 PM, rab ra <ra...@gmail.com> wrote:
> Thanks for the response. However I could not find LinuxTaskController in
> hadoop 2.2.0.
> On 12 Nov 2013 03:10, "Harsh J" <ha...@cloudera.com> wrote:
>
>> If you'd like the tasks to use the actual submitting user accounts,
>> you'll need to turn on security, or more specifically use the
>> LinuxTaskController instead of the DefaultTaskController.
>>
>> On Mon, Nov 11, 2013 at 10:07 PM, rab ra <ra...@gmail.com> wrote:
>> > ---------- Forwarded message ----------
>> > From: "rab ra" <ra...@gmail.com>
>> > Date: 11 Nov 2013 20:11
>> > Subject: Hadoop on multiple user mode
>> > To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
>> >
>> > Hello
>> >
>> > I want to configure hadoop so that it is started as user admin and more
>> than
>> > one user can launch job. I notice that while i submit job as a guest
>> user,
>> > the map process is executed as admin user. I print user home in my main
>> code
>> > as well as inside map process. Is there a way span map process a job
>> > submitting user?
>>
>>
>>
>> --
>> Harsh J
>>
>
--
Harsh J
Re: Hadoop on multiple user mode?
Posted by rab ra <ra...@gmail.com>.
Thanks for the response. However I could not find LinuxTaskController in
hadoop 2.2.0.
On 12 Nov 2013 03:10, "Harsh J" <ha...@cloudera.com> wrote:
> If you'd like the tasks to use the actual submitting user accounts,
> you'll need to turn on security, or more specifically use the
> LinuxTaskController instead of the DefaultTaskController.
>
> On Mon, Nov 11, 2013 at 10:07 PM, rab ra <ra...@gmail.com> wrote:
> > ---------- Forwarded message ----------
> > From: "rab ra" <ra...@gmail.com>
> > Date: 11 Nov 2013 20:11
> > Subject: Hadoop on multiple user mode
> > To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
> >
> > Hello
> >
> > I want to configure hadoop so that it is started as user admin and more
> than
> > one user can launch job. I notice that while i submit job as a guest
> user,
> > the map process is executed as admin user. I print user home in my main
> code
> > as well as inside map process. Is there a way span map process a job
> > submitting user?
>
>
>
> --
> Harsh J
>
Re: Hadoop on multiple user mode?
Posted by rab ra <ra...@gmail.com>.
Thanks for the response. However I could not find LinuxTaskController in
hadoop 2.2.0.
On 12 Nov 2013 03:10, "Harsh J" <ha...@cloudera.com> wrote:
> If you'd like the tasks to use the actual submitting user accounts,
> you'll need to turn on security, or more specifically use the
> LinuxTaskController instead of the DefaultTaskController.
>
> On Mon, Nov 11, 2013 at 10:07 PM, rab ra <ra...@gmail.com> wrote:
> > ---------- Forwarded message ----------
> > From: "rab ra" <ra...@gmail.com>
> > Date: 11 Nov 2013 20:11
> > Subject: Hadoop on multiple user mode
> > To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
> >
> > Hello
> >
> > I want to configure hadoop so that it is started as user admin and more
> than
> > one user can launch job. I notice that while i submit job as a guest
> user,
> > the map process is executed as admin user. I print user home in my main
> code
> > as well as inside map process. Is there a way span map process a job
> > submitting user?
>
>
>
> --
> Harsh J
>
Re: Hadoop on multiple user mode?
Posted by rab ra <ra...@gmail.com>.
Thanks for the response. However I could not find LinuxTaskController in
hadoop 2.2.0.
On 12 Nov 2013 03:10, "Harsh J" <ha...@cloudera.com> wrote:
> If you'd like the tasks to use the actual submitting user accounts,
> you'll need to turn on security, or more specifically use the
> LinuxTaskController instead of the DefaultTaskController.
>
> On Mon, Nov 11, 2013 at 10:07 PM, rab ra <ra...@gmail.com> wrote:
> > ---------- Forwarded message ----------
> > From: "rab ra" <ra...@gmail.com>
> > Date: 11 Nov 2013 20:11
> > Subject: Hadoop on multiple user mode
> > To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
> >
> > Hello
> >
> > I want to configure hadoop so that it is started as user admin and more
> than
> > one user can launch job. I notice that while i submit job as a guest
> user,
> > the map process is executed as admin user. I print user home in my main
> code
> > as well as inside map process. Is there a way span map process a job
> > submitting user?
>
>
>
> --
> Harsh J
>
Re: Hadoop on multiple user mode?
Posted by rab ra <ra...@gmail.com>.
Thanks for the response. However I could not find LinuxTaskController in
hadoop 2.2.0.
On 12 Nov 2013 03:10, "Harsh J" <ha...@cloudera.com> wrote:
> If you'd like the tasks to use the actual submitting user accounts,
> you'll need to turn on security, or more specifically use the
> LinuxTaskController instead of the DefaultTaskController.
>
> On Mon, Nov 11, 2013 at 10:07 PM, rab ra <ra...@gmail.com> wrote:
> > ---------- Forwarded message ----------
> > From: "rab ra" <ra...@gmail.com>
> > Date: 11 Nov 2013 20:11
> > Subject: Hadoop on multiple user mode
> > To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
> >
> > Hello
> >
> > I want to configure hadoop so that it is started as user admin and more
> than
> > one user can launch job. I notice that while i submit job as a guest
> user,
> > the map process is executed as admin user. I print user home in my main
> code
> > as well as inside map process. Is there a way span map process a job
> > submitting user?
>
>
>
> --
> Harsh J
>
Re: Hadoop on multiple user mode?
Posted by Harsh J <ha...@cloudera.com>.
If you'd like the tasks to use the actual submitting user accounts,
you'll need to turn on security, or more specifically use the
LinuxTaskController instead of the DefaultTaskController.
On Mon, Nov 11, 2013 at 10:07 PM, rab ra <ra...@gmail.com> wrote:
> ---------- Forwarded message ----------
> From: "rab ra" <ra...@gmail.com>
> Date: 11 Nov 2013 20:11
> Subject: Hadoop on multiple user mode
> To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
>
> Hello
>
> I want to configure hadoop so that it is started as user admin and more than
> one user can launch job. I notice that while i submit job as a guest user,
> the map process is executed as admin user. I print user home in my main code
> as well as inside map process. Is there a way span map process a job
> submitting user?
--
Harsh J
Re: Hadoop on multiple user mode?
Posted by Harsh J <ha...@cloudera.com>.
If you'd like the tasks to use the actual submitting user accounts,
you'll need to turn on security, or more specifically use the
LinuxTaskController instead of the DefaultTaskController.
On Mon, Nov 11, 2013 at 10:07 PM, rab ra <ra...@gmail.com> wrote:
> ---------- Forwarded message ----------
> From: "rab ra" <ra...@gmail.com>
> Date: 11 Nov 2013 20:11
> Subject: Hadoop on multiple user mode
> To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
>
> Hello
>
> I want to configure hadoop so that it is started as user admin and more than
> one user can launch job. I notice that while i submit job as a guest user,
> the map process is executed as admin user. I print user home in my main code
> as well as inside map process. Is there a way span map process a job
> submitting user?
--
Harsh J
Re: Hadoop on multiple user mode?
Posted by Harsh J <ha...@cloudera.com>.
If you'd like the tasks to use the actual submitting user accounts,
you'll need to turn on security, or more specifically use the
LinuxTaskController instead of the DefaultTaskController.
On Mon, Nov 11, 2013 at 10:07 PM, rab ra <ra...@gmail.com> wrote:
> ---------- Forwarded message ----------
> From: "rab ra" <ra...@gmail.com>
> Date: 11 Nov 2013 20:11
> Subject: Hadoop on multiple user mode
> To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
>
> Hello
>
> I want to configure hadoop so that it is started as user admin and more than
> one user can launch job. I notice that while i submit job as a guest user,
> the map process is executed as admin user. I print user home in my main code
> as well as inside map process. Is there a way span map process a job
> submitting user?
--
Harsh J
Re: Hadoop on multiple user mode?
Posted by Harsh J <ha...@cloudera.com>.
If you'd like the tasks to use the actual submitting user accounts,
you'll need to turn on security, or more specifically use the
LinuxTaskController instead of the DefaultTaskController.
On Mon, Nov 11, 2013 at 10:07 PM, rab ra <ra...@gmail.com> wrote:
> ---------- Forwarded message ----------
> From: "rab ra" <ra...@gmail.com>
> Date: 11 Nov 2013 20:11
> Subject: Hadoop on multiple user mode
> To: "user@hadoop.apache.org" <us...@hadoop.apache.org>
>
> Hello
>
> I want to configure hadoop so that it is started as user admin and more than
> one user can launch job. I notice that while i submit job as a guest user,
> the map process is executed as admin user. I print user home in my main code
> as well as inside map process. Is there a way span map process a job
> submitting user?
--
Harsh J