You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Ryan Rosario <uc...@gmail.com> on 2010/04/03 23:36:30 UTC
Trouble Submitting Job as another User
Hi,
I am trying to set up a Hadoop cluster so that any of our users can
access HDFS and submit jobs and I am having trouble with this.
I added a HDFS path for mapred.system.dir in mapred-site.xml as
suggested in an FAQ.
I start/stop the cluster with system user _hadoop.
I would like to be able to access HDFS and submit jobs as user "ryan"
(and other users on the system). When I attempt to copy a directory
from local FS to HDFS I get,
10/04/03 14:35:27 INFO ipc.Client: Retrying connect to server:
localhost/127.0.0.1:9000. Already tried 0 time(s).
.
.
.
How can I accomplish what I am trying to do?
Thanks in advance,
Ryan
--
RRR
RE: Trouble Submitting Job as another User
Posted by Michael Segel <mi...@hotmail.com>.
> From: michael_segel@hotmail.com
> To: common-user@hadoop.apache.org
> Subject: RE: Trouble Submitting Job as another User
> Date: Sun, 4 Apr 2010 17:57:51 -0500
>
>
>
>
> > Date: Sat, 3 Apr 2010 14:56:00 -0700
> > Subject: Re: Trouble Submitting Job as another User
> > From: uclamathguy@gmail.com
> > To: common-user@hadoop.apache.org
> >
> > Yes. I just tried that then stopped mapred and dfs and restarted them.
> > No change.
> >
Sorry,
I don't know why my post didn't make it...
Here's what I was saying...
If you go in to hadoop, create a home directory for the user and then change ownership and permissions, the user should then be able to use the cloud.
An example: User : John Doe , Unix ID: jdoe
So you'd create an HDFS directory : /user/jdoe
Change the ownership jdoe:jdoe for /user/jdoe
and that should be it.
No?
-Mike
_________________________________________________________________
The New Busy think 9 to 5 is a cute idea. Combine multiple calendars with Hotmail.
http://www.windowslive.com/campaign/thenewbusy?tile=multicalendar&ocid=PID28326::T:WLMTAGL:ON:WL:en-US:WM_HMP:042010_5
RE: Trouble Submitting Job as another User
Posted by Michael Segel <mi...@hotmail.com>.
> Date: Sat, 3 Apr 2010 14:56:00 -0700
> Subject: Re: Trouble Submitting Job as another User
> From: uclamathguy@gmail.com
> To: common-user@hadoop.apache.org
>
> Yes. I just tried that then stopped mapred and dfs and restarted them.
> No change.
>
> 10/04/03 14:55:03 INFO ipc.Client: Retrying connect to server:
> localhost/127.0.0.1:9000. Already tried 0 time(s).
> 10/04/03 14:55:04 INFO ipc.Client: Retrying connect to server:
> localhost/127.0.0.1:9000. Already tried 1 time(s).
> 10/04/03 14:55:05 INFO ipc.Client: Retrying connect to server:
> localhost/127.0.0.1:9000. Already tried 2 time(s).
> 10/04/03 14:55:06 INFO ipc.Client: Retrying connect to server:
> localhost/127.0.0.1:9000. Already tried 3 time(s).
> 10/04/03 14:55:07 INFO ipc.Client: Retrying connect to server:
> localhost/127.0.0.1:9000. Already tried 4 time(s).
> 10/04/03 14:55:08 INFO ipc.Client: Retrying connect to server:
> localhost/127.0.0.1:9000. Already tried 5 time(s).
> 10/04/03 14:55:09 INFO ipc.Client: Retrying connect to server:
> localhost/127.0.0.1:9000. Already tried 6 time(s).
> 10/04/03 14:55:10 INFO ipc.Client: Retrying connect to server:
> localhost/127.0.0.1:9000. Already tried 7 time(s).
> 10/04/03 14:55:11 INFO ipc.Client: Retrying connect to server:
> localhost/127.0.0.1:9000. Already tried 8 time(s).
> 10/04/03 14:55:12 INFO ipc.Client: Retrying connect to server:
> localhost/127.0.0.1:9000. Already tried 9 time(s).
> Bad connection to FS. command aborted.
>
> I am still only able to connect to HDFS only as _hadoop.
>
> R.
>
> On Sat, Apr 3, 2010 at 2:49 PM, abhishek sharma <ab...@usc.edu> wrote:
> > Did you disable the permissions for HDFS?
> >
> > <property>
> > <name>dfs.permissions</name>
> > <value>false</value>
> > </property>
> >
> >
> > Abhishek
> >
> > On Sat, Apr 3, 2010 at 5:36 PM, Ryan Rosario <uc...@gmail.com> wrote:
> >> Hi,
> >>
> >> I am trying to set up a Hadoop cluster so that any of our users can
> >> access HDFS and submit jobs and I am having trouble with this.
> >> I added a HDFS path for mapred.system.dir in mapred-site.xml as
> >> suggested in an FAQ.
> >>
> >> I start/stop the cluster with system user _hadoop.
> >> I would like to be able to access HDFS and submit jobs as user "ryan"
> >> (and other users on the system). When I attempt to copy a directory
> >> from local FS to HDFS I get,
> >>
> >> 10/04/03 14:35:27 INFO ipc.Client: Retrying connect to server:
> >> localhost/127.0.0.1:9000. Already tried 0 time(s).
> >> .
> >> .
> >> .
> >>
> >> How can I accomplish what I am trying to do?
> >>
> >> Thanks in advance,
> >> Ryan
> >>
> >> --
> >> RRR
> >>
> >
>
>
>
> --
> RRR
_________________________________________________________________
Hotmail is redefining busy with tools for the New Busy. Get more from your inbox.
http://www.windowslive.com/campaign/thenewbusy?ocid=PID28326::T:WLMTAGL:ON:WL:en-US:WM_HMP:042010_2
Re: Trouble Submitting Job as another User
Posted by Ryan Rosario <uc...@gmail.com>.
Yes. I just tried that then stopped mapred and dfs and restarted them.
No change.
10/04/03 14:55:03 INFO ipc.Client: Retrying connect to server:
localhost/127.0.0.1:9000. Already tried 0 time(s).
10/04/03 14:55:04 INFO ipc.Client: Retrying connect to server:
localhost/127.0.0.1:9000. Already tried 1 time(s).
10/04/03 14:55:05 INFO ipc.Client: Retrying connect to server:
localhost/127.0.0.1:9000. Already tried 2 time(s).
10/04/03 14:55:06 INFO ipc.Client: Retrying connect to server:
localhost/127.0.0.1:9000. Already tried 3 time(s).
10/04/03 14:55:07 INFO ipc.Client: Retrying connect to server:
localhost/127.0.0.1:9000. Already tried 4 time(s).
10/04/03 14:55:08 INFO ipc.Client: Retrying connect to server:
localhost/127.0.0.1:9000. Already tried 5 time(s).
10/04/03 14:55:09 INFO ipc.Client: Retrying connect to server:
localhost/127.0.0.1:9000. Already tried 6 time(s).
10/04/03 14:55:10 INFO ipc.Client: Retrying connect to server:
localhost/127.0.0.1:9000. Already tried 7 time(s).
10/04/03 14:55:11 INFO ipc.Client: Retrying connect to server:
localhost/127.0.0.1:9000. Already tried 8 time(s).
10/04/03 14:55:12 INFO ipc.Client: Retrying connect to server:
localhost/127.0.0.1:9000. Already tried 9 time(s).
Bad connection to FS. command aborted.
I am still only able to connect to HDFS only as _hadoop.
R.
On Sat, Apr 3, 2010 at 2:49 PM, abhishek sharma <ab...@usc.edu> wrote:
> Did you disable the permissions for HDFS?
>
> <property>
> <name>dfs.permissions</name>
> <value>false</value>
> </property>
>
>
> Abhishek
>
> On Sat, Apr 3, 2010 at 5:36 PM, Ryan Rosario <uc...@gmail.com> wrote:
>> Hi,
>>
>> I am trying to set up a Hadoop cluster so that any of our users can
>> access HDFS and submit jobs and I am having trouble with this.
>> I added a HDFS path for mapred.system.dir in mapred-site.xml as
>> suggested in an FAQ.
>>
>> I start/stop the cluster with system user _hadoop.
>> I would like to be able to access HDFS and submit jobs as user "ryan"
>> (and other users on the system). When I attempt to copy a directory
>> from local FS to HDFS I get,
>>
>> 10/04/03 14:35:27 INFO ipc.Client: Retrying connect to server:
>> localhost/127.0.0.1:9000. Already tried 0 time(s).
>> .
>> .
>> .
>>
>> How can I accomplish what I am trying to do?
>>
>> Thanks in advance,
>> Ryan
>>
>> --
>> RRR
>>
>
--
RRR
Re: Trouble Submitting Job as another User
Posted by abhishek sharma <ab...@usc.edu>.
Did you disable the permissions for HDFS?
<property>
<name>dfs.permissions</name>
<value>false</value>
</property>
Abhishek
On Sat, Apr 3, 2010 at 5:36 PM, Ryan Rosario <uc...@gmail.com> wrote:
> Hi,
>
> I am trying to set up a Hadoop cluster so that any of our users can
> access HDFS and submit jobs and I am having trouble with this.
> I added a HDFS path for mapred.system.dir in mapred-site.xml as
> suggested in an FAQ.
>
> I start/stop the cluster with system user _hadoop.
> I would like to be able to access HDFS and submit jobs as user "ryan"
> (and other users on the system). When I attempt to copy a directory
> from local FS to HDFS I get,
>
> 10/04/03 14:35:27 INFO ipc.Client: Retrying connect to server:
> localhost/127.0.0.1:9000. Already tried 0 time(s).
> .
> .
> .
>
> How can I accomplish what I am trying to do?
>
> Thanks in advance,
> Ryan
>
> --
> RRR
>