You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Nicholas Loulloudes <lo...@cs.ucy.ac.cy> on 2009/02/17 19:48:16 UTC

Allowing other system users to use Haddoop

Hi all,

I just installed Hadoop (Single Node) on a Linux Ubuntu distribution as
per the instructions found in the following website:

http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Single-Node_Cluster)

I followed the instructions of the website to create a "hadoop" system
user and group and i was able to run a Map Reduce job successfully.

What i want to do now is to create more system users which will be able
to use Hadoop for running Map Reduce jobs.

Is there any guide on how to achieve these??

Any suggestions will be highly appreciated.

Thanks in advance,

-- 
_________________________________________________

Nicholas Loulloudes
High Performance Computing Systems Laboratory (HPCL)
University of Cyprus,
Nicosia, Cyprus





Re: Allowing other system users to use Haddoop

Posted by Rasit OZDAS <ra...@gmail.com>.
Nicholas, like Matei said,
There is 2 possibility in terms of permissions:

(any permissions command is just-like in linux)

1. Create a directory for a user. Make the user owner of that directory:
hadoop dfs -chown ... (assuming hadoop doesn't need to have write access to
any file outside user's home directory)
2. Convert group ownership of all files in HDFS to a group name which any
user has. (hadoop dfs -chgrp -R <groupname> /). Then give group write access
(hadoop dfs -chmod -R g+w /), again to all files. (here, any user runs jobs,
hadoop creates automatically a separated home directory). This way is better
for development environment, I think.

Cheers,
Rasit

2009/2/18 Matei Zaharia <ma...@cloudera.com>

> Other users should be able to submit jobs using the same commands
> (bin/hadoop ...). Are there errors you ran into?
> One thing is that you'll need to grant them permissions over any files in
> HDFS that you want them to read. You can do it using bin/hadoop fs -chmod,
> which works like chmod on Linux. You may need to run this as the root user
> (sudo bin/hadoop fs -chmod). Also, I don't remember exactly, but you may
> need to create home directories for them in HDFS as well (again create them
> as root, and then sudo bin/hadoop fs -chown them).
>
> On Tue, Feb 17, 2009 at 10:48 AM, Nicholas Loulloudes <
> loulloudes.n@cs.ucy.ac.cy> wrote:
>
> > Hi all,
> >
> > I just installed Hadoop (Single Node) on a Linux Ubuntu distribution as
> > per the instructions found in the following website:
> >
> >
> >
> http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Single-Node_Cluster)<http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_%28Single-Node_Cluster%29>
> >
> > I followed the instructions of the website to create a "hadoop" system
> > user and group and i was able to run a Map Reduce job successfully.
> >
> > What i want to do now is to create more system users which will be able
> > to use Hadoop for running Map Reduce jobs.
> >
> > Is there any guide on how to achieve these??
> >
> > Any suggestions will be highly appreciated.
> >
> > Thanks in advance,
> >
> > --
> > _________________________________________________
> >
> > Nicholas Loulloudes
> > High Performance Computing Systems Laboratory (HPCL)
> > University of Cyprus,
> > Nicosia, Cyprus
> >
> >
> >
> >
> >
>



-- 
M. Raşit ÖZDAŞ

Re: Allowing other system users to use Haddoop

Posted by Matei Zaharia <ma...@cloudera.com>.
Other users should be able to submit jobs using the same commands
(bin/hadoop ...). Are there errors you ran into?
One thing is that you'll need to grant them permissions over any files in
HDFS that you want them to read. You can do it using bin/hadoop fs -chmod,
which works like chmod on Linux. You may need to run this as the root user
(sudo bin/hadoop fs -chmod). Also, I don't remember exactly, but you may
need to create home directories for them in HDFS as well (again create them
as root, and then sudo bin/hadoop fs -chown them).

On Tue, Feb 17, 2009 at 10:48 AM, Nicholas Loulloudes <
loulloudes.n@cs.ucy.ac.cy> wrote:

> Hi all,
>
> I just installed Hadoop (Single Node) on a Linux Ubuntu distribution as
> per the instructions found in the following website:
>
>
> http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Single-Node_Cluster)
>
> I followed the instructions of the website to create a "hadoop" system
> user and group and i was able to run a Map Reduce job successfully.
>
> What i want to do now is to create more system users which will be able
> to use Hadoop for running Map Reduce jobs.
>
> Is there any guide on how to achieve these??
>
> Any suggestions will be highly appreciated.
>
> Thanks in advance,
>
> --
> _________________________________________________
>
> Nicholas Loulloudes
> High Performance Computing Systems Laboratory (HPCL)
> University of Cyprus,
> Nicosia, Cyprus
>
>
>
>
>