You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Manoj Babu <ma...@gmail.com> on 2012/07/10 07:54:09 UTC
How to change name node storage directory?
Hi,
It would be great if you could provide answer for the below doubts.
1,How to change name node storage directory?[i tried
*hadoop.tmp.dir,**hadoop.name.dir
but it leads to other issue but reverting back works fine*]
2,Can we provide the path of my home directory since my /user and /var
directories where less in space?
**
Cheers!
Manoj.
Re: How to change name node storage directory?
Posted by Harsh J <ha...@cloudera.com>.
Manoj,
1. Since the NameNode is the one that uses it, you need to ensure the
permissions cater well to the user who runs the NameNode.
2. The folders are auto created, as you should have noticed, when you
format the NameNode.
3. Delete the dfs.data.dir (or dfs.datanode.data.dir) directories, if
you are formatting your NameNode.
On Tue, Jul 10, 2012 at 12:23 PM, Manoj Babu <ma...@gmail.com> wrote:
> Hi Harsh,
>
> What permission do we need to provide for dfs.name.dir folder? and the
> remaining internal folder structures will it be created auto or do we need
> to create manually?
>
> Also How to clean data node?
>
> Thanks in Advance!
>
> Cheers!
> Manoj.
>
>
>
> On Tue, Jul 10, 2012 at 11:58 AM, Harsh J <ha...@cloudera.com> wrote:
>>
>> Manoj,
>>
>> If you change your dfs.name.dir (Which is the right property for
>> 0.20.x/1.x) or dfs.namenode.name.dir (Which is the right property for
>> 0.23/2.x) completely to a different directory, you will need to move
>> the contents of the original, older name-directory to the new one to
>> preserve data, or if you wish to start again from scratch, you'll need
>> to run a format of the NameNode and scrub your DataNode directories
>> clean.
>>
>> On Tue, Jul 10, 2012 at 11:24 AM, Manoj Babu <ma...@gmail.com> wrote:
>> >
>> > Hi,
>> >
>> > It would be great if you could provide answer for the below doubts.
>> >
>> > 1,How to change name node storage directory?[i tried
>> > hadoop.tmp.dir,hadoop.name.dir but it leads to other issue but reverting
>> > back works fine]
>> >
>> > 2,Can we provide the path of my home directory since my /user and /var
>> > directories where less in space?
>> >
>> >
>> >
>> > Cheers!
>> > Manoj.
>> >
>>
>>
>>
>> --
>> Harsh J
>
>
HTH! You may also find http://search-hadoop.com useful when searching
answers to your questions.
--
Harsh J
Re: How to change name node storage directory?
Posted by Manoj Babu <ma...@gmail.com>.
Hi Harsh,
What permission do we need to provide for dfs.name.dir folder? and the
remaining internal folder structures will it be created auto or do we need
to create manually?
Also How to clean data node?
Thanks in Advance!
Cheers!
Manoj.
On Tue, Jul 10, 2012 at 11:58 AM, Harsh J <ha...@cloudera.com> wrote:
> Manoj,
>
> If you change your dfs.name.dir (Which is the right property for
> 0.20.x/1.x) or dfs.namenode.name.dir (Which is the right property for
> 0.23/2.x) completely to a different directory, you will need to move
> the contents of the original, older name-directory to the new one to
> preserve data, or if you wish to start again from scratch, you'll need
> to run a format of the NameNode and scrub your DataNode directories
> clean.
>
> On Tue, Jul 10, 2012 at 11:24 AM, Manoj Babu <ma...@gmail.com> wrote:
> >
> > Hi,
> >
> > It would be great if you could provide answer for the below doubts.
> >
> > 1,How to change name node storage directory?[i tried
> > hadoop.tmp.dir,hadoop.name.dir but it leads to other issue but reverting
> > back works fine]
> >
> > 2,Can we provide the path of my home directory since my /user and /var
> > directories where less in space?
> >
> >
> >
> > Cheers!
> > Manoj.
> >
>
>
>
> --
> Harsh J
>
Re: How to change name node storage directory?
Posted by Harsh J <ha...@cloudera.com>.
Manoj,
If you change your dfs.name.dir (Which is the right property for
0.20.x/1.x) or dfs.namenode.name.dir (Which is the right property for
0.23/2.x) completely to a different directory, you will need to move
the contents of the original, older name-directory to the new one to
preserve data, or if you wish to start again from scratch, you'll need
to run a format of the NameNode and scrub your DataNode directories
clean.
On Tue, Jul 10, 2012 at 11:24 AM, Manoj Babu <ma...@gmail.com> wrote:
>
> Hi,
>
> It would be great if you could provide answer for the below doubts.
>
> 1,How to change name node storage directory?[i tried
> hadoop.tmp.dir,hadoop.name.dir but it leads to other issue but reverting
> back works fine]
>
> 2,Can we provide the path of my home directory since my /user and /var
> directories where less in space?
>
>
>
> Cheers!
> Manoj.
>
--
Harsh J