You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Shavit Netzer <Sh...@conduit.com> on 2010/11/05 16:33:47 UTC

Hadoop partitions Problem

Hi,

I have hadoop cluster with 24 nodes.

Each node have 4 mount disks mnt - mnt3.

I'm getting alerts on mnt and the capacity is 99% full on it.

I have free space on other partitions mnt1-mnt3.

I used the balancer, but I still get alerts on disk size.

Any Ida what to do?

Sent from my mobile

RE: Hadoop partitions Problem

Posted by Shavit Netzer <Sh...@conduit.com>.

Thanks for your help.

Regards,
Shavit


-----Original Message-----
From: Allen Wittenauer [mailto:awittenauer@linkedin.com] 
Sent: Friday, November 05, 2010 10:37 PM
To: <co...@hadoop.apache.org>
Subject: Re: Hadoop partitions Problem


On Nov 5, 2010, at 8:33 AM, Shavit Netzer wrote:

> Hi,
> 
> I have hadoop cluster with 24 nodes.
> 
> Each node have 4 mount disks mnt - mnt3.
> 
> I'm getting alerts on mnt and the capacity is 99% full on it.
> 
> I have free space on other partitions mnt1-mnt3.
> 
> I used the balancer, but I still get alerts on disk size.
> 
> Any Ida what to do?


http://wiki.apache.org/hadoop/FAQ#On_an_individual_data_node.2C_how_do_you_balance_the_blocks_on_the_disk.3F

Re: Hadoop partitions Problem

Posted by Allen Wittenauer <aw...@linkedin.com>.

On Nov 5, 2010, at 8:33 AM, Shavit Netzer wrote:

> Hi,
> 
> I have hadoop cluster with 24 nodes.
> 
> Each node have 4 mount disks mnt - mnt3.
> 
> I'm getting alerts on mnt and the capacity is 99% full on it.
> 
> I have free space on other partitions mnt1-mnt3.
> 
> I used the balancer, but I still get alerts on disk size.
> 
> Any Ida what to do?


http://wiki.apache.org/hadoop/FAQ#On_an_individual_data_node.2C_how_do_you_balance_the_blocks_on_the_disk.3F

Re: Hadoop partitions Problem

Posted by Shavit Netzer <Sh...@conduit.com>.

Yes

Sent from my mobile

On 05/11/2010, at 19:09, "Harsh J" <qw...@gmail.com> wrote:

> Hi,
>
> On Fri, Nov 5, 2010 at 9:03 PM, Shavit Netzer <Sh...@conduit.com>  
> wrote:
>> Hi,
>>
>> I have hadoop cluster with 24 nodes.
>>
>> Each node have 4 mount disks mnt - mnt3.
>
> Just to confirm -- You've configured all DataNodes to utilize ALL
> these mount points via the dfs.data.dir property, yes?
>
>
>
> -- 
> Harsh J
> www.harshj.com

Re: Hadoop partitions Problem

Posted by Harsh J <qw...@gmail.com>.

Hi,

On Fri, Nov 5, 2010 at 9:03 PM, Shavit Netzer <Sh...@conduit.com> wrote:
> Hi,
>
> I have hadoop cluster with 24 nodes.
>
> Each node have 4 mount disks mnt - mnt3.

Just to confirm -- You've configured all DataNodes to utilize ALL
these mount points via the dfs.data.dir property, yes?

-- 
Harsh J
www.harshj.com