You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by runtao cao <ca...@gmail.com> on 2010/11/05 09:14:27 UTC
Compiling Hadoop Problem
Hi,
I'm a student. I'm reading the source code of Hadoop Common recently. I
find a problem when I load the source code of Common into Eclipse. In the
Package Explorer of Eclipse, some packages are default packages, but others
are not default packages. So there are many faults in the default packages
and other packages. I want to know what is the problem with it. The problem
is discribed in the accessor. Thank you very much.
caoruntao
RE: Hadoop partitions Problem
Posted by Shavit Netzer <Sh...@conduit.com>.
Thanks for your help.
Regards,
Shavit
-----Original Message-----
From: Allen Wittenauer [mailto:awittenauer@linkedin.com]
Sent: Friday, November 05, 2010 10:37 PM
To: <co...@hadoop.apache.org>
Subject: Re: Hadoop partitions Problem
On Nov 5, 2010, at 8:33 AM, Shavit Netzer wrote:
> Hi,
>
> I have hadoop cluster with 24 nodes.
>
> Each node have 4 mount disks mnt - mnt3.
>
> I'm getting alerts on mnt and the capacity is 99% full on it.
>
> I have free space on other partitions mnt1-mnt3.
>
> I used the balancer, but I still get alerts on disk size.
>
> Any Ida what to do?
http://wiki.apache.org/hadoop/FAQ#On_an_individual_data_node.2C_how_do_you_balance_the_blocks_on_the_disk.3F
Re: Hadoop partitions Problem
Posted by Allen Wittenauer <aw...@linkedin.com>.
On Nov 5, 2010, at 8:33 AM, Shavit Netzer wrote:
> Hi,
>
> I have hadoop cluster with 24 nodes.
>
> Each node have 4 mount disks mnt - mnt3.
>
> I'm getting alerts on mnt and the capacity is 99% full on it.
>
> I have free space on other partitions mnt1-mnt3.
>
> I used the balancer, but I still get alerts on disk size.
>
> Any Ida what to do?
http://wiki.apache.org/hadoop/FAQ#On_an_individual_data_node.2C_how_do_you_balance_the_blocks_on_the_disk.3F
Re: Hadoop partitions Problem
Posted by Shavit Netzer <Sh...@conduit.com>.
Yes
Sent from my mobile
On 05/11/2010, at 19:09, "Harsh J" <qw...@gmail.com> wrote:
> Hi,
>
> On Fri, Nov 5, 2010 at 9:03 PM, Shavit Netzer <Sh...@conduit.com>
> wrote:
>> Hi,
>>
>> I have hadoop cluster with 24 nodes.
>>
>> Each node have 4 mount disks mnt - mnt3.
>
> Just to confirm -- You've configured all DataNodes to utilize ALL
> these mount points via the dfs.data.dir property, yes?
>
>
>
> --
> Harsh J
> www.harshj.com
Re: Hadoop partitions Problem
Posted by Harsh J <qw...@gmail.com>.
Hi,
On Fri, Nov 5, 2010 at 9:03 PM, Shavit Netzer <Sh...@conduit.com> wrote:
> Hi,
>
> I have hadoop cluster with 24 nodes.
>
> Each node have 4 mount disks mnt - mnt3.
Just to confirm -- You've configured all DataNodes to utilize ALL
these mount points via the dfs.data.dir property, yes?
--
Harsh J
www.harshj.com
Hadoop partitions Problem
Posted by Shavit Netzer <Sh...@conduit.com>.
Hi,
I have hadoop cluster with 24 nodes.
Each node have 4 mount disks mnt - mnt3.
I'm getting alerts on mnt and the capacity is 99% full on it.
I have free space on other partitions mnt1-mnt3.
I used the balancer, but I still get alerts on disk size.
Any Ida what to do?
Sent from my mobile
Re: Compiling Hadoop Problem
Posted by bharath v <bh...@gmail.com>.
Do an "ant eclipse-files" in the hadoop home dir and then browse the
project using the eclipse "Import existing project" wizard ..If you
load it directly as a folder it doesn't work ..
Thanks
Bharath.V
4th year undergraduate,
IIIT Hyderabad
On Fri, Nov 5, 2010 at 1:44 PM, runtao cao <ca...@gmail.com> wrote:
> Hi,
> I'm a student. I'm reading the source code of Hadoop Common recently. I
> find a problem when I load the source code of Common into Eclipse. In the
> Package Explorer of Eclipse, some packages are default packages, but others
> are not default packages. So there are many faults in the default packages
> and other packages. I want to know what is the problem with it. The problem
> is discribed in the accessor. Thank you very much.
>
> caoruntao
Re: Compiling Hadoop Problem
Posted by Harsh J <qw...@gmail.com>.
Hi,
On Fri, Nov 5, 2010 at 1:44 PM, runtao cao <ca...@gmail.com> wrote:
> Hi,
> I'm a student. I'm reading the source code of Hadoop Common recently. I
> find a problem when I load the source code of Common into Eclipse. In the
> Package Explorer of Eclipse, some packages are default packages, but others
> are not default packages. So there are many faults in the default packages
> and other packages. I want to know what is the problem with it. The problem
> is discribed in the accessor. Thank you very much.
>
> caoruntao
Did you load it into eclipse after an 'ant eclipse-files' build? I
have hadoop-common loaded up in my Eclipse with no package issues at
all.
--
Harsh J
www.harshj.com