You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by Rita <rm...@gmail.com> on 2011/03/09 13:24:26 UTC
datanode memory requirement
All of my data nodes have 16GB of memory. Would increasing my Java virtual
memory help in performance?
--
--- Get your facts first, then you can distort them as you please.--
Re: datanode memory requirement
Posted by elton sky <el...@gmail.com>.
I don't think data node needs much memory, as Stu suggested. There will be
requirement for memory when running a map reduce job. In that case, more
memory is better for in memory sorting (on map) and in-memory copy (on
reduce).
Namenode needs memory to hold meta data though.
On Thu, Mar 10, 2011 at 11:32 AM, Rita <rm...@gmail.com> wrote:
> No, just a datanode. Nothing else.
>
>
>
> On Wed, Mar 9, 2011 at 11:30 AM, <st...@yahoo.com> wrote:
>
>> Is anything else running on the datanodes? Datanodes themselves don't need
>> too much memory.
>>
>> Take care,
>> -stu
>> ------------------------------
>> *From: * Rita <rm...@gmail.com>
>> *Date: *Wed, 9 Mar 2011 07:24:26 -0500
>> *To: *<hd...@hadoop.apache.org>
>> *ReplyTo: * hdfs-user@hadoop.apache.org
>> *Subject: *datanode memory requirement
>>
>> All of my data nodes have 16GB of memory. Would increasing my Java virtual
>> memory help in performance?
>>
>> --
>> --- Get your facts first, then you can distort them as you please.--
>>
>
>
>
> --
> --- Get your facts first, then you can distort them as you please.--
>
Re: datanode memory requirement
Posted by Rita <rm...@gmail.com>.
No, just a datanode. Nothing else.
On Wed, Mar 9, 2011 at 11:30 AM, <st...@yahoo.com> wrote:
> Is anything else running on the datanodes? Datanodes themselves don't need
> too much memory.
>
> Take care,
> -stu
> ------------------------------
> *From: * Rita <rm...@gmail.com>
> *Date: *Wed, 9 Mar 2011 07:24:26 -0500
> *To: *<hd...@hadoop.apache.org>
> *ReplyTo: * hdfs-user@hadoop.apache.org
> *Subject: *datanode memory requirement
>
> All of my data nodes have 16GB of memory. Would increasing my Java virtual
> memory help in performance?
>
> --
> --- Get your facts first, then you can distort them as you please.--
>
--
--- Get your facts first, then you can distort them as you please.--
Re: datanode memory requirement
Posted by st...@yahoo.com.
Is anything else running on the datanodes? Datanodes themselves don't need too much memory.
Take care,
-stu
-----Original Message-----
From: Rita <rm...@gmail.com>
Date: Wed, 9 Mar 2011 07:24:26
To: <hd...@hadoop.apache.org>
Reply-To: hdfs-user@hadoop.apache.org
Subject: datanode memory requirement
All of my data nodes have 16GB of memory. Would increasing my Java virtual
memory help in performance?
--
--- Get your facts first, then you can distort them as you please.--