Query for Hardware configuration

[Stuti Awasthi <st...@hcl.com>]

Hi,

I am setting up Hadoop and Hbase clusters for some applications. Data can range from TBs to PBs in production. I want to know what all hardware requirements I should look before finalizing machines.
Foe eg : Number of nodes, RAM, HDD, cache etc.
Are there any guidelines for huge cluster management for Hadoop and Hbase ?


Thanks



________________________________
::DISCLAIMER::
-----------------------------------------------------------------------------------------------------------------------

The contents of this e-mail and any attachment(s) are confidential and intended for the named recipient(s) only.
It shall not attach any liability on the originator or HCL or its affiliates. Any views or opinions presented in
this email are solely those of the author and may not necessarily reflect the opinions of HCL or its affiliates.
Any form of reproduction, dissemination, copying, disclosure, modification, distribution and / or publication of
this message without the prior written consent of the author of this e-mail is strictly prohibited. If you have
received this email in error please delete it and notify the sender immediately. Before opening any mail and
attachments please check them for viruses and defect.

-----------------------------------------------------------------------------------------------------------------------

Re: Query for Hardware configuration

[Joey Echeverria <jo...@cloudera.com>]

Hi Stuti,

There is a pretty good, though somewhat dated, post about picking
hardware on the Cloudera blog:

http://www.cloudera.com/blog/2010/03/clouderas-support-team-shares-some-basic-hardware-recommendations/

Things I would add to bring it more up to date:

1) More hard drives, a lot of organizations are using 8 or 12 drives these days.
2) If you go with 12 drives, you might want dual hexacore CPUs.

Like the post says, it's highly workload and data size dependent so
without more details, I can't give you a better recommendation.

-Joey

On Thu, Sep 15, 2011 at 6:30 AM, Stuti Awasthi <st...@hcl.com> wrote:
> Hi,
>
> I am setting up Hadoop and Hbase clusters for some applications. Data can range from TBs to PBs in production. I want to know what all hardware requirements I should look before finalizing machines.
> Foe eg : Number of nodes, RAM, HDD, cache etc.
> Are there any guidelines for huge cluster management for Hadoop and Hbase ?
>
>
> Thanks
>
>
>
> ________________________________
> ::DISCLAIMER::
> -----------------------------------------------------------------------------------------------------------------------
>
> The contents of this e-mail and any attachment(s) are confidential and intended for the named recipient(s) only.
> It shall not attach any liability on the originator or HCL or its affiliates. Any views or opinions presented in
> this email are solely those of the author and may not necessarily reflect the opinions of HCL or its affiliates.
> Any form of reproduction, dissemination, copying, disclosure, modification, distribution and / or publication of
> this message without the prior written consent of the author of this e-mail is strictly prohibited. If you have
> received this email in error please delete it and notify the sender immediately. Before opening any mail and
> attachments please check them for viruses and defect.
>
> -----------------------------------------------------------------------------------------------------------------------
>



-- 
Joseph Echeverria
Cloudera, Inc.
443.305.9434