You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Artem Ervits <ar...@nyp.org> on 2013/01/31 17:53:06 UTC
Dell Hardware
Hello all,
Does anyone run Hadoop on Dell R720 model of servers? Dell site lists C2100 model of servers as best fit for Hadoop workloads. What does community recommend?
Artem Ervits
New York Presbyterian Hospital
--------------------
This electronic message is intended to be for the use only of the named recipient, and may contain information that is confidential or privileged. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of the contents of this message is strictly prohibited. If you have received this message in error or are not the named recipient, please notify us immediately by contacting the sender at the electronic mail address noted above, and delete and destroy all copies of this message. Thank you.
--------------------
This electronic message is intended to be for the use only of the named recipient, and may contain information that is confidential or privileged. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of the contents of this message is strictly prohibited. If you have received this message in error or are not the named recipient, please notify us immediately by contacting the sender at the electronic mail address noted above, and delete and destroy all copies of this message. Thank you.
Re: Dell Hardware
Posted by Ted Dunning <td...@maprtech.com>.
We have tested both machines in our labs at MapR and both work well. Both
run pretty hot so you need to keep a good eye on that.
The R720 will have higher wattage per unit of storage due to the smaller
number of drives per chassis. That may be a good match for ordinary Hadoop
due to the lower I/O efficiency, but with higher performance distributions
like MapR, you will probably do better on combined acquisition, ops and
power costs per terabyte with the C2100 series.
As you do your selection, you need to determine what your primary
constraint will be. Will it be storage size? I/O rates? Compute load?
Once you have that figured out, the hardware selection should fall out
directly from a TCO analysis that looks at the different scenarios.
On Thu, Jan 31, 2013 at 11:13 AM, Andy Isaacson <ad...@cloudera.com> wrote:
> On Thu, Jan 31, 2013 at 8:53 AM, Artem Ervits <ar...@nyp.org> wrote:
> > Does anyone run Hadoop on Dell R720 model of servers? Dell site lists
> C2100
> > model of servers as best fit for Hadoop workloads. What does community
> > recommend?
>
> The R720 supports up to 2 xeon CPUs and 8 drives in 2U. If configured
> appropriately it will work fine as a Hadoop node. For example, 2x
> Xeon, 64GB RAM, 8x 2TB SATA configured as JBOD, would be a reasonable
> worker node. Buy 20 of those and now you're cooking with gas. :)
>
> The C2100 is probably somewhat cheaper for a given storage amount
> since it fits 12 disks in a 2U chassis (so you don't need to buy as
> many machines to achieve a given amount of capacity). Dell doesn't
> provide a configurator for that model so I can't compare prices.
> Apparently it's using the previous generation of Xeon -- 5500/5600
> versus e5 on the R720 -- which probably means poorer throughput per
> watt.
>
> The right answer will depend on your application and workload.
>
> -andy
>
Re: Dell Hardware
Posted by Ted Dunning <td...@maprtech.com>.
We have tested both machines in our labs at MapR and both work well. Both
run pretty hot so you need to keep a good eye on that.
The R720 will have higher wattage per unit of storage due to the smaller
number of drives per chassis. That may be a good match for ordinary Hadoop
due to the lower I/O efficiency, but with higher performance distributions
like MapR, you will probably do better on combined acquisition, ops and
power costs per terabyte with the C2100 series.
As you do your selection, you need to determine what your primary
constraint will be. Will it be storage size? I/O rates? Compute load?
Once you have that figured out, the hardware selection should fall out
directly from a TCO analysis that looks at the different scenarios.
On Thu, Jan 31, 2013 at 11:13 AM, Andy Isaacson <ad...@cloudera.com> wrote:
> On Thu, Jan 31, 2013 at 8:53 AM, Artem Ervits <ar...@nyp.org> wrote:
> > Does anyone run Hadoop on Dell R720 model of servers? Dell site lists
> C2100
> > model of servers as best fit for Hadoop workloads. What does community
> > recommend?
>
> The R720 supports up to 2 xeon CPUs and 8 drives in 2U. If configured
> appropriately it will work fine as a Hadoop node. For example, 2x
> Xeon, 64GB RAM, 8x 2TB SATA configured as JBOD, would be a reasonable
> worker node. Buy 20 of those and now you're cooking with gas. :)
>
> The C2100 is probably somewhat cheaper for a given storage amount
> since it fits 12 disks in a 2U chassis (so you don't need to buy as
> many machines to achieve a given amount of capacity). Dell doesn't
> provide a configurator for that model so I can't compare prices.
> Apparently it's using the previous generation of Xeon -- 5500/5600
> versus e5 on the R720 -- which probably means poorer throughput per
> watt.
>
> The right answer will depend on your application and workload.
>
> -andy
>
Re: Dell Hardware
Posted by Ted Dunning <td...@maprtech.com>.
We have tested both machines in our labs at MapR and both work well. Both
run pretty hot so you need to keep a good eye on that.
The R720 will have higher wattage per unit of storage due to the smaller
number of drives per chassis. That may be a good match for ordinary Hadoop
due to the lower I/O efficiency, but with higher performance distributions
like MapR, you will probably do better on combined acquisition, ops and
power costs per terabyte with the C2100 series.
As you do your selection, you need to determine what your primary
constraint will be. Will it be storage size? I/O rates? Compute load?
Once you have that figured out, the hardware selection should fall out
directly from a TCO analysis that looks at the different scenarios.
On Thu, Jan 31, 2013 at 11:13 AM, Andy Isaacson <ad...@cloudera.com> wrote:
> On Thu, Jan 31, 2013 at 8:53 AM, Artem Ervits <ar...@nyp.org> wrote:
> > Does anyone run Hadoop on Dell R720 model of servers? Dell site lists
> C2100
> > model of servers as best fit for Hadoop workloads. What does community
> > recommend?
>
> The R720 supports up to 2 xeon CPUs and 8 drives in 2U. If configured
> appropriately it will work fine as a Hadoop node. For example, 2x
> Xeon, 64GB RAM, 8x 2TB SATA configured as JBOD, would be a reasonable
> worker node. Buy 20 of those and now you're cooking with gas. :)
>
> The C2100 is probably somewhat cheaper for a given storage amount
> since it fits 12 disks in a 2U chassis (so you don't need to buy as
> many machines to achieve a given amount of capacity). Dell doesn't
> provide a configurator for that model so I can't compare prices.
> Apparently it's using the previous generation of Xeon -- 5500/5600
> versus e5 on the R720 -- which probably means poorer throughput per
> watt.
>
> The right answer will depend on your application and workload.
>
> -andy
>
Re: Dell Hardware
Posted by Ted Dunning <td...@maprtech.com>.
We have tested both machines in our labs at MapR and both work well. Both
run pretty hot so you need to keep a good eye on that.
The R720 will have higher wattage per unit of storage due to the smaller
number of drives per chassis. That may be a good match for ordinary Hadoop
due to the lower I/O efficiency, but with higher performance distributions
like MapR, you will probably do better on combined acquisition, ops and
power costs per terabyte with the C2100 series.
As you do your selection, you need to determine what your primary
constraint will be. Will it be storage size? I/O rates? Compute load?
Once you have that figured out, the hardware selection should fall out
directly from a TCO analysis that looks at the different scenarios.
On Thu, Jan 31, 2013 at 11:13 AM, Andy Isaacson <ad...@cloudera.com> wrote:
> On Thu, Jan 31, 2013 at 8:53 AM, Artem Ervits <ar...@nyp.org> wrote:
> > Does anyone run Hadoop on Dell R720 model of servers? Dell site lists
> C2100
> > model of servers as best fit for Hadoop workloads. What does community
> > recommend?
>
> The R720 supports up to 2 xeon CPUs and 8 drives in 2U. If configured
> appropriately it will work fine as a Hadoop node. For example, 2x
> Xeon, 64GB RAM, 8x 2TB SATA configured as JBOD, would be a reasonable
> worker node. Buy 20 of those and now you're cooking with gas. :)
>
> The C2100 is probably somewhat cheaper for a given storage amount
> since it fits 12 disks in a 2U chassis (so you don't need to buy as
> many machines to achieve a given amount of capacity). Dell doesn't
> provide a configurator for that model so I can't compare prices.
> Apparently it's using the previous generation of Xeon -- 5500/5600
> versus e5 on the R720 -- which probably means poorer throughput per
> watt.
>
> The right answer will depend on your application and workload.
>
> -andy
>
Re: Dell Hardware
Posted by Andy Isaacson <ad...@cloudera.com>.
On Thu, Jan 31, 2013 at 8:53 AM, Artem Ervits <ar...@nyp.org> wrote:
> Does anyone run Hadoop on Dell R720 model of servers? Dell site lists C2100
> model of servers as best fit for Hadoop workloads. What does community
> recommend?
The R720 supports up to 2 xeon CPUs and 8 drives in 2U. If configured
appropriately it will work fine as a Hadoop node. For example, 2x
Xeon, 64GB RAM, 8x 2TB SATA configured as JBOD, would be a reasonable
worker node. Buy 20 of those and now you're cooking with gas. :)
The C2100 is probably somewhat cheaper for a given storage amount
since it fits 12 disks in a 2U chassis (so you don't need to buy as
many machines to achieve a given amount of capacity). Dell doesn't
provide a configurator for that model so I can't compare prices.
Apparently it's using the previous generation of Xeon -- 5500/5600
versus e5 on the R720 -- which probably means poorer throughput per
watt.
The right answer will depend on your application and workload.
-andy
Re: Dell Hardware
Posted by Andy Isaacson <ad...@cloudera.com>.
On Thu, Jan 31, 2013 at 8:53 AM, Artem Ervits <ar...@nyp.org> wrote:
> Does anyone run Hadoop on Dell R720 model of servers? Dell site lists C2100
> model of servers as best fit for Hadoop workloads. What does community
> recommend?
The R720 supports up to 2 xeon CPUs and 8 drives in 2U. If configured
appropriately it will work fine as a Hadoop node. For example, 2x
Xeon, 64GB RAM, 8x 2TB SATA configured as JBOD, would be a reasonable
worker node. Buy 20 of those and now you're cooking with gas. :)
The C2100 is probably somewhat cheaper for a given storage amount
since it fits 12 disks in a 2U chassis (so you don't need to buy as
many machines to achieve a given amount of capacity). Dell doesn't
provide a configurator for that model so I can't compare prices.
Apparently it's using the previous generation of Xeon -- 5500/5600
versus e5 on the R720 -- which probably means poorer throughput per
watt.
The right answer will depend on your application and workload.
-andy
Re: Dell Hardware
Posted by Andy Isaacson <ad...@cloudera.com>.
On Thu, Jan 31, 2013 at 8:53 AM, Artem Ervits <ar...@nyp.org> wrote:
> Does anyone run Hadoop on Dell R720 model of servers? Dell site lists C2100
> model of servers as best fit for Hadoop workloads. What does community
> recommend?
The R720 supports up to 2 xeon CPUs and 8 drives in 2U. If configured
appropriately it will work fine as a Hadoop node. For example, 2x
Xeon, 64GB RAM, 8x 2TB SATA configured as JBOD, would be a reasonable
worker node. Buy 20 of those and now you're cooking with gas. :)
The C2100 is probably somewhat cheaper for a given storage amount
since it fits 12 disks in a 2U chassis (so you don't need to buy as
many machines to achieve a given amount of capacity). Dell doesn't
provide a configurator for that model so I can't compare prices.
Apparently it's using the previous generation of Xeon -- 5500/5600
versus e5 on the R720 -- which probably means poorer throughput per
watt.
The right answer will depend on your application and workload.
-andy
Re: Dell Hardware
Posted by Andy Isaacson <ad...@cloudera.com>.
On Thu, Jan 31, 2013 at 8:53 AM, Artem Ervits <ar...@nyp.org> wrote:
> Does anyone run Hadoop on Dell R720 model of servers? Dell site lists C2100
> model of servers as best fit for Hadoop workloads. What does community
> recommend?
The R720 supports up to 2 xeon CPUs and 8 drives in 2U. If configured
appropriately it will work fine as a Hadoop node. For example, 2x
Xeon, 64GB RAM, 8x 2TB SATA configured as JBOD, would be a reasonable
worker node. Buy 20 of those and now you're cooking with gas. :)
The C2100 is probably somewhat cheaper for a given storage amount
since it fits 12 disks in a 2U chassis (so you don't need to buy as
many machines to achieve a given amount of capacity). Dell doesn't
provide a configurator for that model so I can't compare prices.
Apparently it's using the previous generation of Xeon -- 5500/5600
versus e5 on the R720 -- which probably means poorer throughput per
watt.
The right answer will depend on your application and workload.
-andy