You are viewing a plain text version of this content. The canonical link for it is here.
Posted to general@hadoop.apache.org by "Gray, Adam" <ad...@amazon.com> on 2010/11/17 00:57:57 UTC
Announcing HPC Instances on Amazon Elastic MapReduce
We are excited to announce that Amazon Elastic MapReduce<http://www.amazon.com/gp/r.html?R=3Q89S9WPYQKE1&C=34S4XKTAXGMJV&H=NXKY2U8PLMAUGM8QAAA9WMJ1E7WA&T=TC&U=http%3A%2F%2Faws.amazon.com%2Felasticmapreduce%2F%3Fref_%3Dpe_2170_17587710> can now take advantage of Cluster Compute (cc1) and Cluster GPU (cg1) instances, giving you the ability to combine Hadoop's massively parallelized architecture with high performance computing. You can focus on developing HPC applications and Elastic MapReduce will handle workload parallelization, node configuration and scaling, and cluster management. Further, Elastic MapReduce applications that are I/O intensive have the opportunity to realize performance improvement by leveraging the low latency, full bisection bandwidth 10 Gbps Ethernet network between the instances in the cluster.
Cluster Compute Quadruple Extra Large (cc1.4xlarge) instances have the following configuration:
* A pair of quad-core Intel "Nehalem"<http://www.amazon.com/gp/r.html?R=3Q89S9WPYQKE1&C=34S4XKTAXGMJV&H=BUV0FAACQNE2OOH6G3SD1W0HEWIA&T=TC&U=http%3A%2F%2Fen.wikipedia.org%2Fwiki%2FNehalem_%2528microarchitecture%2529> X5570<http://www.amazon.com/gp/r.html?R=3Q89S9WPYQKE1&C=34S4XKTAXGMJV&H=TWETWZNHVDXWNSPJBPKNZJL4CYSA&T=TC&U=http%3A%2F%2Fark.intel.com%2FProduct.aspx%3Fid%3D37111> processors with a total of 33.5 ECU (EC2 Compute Units)
* 23 GB of RAM
* 1690 GB of local instance storage
* 10 Gbps networking with network locality between nodes
Cluster GPU Quadruple Extra Large (cg1.4xlarge) instances add a pair of NVIDIA Tesla® M2050 GPUs<http://www.amazon.com/gp/r.html?R=3Q89S9WPYQKE1&C=34S4XKTAXGMJV&H=1IXZ4VXWKOW2MIUZVEEFGXWGGTGA&T=TC&U=http%3A%2F%2Fwww.nvidia.com%2Fobject%2Fproduct_tesla_M2050_M2070_us.html> and when launched with Elastic MapReduce have the NVIDIA GPU driver and CUDA<http://www.amazon.com/gp/r.html?R=3Q89S9WPYQKE1&C=34S4XKTAXGMJV&H=JELGRTSTGCVAOGTHZEPWVJOYMSUA&T=TC&U=http%3A%2F%2Fwww.nvidia.com%2Fobject%2Fwhat_is_cuda_new.html> runtime installed.
Please refer to the High Performance Computing<http://www.amazon.com/gp/r.html?R=3Q89S9WPYQKE1&C=34S4XKTAXGMJV&H=3Q8IO9AMW2GTY8BTZBPTAXHVAXSA&T=TC&U=http%3A%2F%2Faws.amazon.com%2Fhpc-applications%2F%3Fref_%3Dpe_2170_17587710> AWS Solutions page for more details on how HPC instances can be leveraged.
Sincerely,
The Amazon Elastic MapReduce Team
Amazon Web Services LLC is a subsidiary of Amazon.com, Inc. Amazon.com is a registered trademark of Amazon.com, Inc. This message produced and distributed by Amazon Web Services, LLC, 1200 12th Ave South, Seattle, WA 98144.
[http://www.amazon.com/gp/r.html?R=3Q89S9WPYQKE1&C=34S4XKTAXGMJV&H=GPVBDDQBYZABZXXWS2LBMBHA2FSA&T=TE&U=http%3A%2F%2Fimages.amazon.com%2Fimages%2FG%2F01%2Fnav%2Ftransp.gif]
Fwd: Announcing HPC Instances on Amazon Elastic MapReduce
Posted by "Edward J. Yoon" <ed...@apache.org>.
---------- Forwarded message ----------
From: Gray, Adam <ad...@amazon.com>
Date: Wed, Nov 17, 2010 at 8:57 AM
Subject: Announcing HPC Instances on Amazon Elastic MapReduce
To: "nosql-discussion@googlegroups.com"
<no...@googlegroups.com>, "general@hadoop.apache.org"
<ge...@hadoop.apache.org>, "common-user@hadoop.apache.org"
<co...@hadoop.apache.org>, "mapreduce-user@hadoop.apache.org"
<ma...@hadoop.apache.org>, "hdfs-user@hadoop.apache.org"
<hd...@hadoop.apache.org>
We are excited to announce that Amazon Elastic
MapReduce<http://www.amazon.com/gp/r.html?R=3Q89S9WPYQKE1&C=34S4XKTAXGMJV&H=NXKY2U8PLMAUGM8QAAA9WMJ1E7WA&T=TC&U=http%3A%2F%2Faws.amazon.com%2Felasticmapreduce%2F%3Fref_%3Dpe_2170_17587710>
can now take advantage of Cluster Compute (cc1) and Cluster GPU (cg1)
instances, giving you the ability to combine Hadoop's massively
parallelized architecture with high performance computing. You can
focus on developing HPC applications and Elastic MapReduce will handle
workload parallelization, node configuration and scaling, and cluster
management. Further, Elastic MapReduce applications that are I/O
intensive have the opportunity to realize performance improvement by
leveraging the low latency, full bisection bandwidth 10 Gbps Ethernet
network between the instances in the cluster.
Cluster Compute Quadruple Extra Large (cc1.4xlarge) instances have the
following configuration:
* A pair of quad-core Intel
"Nehalem"<http://www.amazon.com/gp/r.html?R=3Q89S9WPYQKE1&C=34S4XKTAXGMJV&H=BUV0FAACQNE2OOH6G3SD1W0HEWIA&T=TC&U=http%3A%2F%2Fen.wikipedia.org%2Fwiki%2FNehalem_%2528microarchitecture%2529>
X5570<http://www.amazon.com/gp/r.html?R=3Q89S9WPYQKE1&C=34S4XKTAXGMJV&H=TWETWZNHVDXWNSPJBPKNZJL4CYSA&T=TC&U=http%3A%2F%2Fark.intel.com%2FProduct.aspx%3Fid%3D37111>
processors with a total of 33.5 ECU (EC2 Compute Units)
* 23 GB of RAM
* 1690 GB of local instance storage
* 10 Gbps networking with network locality between nodes
Cluster GPU Quadruple Extra Large (cg1.4xlarge) instances add a pair
of NVIDIA Tesla® M2050
GPUs<http://www.amazon.com/gp/r.html?R=3Q89S9WPYQKE1&C=34S4XKTAXGMJV&H=1IXZ4VXWKOW2MIUZVEEFGXWGGTGA&T=TC&U=http%3A%2F%2Fwww.nvidia.com%2Fobject%2Fproduct_tesla_M2050_M2070_us.html>
and when launched with Elastic MapReduce have the NVIDIA GPU driver
and CUDA<http://www.amazon.com/gp/r.html?R=3Q89S9WPYQKE1&C=34S4XKTAXGMJV&H=JELGRTSTGCVAOGTHZEPWVJOYMSUA&T=TC&U=http%3A%2F%2Fwww.nvidia.com%2Fobject%2Fwhat_is_cuda_new.html>
runtime installed.
Please refer to the High Performance
Computing<http://www.amazon.com/gp/r.html?R=3Q89S9WPYQKE1&C=34S4XKTAXGMJV&H=3Q8IO9AMW2GTY8BTZBPTAXHVAXSA&T=TC&U=http%3A%2F%2Faws.amazon.com%2Fhpc-applications%2F%3Fref_%3Dpe_2170_17587710>
AWS Solutions page for more details on how HPC instances can be
leveraged.
Sincerely,
The Amazon Elastic MapReduce Team
Amazon Web Services LLC is a subsidiary of Amazon.com, Inc. Amazon.com
is a registered trademark of Amazon.com, Inc. This message produced
and distributed by Amazon Web Services, LLC, 1200 12th Ave South,
Seattle, WA 98144.
[http://www.amazon.com/gp/r.html?R=3Q89S9WPYQKE1&C=34S4XKTAXGMJV&H=GPVBDDQBYZABZXXWS2LBMBHA2FSA&T=TE&U=http%3A%2F%2Fimages.amazon.com%2Fimages%2FG%2F01%2Fnav%2Ftransp.gif]
--
Best Regards, Edward J. Yoon
edwardyoon@apache.org
http://blog.udanax.org