You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Trev Smith <tr...@gmail.com> on 2013/10/26 12:25:00 UTC

Best practice for EC2 deployment

Hi all,

Could anyone direct me to a resource (or perhaps give me their own
thoughts) on best practice for deploying a robust, resilient Hadoop
(specifically CDH in this case) cluster to AWS? The data is important to us
and we expect to store it for a long time. We want to make sure we are not
impacted by outages in single availability zones and we want to implement a
sensible backup/disaster recovery plan.

We are using HBase in addition to HDFS but not Hive, at present.

Your thoughts much appreciated.

Regards,
Trevor Smith

Re: Best practice for EC2 deployment

Posted by Juan Suero <ju...@gmail.com>.
Everything fails
On Saturday, October 26, 2013, Trev Smith wrote:

> Hi all,
>
> Could anyone direct me to a resource (or perhaps give me their own
> thoughts) on best practice for deploying a robust, resilient Hadoop
> (specifically CDH in this case) cluster to AWS? The data is important to us
> and we expect to store it for a long time. We want to make sure we are not
> impacted by outages in single availability zones and we want to implement a
> sensible backup/disaster recovery plan.
>
> We are using HBase in addition to HDFS but not Hive, at present.
>
> Your thoughts much appreciated.
>
> Regards,
> Trevor Smith
>

Re: Best practice for EC2 deployment

Posted by Ted Yu <yu...@gmail.com>.
Recycling bits:
http://search-hadoop.com/m/owi9fgKzRE/Cluster+set-up+quick&subj=Re+cluster+set+up+a+few+quick+questions

Cheers

On Oct 26, 2013, at 3:25 AM, Trev Smith <tr...@gmail.com> wrote:

> Hi all,
> 
> Could anyone direct me to a resource (or perhaps give me their own thoughts) on best practice for deploying a robust, resilient Hadoop (specifically CDH in this case) cluster to AWS? The data is important to us and we expect to store it for a long time. We want to make sure we are not impacted by outages in single availability zones and we want to implement a sensible backup/disaster recovery plan.
> 
> We are using HBase in addition to HDFS but not Hive, at present.
> 
> Your thoughts much appreciated.
> 
> Regards,
> Trevor Smith

Re: Best practice for EC2 deployment

Posted by Juan Suero <ju...@gmail.com>.
Everything fails
On Saturday, October 26, 2013, Trev Smith wrote:

> Hi all,
>
> Could anyone direct me to a resource (or perhaps give me their own
> thoughts) on best practice for deploying a robust, resilient Hadoop
> (specifically CDH in this case) cluster to AWS? The data is important to us
> and we expect to store it for a long time. We want to make sure we are not
> impacted by outages in single availability zones and we want to implement a
> sensible backup/disaster recovery plan.
>
> We are using HBase in addition to HDFS but not Hive, at present.
>
> Your thoughts much appreciated.
>
> Regards,
> Trevor Smith
>

Re: Best practice for EC2 deployment

Posted by Ted Yu <yu...@gmail.com>.
Recycling bits:
http://search-hadoop.com/m/owi9fgKzRE/Cluster+set-up+quick&subj=Re+cluster+set+up+a+few+quick+questions

Cheers

On Oct 26, 2013, at 3:25 AM, Trev Smith <tr...@gmail.com> wrote:

> Hi all,
> 
> Could anyone direct me to a resource (or perhaps give me their own thoughts) on best practice for deploying a robust, resilient Hadoop (specifically CDH in this case) cluster to AWS? The data is important to us and we expect to store it for a long time. We want to make sure we are not impacted by outages in single availability zones and we want to implement a sensible backup/disaster recovery plan.
> 
> We are using HBase in addition to HDFS but not Hive, at present.
> 
> Your thoughts much appreciated.
> 
> Regards,
> Trevor Smith

Re: Best practice for EC2 deployment

Posted by Ted Yu <yu...@gmail.com>.
Recycling bits:
http://search-hadoop.com/m/owi9fgKzRE/Cluster+set-up+quick&subj=Re+cluster+set+up+a+few+quick+questions

Cheers

On Oct 26, 2013, at 3:25 AM, Trev Smith <tr...@gmail.com> wrote:

> Hi all,
> 
> Could anyone direct me to a resource (or perhaps give me their own thoughts) on best practice for deploying a robust, resilient Hadoop (specifically CDH in this case) cluster to AWS? The data is important to us and we expect to store it for a long time. We want to make sure we are not impacted by outages in single availability zones and we want to implement a sensible backup/disaster recovery plan.
> 
> We are using HBase in addition to HDFS but not Hive, at present.
> 
> Your thoughts much appreciated.
> 
> Regards,
> Trevor Smith

Re: Best practice for EC2 deployment

Posted by Juan Suero <ju...@gmail.com>.
Everything fails
On Saturday, October 26, 2013, Trev Smith wrote:

> Hi all,
>
> Could anyone direct me to a resource (or perhaps give me their own
> thoughts) on best practice for deploying a robust, resilient Hadoop
> (specifically CDH in this case) cluster to AWS? The data is important to us
> and we expect to store it for a long time. We want to make sure we are not
> impacted by outages in single availability zones and we want to implement a
> sensible backup/disaster recovery plan.
>
> We are using HBase in addition to HDFS but not Hive, at present.
>
> Your thoughts much appreciated.
>
> Regards,
> Trevor Smith
>

Re: Best practice for EC2 deployment

Posted by Juan Suero <ju...@gmail.com>.
Everything fails
On Saturday, October 26, 2013, Trev Smith wrote:

> Hi all,
>
> Could anyone direct me to a resource (or perhaps give me their own
> thoughts) on best practice for deploying a robust, resilient Hadoop
> (specifically CDH in this case) cluster to AWS? The data is important to us
> and we expect to store it for a long time. We want to make sure we are not
> impacted by outages in single availability zones and we want to implement a
> sensible backup/disaster recovery plan.
>
> We are using HBase in addition to HDFS but not Hive, at present.
>
> Your thoughts much appreciated.
>
> Regards,
> Trevor Smith
>

Re: Best practice for EC2 deployment

Posted by Ted Yu <yu...@gmail.com>.
Recycling bits:
http://search-hadoop.com/m/owi9fgKzRE/Cluster+set-up+quick&subj=Re+cluster+set+up+a+few+quick+questions

Cheers

On Oct 26, 2013, at 3:25 AM, Trev Smith <tr...@gmail.com> wrote:

> Hi all,
> 
> Could anyone direct me to a resource (or perhaps give me their own thoughts) on best practice for deploying a robust, resilient Hadoop (specifically CDH in this case) cluster to AWS? The data is important to us and we expect to store it for a long time. We want to make sure we are not impacted by outages in single availability zones and we want to implement a sensible backup/disaster recovery plan.
> 
> We are using HBase in addition to HDFS but not Hive, at present.
> 
> Your thoughts much appreciated.
> 
> Regards,
> Trevor Smith