You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by S Ahmed <sa...@gmail.com> on 2014/06/11 19:43:08 UTC
ec2 suggestion setup for a minimum kafka setup; zookeeper is bad in ec2?
For those of you hosting on ec2, could someone suggest a "minimum"
recommended setup for kafka? i.e. the # and type of instance size that you
would say is the bare minimum to get started with kafka in ec2.
My guess is the suggest route is the m3 instance type?
How about:
m3.medium 1 cpu, 3.75GB Ram 4 GB SSD
m3.large 2 cpus, 7.5 GB ram 32 GB SSD
My requirements are maybe a few hundred messages per second to start, but
want to grow my usage as my confidence/experience with kafka increases.
I was reading this post regarding kafka on ec2 (
http://engineering.onlive.com/2013/12/12/didnt-use-kafka/) and one of the
main cons the author says exists with kafka on ec2 is that zookeeper is a
little finicky when it comes to latency and may knock a host out b/c of
latency issues.
How do you guys on ec2 work around these issues?
Re: ec2 suggestion setup for a minimum kafka setup; zookeeper is bad in ec2?
Posted by "Michael G. Noll" <mi...@michael-noll.com>.
Take a look at Loggly.com's AWS setup for Kafka, e.g. as described on theor blog (very recently) as well as in their talk at AWS reInvent 2013.
--Michael
> On 11.06.2014, at 19:43, S Ahmed <sa...@gmail.com> wrote:
>
> For those of you hosting on ec2, could someone suggest a "minimum"
> recommended setup for kafka? i.e. the # and type of instance size that you
> would say is the bare minimum to get started with kafka in ec2.
>
> My guess is the suggest route is the m3 instance type?
> How about:
>
> m3.medium 1 cpu, 3.75GB Ram 4 GB SSD
> m3.large 2 cpus, 7.5 GB ram 32 GB SSD
>
>
> My requirements are maybe a few hundred messages per second to start, but
> want to grow my usage as my confidence/experience with kafka increases.
>
> I was reading this post regarding kafka on ec2 (
> http://engineering.onlive.com/2013/12/12/didnt-use-kafka/) and one of the
> main cons the author says exists with kafka on ec2 is that zookeeper is a
> little finicky when it comes to latency and may knock a host out b/c of
> latency issues.
>
> How do you guys on ec2 work around these issues?