You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Kessiler Rodrigues <ke...@callinize.com> on 2016/07/28 22:19:01 UTC
SSD or not for Kafka brokers?
Hi guys,
Should I use SSD for my brokers or not?
What are the pros and cons?
Thank you!
Re: SSD or not for Kafka brokers?
Posted by Anderson Goulart <an...@boxever.com>.
Hi,
You might consider SSD specially for reads - if your consumers are the
bottleneck (as kafka usually sends sequential bulk messages from memory,
it won't add much value to writes). Latency can be also a factor to
move to SSD (as seek time can vary from 0.2 to 0.8ms on magnetic discs
compared to 0.1-0.2ms on SSD).
The overall throughput of messages/s was 10% better on SSD (in my tests).
-- Anderson
On 29/07/2016 15:37, Tauzell, Dave wrote:
> In addition for sequential writes, which is common with kafka, SSD isn't much faster than HDD.
>
> Dave Tauzell | Senior Software Engineer | Surescripts
> O: 651.855.3042 | www.surescripts.com | Dave.Tauzell@surescripts.com
> Connect with us: Twitter I LinkedIn I Facebook I YouTube
>
>
> -----Original Message-----
> From: Gerard Klijs [mailto:gerard.klijs@dizzit.com]
> Sent: Friday, July 29, 2016 9:33 AM
> To: users@kafka.apache.org
> Subject: Re: SSD or not for Kafka brokers?
>
> As I under stood it won't really has any advantage over using HDD since most things will work from the working memory anyway. You might want to use SSD for zookeeper through.
>
> On Fri, Jul 29, 2016 at 12:19 AM Kessiler Rodrigues <ke...@callinize.com>
> wrote:
>
>> Hi guys,
>>
>> Should I use SSD for my brokers or not?
>>
>> What are the pros and cons?
>>
>> Thank you!
>>
> This e-mail and any files transmitted with it are confidential, may contain sensitive information, and are intended solely for the use of the individual or entity to whom they are addressed. If you have received this e-mail in error, please notify the sender by reply e-mail immediately and destroy all copies of the e-mail and any attachments.
RE: SSD or not for Kafka brokers?
Posted by "Tauzell, Dave" <Da...@surescripts.com>.
In addition for sequential writes, which is common with kafka, SSD isn't much faster than HDD.
Dave Tauzell | Senior Software Engineer | Surescripts
O: 651.855.3042 | www.surescripts.com | Dave.Tauzell@surescripts.com
Connect with us: Twitter I LinkedIn I Facebook I YouTube
-----Original Message-----
From: Gerard Klijs [mailto:gerard.klijs@dizzit.com]
Sent: Friday, July 29, 2016 9:33 AM
To: users@kafka.apache.org
Subject: Re: SSD or not for Kafka brokers?
As I under stood it won't really has any advantage over using HDD since most things will work from the working memory anyway. You might want to use SSD for zookeeper through.
On Fri, Jul 29, 2016 at 12:19 AM Kessiler Rodrigues <ke...@callinize.com>
wrote:
> Hi guys,
>
> Should I use SSD for my brokers or not?
>
> What are the pros and cons?
>
> Thank you!
>
This e-mail and any files transmitted with it are confidential, may contain sensitive information, and are intended solely for the use of the individual or entity to whom they are addressed. If you have received this e-mail in error, please notify the sender by reply e-mail immediately and destroy all copies of the e-mail and any attachments.
Re: SSD or not for Kafka brokers?
Posted by Gerard Klijs <ge...@dizzit.com>.
As I under stood it won't really has any advantage over using HDD since
most things will work from the working memory anyway. You might want to use
SSD for zookeeper through.
On Fri, Jul 29, 2016 at 12:19 AM Kessiler Rodrigues <ke...@callinize.com>
wrote:
> Hi guys,
>
> Should I use SSD for my brokers or not?
>
> What are the pros and cons?
>
> Thank you!
>