[jira] [Comment Edited] (KAFKA-4971) Why is there no difference between kafka benchmark tests on SSD and HDD?

["Michal Borowiecki (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15953608#comment-15953608 ] 

Michal Borowiecki edited comment on KAFKA-4971 at 4/3/17 2:54 PM:
------------------------------------------------------------------

I think your question would be easier to respond to if you quantified it by providing your test results and the drive specs.
Kafka IO access patterns are designed to be sequential for good reason. Spinning disks and OS level buffering are optimised for such IO patterns, but I don't know if that alone can account for the miss-match between your expectations and the results you are getting on your hardware.


was (Author: mihbor):
I think your question would be easier to respond to if you quantified it by providing your test results and the drive specs.
Kafka IO access patterns are designed to be sequential for good reason. Spinning disks and OS level buffering are optimised for such IO patterns, but I don't know if that alone can account for the miss-match between your expectations and the results your getting on your hardware.

> Why is there no difference between kafka benchmark tests on SSD and HDD? 
> -------------------------------------------------------------------------
>
>                 Key: KAFKA-4971
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4971
>             Project: Kafka
>          Issue Type: Test
>    Affects Versions: 0.10.0.0
>         Environment: Oracle VM VirtualBox
> OS : CentOs 7
> Memory : 1G
> Disk : 8GB
>            Reporter: Dasol Kim
>
> I installed OS and kafka in the two SSD and two HDDs  to perform the kafka benchmark test based on the disc difference. As expected, the SSD should show faster results, but according to my experimental results, there is no big difference between SSD and HDD. why? Ohter settings have been set to default.
> *test settings
> zookeeper node  : 1, producer node : 2, broker node : 2(SSD 1, HDD 1)
> test scenario : Two producers send messages to the broker and compare the throughtput per second of kafka installed on SSD and kafka on HDD
> command : ./bin/kafka-producer-perf-test.sh --num-records 1000000 --record-size 2000 --topic test --throughput 100000 --producer-props bootstrap.servers=SN02:9092
>  



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)