You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by Felipe Santos <fe...@gmail.com> on 2016/08/09 17:03:52 UTC

Compression + Batch problem?

I was testing kafka 0.10 with and without compression, when I actived
compression I got a message that max bytes exceeded with same batch size.

the command was this

with compression
kafka-producer-perf-test --topic test-rep-one4 --num-records 100000
--record-size 35000 --throughput -1 --producer-props bootstrap.servers=****
security.protocol=SSL
ssl.truststore.location=/home/felipe.santos/client.truststore.jks
ssl.truststore.password=changeit
 ssl.keystore.location=/home/felipe.santos/client.keystore.jks
ssl.keystore.password=changeit ssl.key.password=changeit acks=1
batch.size=900000  max.request.size=200000000 compression.type=snappy



no compression
kafka-producer-perf-test --topic test-rep-one4 --num-records 100000
--record-size 35000 --throughput -1 --producer-props bootstrap.servers=****
security.protocol=SSL
ssl.truststore.location=/home/felipe.santos/client.truststore.jks
ssl.truststore.password=changeit
 ssl.keystore.location=/home/felipe.santos/client.keystore.jks
ssl.keystore.password=changeit ssl.key.password=changeit acks=1
batch.size=900000  max.request.size=200000000

 Why? To me when I actived compression the message should be smaller


 Thanks

-- 
Felipe Santos