You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Sandesh Karkera (JIRA)" <ji...@apache.org> on 2016/11/22 09:49:58 UTC

[jira] [Updated] (KAFKA-4432) ProducerPerformance.java : Add support to supply custom message payloads.

     [ https://issues.apache.org/jira/browse/KAFKA-4432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sandesh Karkera updated KAFKA-4432:
-----------------------------------
    Description: 
Currently, kafka-producer-perf-test.sh does not support supplying custom payloads to read messages from. The payload generated is a static payload which is not very useful when testing features like compression. 

We can improve the ProducerPerformance.java to accept a "-payload-file" and "-payload-delimiter"(optional) parameters instead of "-record-size". This will enable to user to run performance tests using custom payloads. 

Before every send, we'll pick up a random payload from the payload-file provided. 

-payload-file: Will consists of messages delimited by "-payload-delimiter". 
-payload-delimiter: Takes a default value of "\n" if not specified.

  was:
Currently, kafka-producer-perf-test.sh does not support supplying custom payloads to read messages from. The payload generated is a static payload which is not very useful when testing features like compression. 

We can improve the ProducerPerformance.java to accept a "-payload-file" and "-payload-delimiter"(optional) parameters instead of "-record-size". This will enable to user to run performance tests using custom payloads. 

Before every send, we'll pick up a random payload from the payload-file provided. 

-payload-file: Will consists of messages delimited by "--payload-delimiter". 
-payload-delimiter: Takes a default value of "\n" if not specified.


> ProducerPerformance.java : Add support to supply custom message payloads.
> -------------------------------------------------------------------------
>
>                 Key: KAFKA-4432
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4432
>             Project: Kafka
>          Issue Type: Improvement
>            Reporter: Sandesh Karkera
>            Priority: Minor
>             Fix For: 0.10.0.2
>
>
> Currently, kafka-producer-perf-test.sh does not support supplying custom payloads to read messages from. The payload generated is a static payload which is not very useful when testing features like compression. 
> We can improve the ProducerPerformance.java to accept a "-payload-file" and "-payload-delimiter"(optional) parameters instead of "-record-size". This will enable to user to run performance tests using custom payloads. 
> Before every send, we'll pick up a random payload from the payload-file provided. 
> -payload-file: Will consists of messages delimited by "-payload-delimiter". 
> -payload-delimiter: Takes a default value of "\n" if not specified.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)