You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2022/10/28 03:40:39 UTC

[GitHub] [pulsar-client-cpp] matejsaravanja opened a new issue, #83: Key-based batching and hashingScheme parameter for Python client

matejsaravanja opened a new issue, #83:
URL: https://github.com/apache/pulsar-client-cpp/issues/83

   **Short intro**
   We're running a platform that's effectively just a bunch of microservices written in Python, Java and Go which are communicating through Kafka. Currently we're considering moving from Kafka to Pulsar.
   However, one of the main features we need is key-based message routing for solving concurrency problems. Pulsar has that option with KeyShared subscription mode.
   
   **The problem**
   In Python, KeyShared subscription works only if producer disables batching. I ran some tests in my local environment and disabling batching results in high decrease of throughput (~25k/s with batching vs ~9k/s without).
   
   **Features that would've solved the problem**
   - Key-based batching for Python client
   - HashingScheme parameter when creating producer so all of our services (Java, Python and Go) could have the same hashing scheme


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org