Kafka C++ Sync Producer on Windows

[Pankaj Misra <pa...@impetus.co.in>]

Hi All,

I am using Kafka 0.7.2. I was able to run the async example of the C++ producer on Windows using the code listed at
https://github.com/kafka-dev/kafka/blob/master/clients/cpp/src/producer.cpp


But as I understand, the C++ async producer does not have the fail-over mechanisms of buffering the messages and retrying the transmission of messages like the Java producer has in async mode.

To have a better control on the failure detection and to be able to retry sending the data, I wanted to change the C++ producer to be a sync producer. A sync write will provide me ability to detect failures for every batch of message written to the socket, and relay the buffered messages to alternate brokers.

Requesting your guidance for the same, as I am not very familiar with the underlying libraries usage for sync and async connections used by the C++ Kafka producer client.

Thanks & Regards
Pankaj Misra


________________________________






NOTE: This message may contain information that is confidential, proprietary, privileged or otherwise protected by law. The message is intended solely for the named addressee. If received in error, please destroy and notify the sender. Any use of this email is prohibited when received in error. Impetus does not represent, warrant and/or guarantee, that the integrity of this communication has been maintained nor that the communication is free of errors, virus, interception or interference.

Re: Kafka C++ Sync Producer on Windows

[Jun Rao <ju...@gmail.com>]

Pankaj,

The non-java client code is maintained separately. You can submit a pull
request directly to the client project to make changes.

Thanks,

Jun


On Tue, May 7, 2013 at 7:16 AM, Pankaj Misra <pa...@impetus.co.in>wrote:

> Hi All,
>
> I am using Kafka 0.7.2. I was able to run the async example of the C++
> producer on Windows using the code listed at
> https://github.com/kafka-dev/kafka/blob/master/clients/cpp/src/producer.cpp
>
>
> But as I understand, the C++ async producer does not have the fail-over
> mechanisms of buffering the messages and retrying the transmission of
> messages like the Java producer has in async mode.
>
> To have a better control on the failure detection and to be able to retry
> sending the data, I wanted to change the C++ producer to be a sync
> producer. A sync write will provide me ability to detect failures for every
> batch of message written to the socket, and relay the buffered messages to
> alternate brokers.
>
> Requesting your guidance for the same, as I am not very familiar with the
> underlying libraries usage for sync and async connections used by the C++
> Kafka producer client.
>
> Thanks & Regards
> Pankaj Misra
>
>
> ________________________________
>
>
>
>
>
>
> NOTE: This message may contain information that is confidential,
> proprietary, privileged or otherwise protected by law. The message is
> intended solely for the named addressee. If received in error, please
> destroy and notify the sender. Any use of this email is prohibited when
> received in error. Impetus does not represent, warrant and/or guarantee,
> that the integrity of this communication has been maintained nor that the
> communication is free of errors, virus, interception or interference.
>