Re: [DISCUSS] KIP-1108 Publish skipped record metrics in Connect

[Anton Liauchuk <an...@gmail.com>]

Hi,
Thank you for the KIP!
As an additional improvement, for troubleshooting purposes it can be useful
to have metrics regarding the number of poll executions:
*sink-poll-count-total*: The total number of poll invocations by this task
belonging to the named sink connector in this worker, since the task was
last restarted.
*source-poll-count-total*: The total number of poll invocations by this
task belonging to the named source connector in this worker, since the task
was last restarted.

On Thu, Nov 7, 2024 at 11:42 PM Hector Geraldino (BLOOMBERG/ 919 3RD A) <
hgeraldino@bloomberg.net> wrote:

> Howdy,
>
> I would like to  propose a new (hopefully not too controversial) KIP to
> publish new metrics to accurately report the number of skipped records in
> Kafka Connect.
>
> KIP:
>
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-1108%3A+Publish+metrics+for+skipped+records+in+Kafka+Connect
>
> I look forward for your thoughts and improvements on this KIP
>
> Cheers,
> Hector