You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Ewen Cheslack-Postava (JIRA)" <ji...@apache.org> on 2017/07/21 06:06:00 UTC
[jira] [Commented] (KAFKA-5000) Framework should log some progress
information regularly to assist in troubleshooting
[ https://issues.apache.org/jira/browse/KAFKA-5000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16095830#comment-16095830 ]
Ewen Cheslack-Postava commented on KAFKA-5000:
----------------------------------------------
Should this be logs or just covered by the metrics that, while still missing, we want to add?
> Framework should log some progress information regularly to assist in troubleshooting
> -------------------------------------------------------------------------------------
>
> Key: KAFKA-5000
> URL: https://issues.apache.org/jira/browse/KAFKA-5000
> Project: Kafka
> Issue Type: Bug
> Components: KafkaConnect
> Reporter: Gwen Shapira
>
> We get many questions of the type:
> "I started a connector, it doesn't seem to make any progress, I don't know what to do"
> I think that periodic "progress reports" on the worker logs may help.
> We have the offset commit message: "INFO WorkerSinkTask{id=cassandra-sink-connector-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSinkTask:244)"
> But I think we'd also want to know: topic, partition, offsets, how many rows were read from source/kafka and how many were successfully written.
> This will help determine if there is any progress being made and whether some partitions are "stuck" for some reason.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)