You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "SilkyAlex (Jira)" <ji...@apache.org> on 2022/05/18 12:43:00 UTC

[jira] [Created] (FLINK-27684) FlinkKafkaConsumerBase could record partitions offset when GROUP_OFFSETS

SilkyAlex created FLINK-27684:
---------------------------------

             Summary: FlinkKafkaConsumerBase could record partitions offset when GROUP_OFFSETS
                 Key: FLINK-27684
                 URL: https://issues.apache.org/jira/browse/FLINK-27684
             Project: Flink
          Issue Type: Improvement
          Components: Connectors / Kafka
    Affects Versions: 1.14.3
            Reporter: SilkyAlex


when FlinkKafkaConsumerBase startupMode been set with:

EARLIEST/LATEST/TIMESTAMP/GROUP_OFFSETS

the log when startup are not record current partitions's offsets, that makes difficult to locate starup offsets for check something data problem.

 

we could record it for a better world.

 
{code:java}
2022-04-15 22:27:58.802 INFO  [95] org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - Consumer subtask 11 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='kafka_topic', partition=4}]
2022-04-15 22:27:58.802 INFO  [94] org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - Consumer subtask 5 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='kafka_topic', partition=14}]
2022-04-15 22:27:58.805 INFO  [92] org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - Consumer subtask 3 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='kafka_topic', partition=12, wish here to log offsets}] {code}
 

 



--
This message was sent by Atlassian Jira
(v8.20.7#820007)