You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Ning Ma (Jira)" <ji...@apache.org> on 2022/03/11 14:38:00 UTC

[jira] [Created] (FLINK-26614) Upsert Kafka SQL Connector:Support startup mode of timestamp and specific offsets

Ning Ma created FLINK-26614:
-------------------------------

             Summary: Upsert Kafka SQL Connector:Support startup mode of timestamp and specific offsets
                 Key: FLINK-26614
                 URL: https://issues.apache.org/jira/browse/FLINK-26614
             Project: Flink
          Issue Type: Improvement
          Components: Connectors / Kafka
    Affects Versions: 1.14.4
            Reporter: Ning Ma
             Fix For: 1.14.4


When we run Flink SQL using upsert-kafka connector, it cannot support startup mode of timestamp or specific offsets. It is determined to read data from the earliest.

I don't think it's reasonable. Because the data stored in Kafka is incomplete that it only saves data for 7 days in most cases. So why don't we consume data from the specified timestamp or offsets, and this can improve the efficiency of reading data from Kafka.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)