[jira] [Commented] (FLINK-15262) kafka connector doesn't read from beginning immediately when 'connector.startup-mode' = 'earliest-offset'

["Jiangjie Qin (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-15262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000592#comment-17000592 ] 

Jiangjie Qin commented on FLINK-15262:
--------------------------------------

[~phoenixjiangnan] I was trying to reproduce the issue in SQL client but failed. Can you provide a few more info about how to reproduce this issue?

> kafka connector doesn't read from beginning immediately when 'connector.startup-mode' = 'earliest-offset' 
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: FLINK-15262
>                 URL: https://issues.apache.org/jira/browse/FLINK-15262
>             Project: Flink
>          Issue Type: Bug
>          Components: Connectors / Kafka
>    Affects Versions: 1.10.0
>            Reporter: Bowen Li
>            Assignee: Jiangjie Qin
>            Priority: Critical
>             Fix For: 1.10.0, 1.11.0
>
>
> I created a kafka table in Flink to read from my kakfa topic (already has messages in it) in earliest offset, but `select * from test` query in Flink doesn't start to read until a new message comes. If no new message arrives, the query just sit there and never produce result.
> What I expect is that the query should immediate produce result on all existing message without having to wait for a new message to "trigger" data processing.
> DDL that I used according to DDL document at https://ci.apache.org/projects/flink/flink-docs-release-1.9/dev/table/connect.html#kafka-connector
> {code:java}
> create table test(name String, age Int) with (
>    'connector.type' = 'kafka',
>    'connector.version' = 'universal',
>    'connector.topic' = 'test',
>    'connector.properties.zookeeper.connect' = 'localhost:2181',
>    'connector.properties.bootstrap.servers' = 'localhost:9092',
>    'connector.startup-mode' = 'earliest-offset',
>    'format.type' = 'csv',
>    'update-mode' = 'append'
> );
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)