kafka consumer can not auto commit

[远远 <zh...@gmail.com>]

I find kafka consumer can not auto commit, when I test kudu async client
with flink async io today.
- i do not enable checkpoint, and with procress time.
- the consumer strategy that i set in connector is: setStartFromEarliest()

the consumer config printed in console as follow:

auto.commit.interval.ms = 5000
auto.offset.reset = latest
bootstrap.servers = [node104.bigdata.dmp.local.com:9092,
node105.bigdata.dmp.local.com:9092, node106.bigdata.dmp.local.com:9092]
check.crcs = true
client.id =
connections.max.idle.ms = 540000
enable.auto.commit = true
exclude.internal.topics = true
fetch.max.bytes = 52428800
fetch.max.wait.ms = 500
fetch.min.bytes = 1

Re: kafka consumer can not auto commit

[vino yang <ya...@gmail.com>]

Hi zhao,

Can you explain what version of Kafka connector you are using?

Thanks, vino.

远远 <zh...@gmail.com> 于2018年8月22日周三 下午6:37写道：

> I find kafka consumer can not auto commit, when I test kudu async client
> with flink async io today.
> - i do not enable checkpoint, and with procress time.
> - the consumer strategy that i set in connector is: setStartFromEarliest()
>
> the consumer config printed in console as follow:
>
> auto.commit.interval.ms = 5000
> auto.offset.reset = latest
> bootstrap.servers = [node104.bigdata.dmp.local.com:9092,
> node105.bigdata.dmp.local.com:9092, node106.bigdata.dmp.local.com:9092]
> check.crcs = true
> client.id =
> connections.max.idle.ms = 540000
> enable.auto.commit = true
> exclude.internal.topics = true
> fetch.max.bytes = 52428800
> fetch.max.wait.ms = 500
> fetch.min.bytes = 1
>