[jira] [Commented] (PHOENIX-4897) Phoenix Kafka Plugin support specifying message offset

["Ankit Singhal (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PHOENIX-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16610395#comment-16610395 ] 

Ankit Singhal commented on PHOENIX-4897:
----------------------------------------

bq. I found Kafka Plugin only consume the new messages after this plugin started, could not consume the message from beginning (at least I didn't found introduction on Phonenix docs).
set "auto.offset.reset" to "earliest" for an initial start of Phoenix consumer so that it will read from starting if no offset is present.
https://kafka.apache.org/documentation/#newconsumerconfigs

bq. And if the plugin app crashed, util it got restarted, the message happened during this period are not got ingested.
The plugin uses the consumer API only, so you can easily manage your offsets for the consumer group through Kafka API directly.

> Phoenix Kafka Plugin support specifying message offset
> ------------------------------------------------------
>
>                 Key: PHOENIX-4897
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-4897
>             Project: Phoenix
>          Issue Type: New Feature
>    Affects Versions: 4.13.0
>            Reporter: XiaoMifan
>            Priority: Major
>
> I found Kafka Plugin only consume the new messages after this plugin started, could not consume the message from beginning (at least I didn't found introduction on Phonenix docs).
> And if the plugin app crashed, util it got restarted, the message happened during this period are not got ingested.
> If I'm missing some thing that this plugin has already supported it, please give some advise, thanks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)