[jira] [Commented] (FLUME-2823) Flume-Kafka-Channel with new APIs

["ASF subversion and git services (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLUME-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438162#comment-15438162 ] 

ASF subversion and git services commented on FLUME-2823:
--------------------------------------------------------

Commit 1e8f2651dacf5daef55d75c7b9b12492962e7921 in flume's branch refs/heads/trunk from [~granthenke]
[ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=1e8f265 ]

FLUME-2972. Handle offset migration in the new Kafka Channel

Offsets tracking the position in Kafka consumers change from using
Zookeeper for offset storage to Kafka when moving from Kafka 0.8.x to
0.9.x.

FLUME-2823 makes the client change in the Kafka Channel but does not
ensure existing offsets get migrated in order to continue consuming
where it left off.

Flume should have some automated logic on startup to check if Kafka
offsets exist, if not and migration is enabled (by default) then copy
the offsets from Zookeeper and commit them to Kafka.

Reviewers: Balázs Donát Bessenyei, Denes Arvay, Mike Percy

(Grant Henke via Mike Percy)


> Flume-Kafka-Channel with new APIs
> ---------------------------------
>
>                 Key: FLUME-2823
>                 URL: https://issues.apache.org/jira/browse/FLUME-2823
>             Project: Flume
>          Issue Type: Sub-task
>            Reporter: Jeff Holoman
>            Assignee: Jeff Holoman
>             Fix For: v1.7.0
>
>         Attachments: FLUME-2823v4.patch, FLUME-2823v6.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)