You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "jweinste (JIRA)" <ji...@apache.org> on 2015/12/21 17:20:46 UTC
[jira] [Updated] (FLUME-2861) KafkaChannel decomission can lead to
loss of data
[ https://issues.apache.org/jira/browse/FLUME-2861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
jweinste updated FLUME-2861:
----------------------------
Summary: KafkaChannel decomission can lead to loss of data (was: KafkaChannel decomission)
> KafkaChannel decomission can lead to loss of data
> -------------------------------------------------
>
> Key: FLUME-2861
> URL: https://issues.apache.org/jira/browse/FLUME-2861
> Project: Flume
> Issue Type: Bug
> Components: Channel
> Affects Versions: v1.6.0
> Reporter: jweinste
>
> Events may be taken, but not Transaction.committed when decommission is called, resulting in potential loss of data.
> doTake()...
> eventTaken = true;
> events.get().add(e);
> stop()...
> private void decommissionConsumerAndIterator(ConsumerAndIterator c) {
> if (c.failedEvents.isEmpty()) {
> c.consumer.commitOffsets();
> }
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)