You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Jonathan Hsieh (Commented) (JIRA)" <ji...@apache.org> on 2011/10/05 17:55:34 UTC

[jira] [Commented] (FLUME-640) Send acks without getting masters involved

    [ https://issues.apache.org/jira/browse/FLUME-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13121068#comment-13121068 ] 

Jonathan Hsieh commented on FLUME-640:
--------------------------------------

Yongkun, I'm excited to see this code finally come out and am very impressed by the design doc!  I've been behind in reviews but will try to spend some time on this later on this week.  This is a big feature and could use some help testing this!  Ideally, we could get a version of this on trunk. 
                
> Send acks without getting masters involved
> ------------------------------------------
>
>                 Key: FLUME-640
>                 URL: https://issues.apache.org/jira/browse/FLUME-640
>             Project: Flume
>          Issue Type: Improvement
>    Affects Versions: v0.9.3
>            Reporter: Disabled imported user
>              Labels: acknowledgement
>         Attachments: flume-0.9.3-cdh3u0-masterless-ack.patch, flume-0.9.3-cdh3u0-masterless-ack.patch.README, flume-masterless-ack-for-community.pdf
>
>
> Currently the acks (acknowledgement) from the collector are sent back via the master(s). In case the master is down, the acks will be lost. It seems that the even the multi masters cannot handle this single-point-failure issue.
> A re-design of sending the acks back without getting the master involved will be very beneficial. The single-point-failure can be removed to some extent, and the efficiency of the acks will also be improved since the master is not a bottleneck any more.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira