[jira] [Commented] (FLUME-1946) Tolerate disk failure in FileChannel

["Hari Shreedharan (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLUME-1946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13798283#comment-13798283 ] 

Hari Shreedharan commented on FLUME-1946:
-----------------------------------------

I have been looking at Avro container files as an option here. Avro container files do give an option to get the offset of a specific sync marker, which we could use as the offset to specific events. I am working on a simple implementation right now to see how things look. I am trying not to change the APIs and expected behavior, which will allow us to use the current unit tests.

> Tolerate disk failure in FileChannel
> ------------------------------------
>
>                 Key: FLUME-1946
>                 URL: https://issues.apache.org/jira/browse/FLUME-1946
>             Project: Flume
>          Issue Type: Bug
>          Components: File Channel
>            Reporter: Mike Percy
>            Assignee: Hari Shreedharan
>
> It would be great to investigate changes to the FileChannel that enable it to tolerate failure of one or more disks in a group of data directories across disks without losing data. This involves implementing support for some form of mirroring at the software level, as well as appropriate recovery routines.



--
This message was sent by Atlassian JIRA
(v6.1#6144)