You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flume.apache.org by "Prasad Mujumdar (Updated) (JIRA)" <ji...@apache.org> on 2012/04/06 03:02:21 UTC

[jira] [Updated] (FLUME-1104) HDFS rolls the first file incorrectly

     [ https://issues.apache.org/jira/browse/FLUME-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Prasad Mujumdar updated FLUME-1104:
-----------------------------------

    Summary: HDFS rolls the first file incorrectly  (was: HDFS file roller creates causes the first file to roll too soon)
    
> HDFS rolls the first file incorrectly
> -------------------------------------
>
>                 Key: FLUME-1104
>                 URL: https://issues.apache.org/jira/browse/FLUME-1104
>             Project: Flume
>          Issue Type: Bug
>          Components: Sinks+Sources
>    Affects Versions: v1.2.0
>            Reporter: Prasad Mujumdar
>            Assignee: Prasad Mujumdar
>
> The sink process() keep tracks of the buckets opened during the transaction. At the end of transaction, we need to flush all the buckets that has pending data. This is required in order to ensure that the data removed from channel should be safely in HDFS during commit.
> Currently the files are tracked only when they are created and also getting closed during the cleanup instead of flush.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira