You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flume.apache.org by "Ted Malaska (JIRA)" <ji...@apache.org> on 2013/05/31 02:59:20 UTC

[jira] [Commented] (FLUME-2007) HDFS Sink should check if file is closed and retry if it is not.

    [ https://issues.apache.org/jira/browse/FLUME-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13671023#comment-13671023 ] 

Ted Malaska commented on FLUME-2007:
------------------------------------

Hey Hari,

I would love to do this one.  Just to confirm.  Does this sound like what you are requesting?

I will add the following method (fs.isFileClosed) to after a close commend has been fired.  If the file is not closed then I will wait a given time and repeat.  I will repeat N times and then throw an exception.

Thanks again.

                
> HDFS Sink should check if file is closed and retry if it is not.
> ----------------------------------------------------------------
>
>                 Key: FLUME-2007
>                 URL: https://issues.apache.org/jira/browse/FLUME-2007
>             Project: Flume
>          Issue Type: Bug
>            Reporter: Hari Shreedharan
>
> We can use the new API added in HDFS-4525. We will need to use reflection though, so we can run against a version of HDFS which does not have this API.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira