[GitHub] flume pull request #229: FLUME-3223 Flume HDFS Sink should retry close prior...

[majorendre <gi...@git.apache.org>]

GitHub user majorendre opened a pull request:

    https://github.com/apache/flume/pull/229

    FLUME-3223 Flume HDFS Sink should retry close prior release lease

    This is based on @mcsanady 's original pull request #202 
    I have took the test changes from him but reworked the new feature implementation since it failed some unit tests.
    Previously when a close failed we immediately did a recover lease. This PR introduces a background retry mechanism. It uses the already existing "hdfs.closeTries" parameter. Unfortunately it has infinite retries by default, that seems a bit too long for me.
    I also did a minimal code clean up.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/majorendre/flume FLUME-3223

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flume/pull/229.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #229
    
----
commit 5514f0489ae6091bec5eea814a4c8a9990eede35
Author: Endre Major <em...@...>
Date:   2018-09-27T12:05:38Z

    FLUME-3223 Flume HDFS Sink should retry close prior release lease

----


---

[GitHub] flume pull request #229: FLUME-3223 Flume HDFS Sink should retry close prior...

[asfgit <gi...@git.apache.org>]

Github user asfgit closed the pull request at:

    https://github.com/apache/flume/pull/229


---