You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@flume.apache.org by hs...@apache.org on 2015/04/15 01:22:22 UTC
flume git commit: FLUME-2665. Update documentation for
hdfs.closeTries based on FLUME-2586
Repository: flume
Updated Branches:
refs/heads/trunk 94f568b96 -> 4188e4ded
FLUME-2665. Update documentation for hdfs.closeTries based on FLUME-2586
(Johny Rufus via Hari)
Project: http://git-wip-us.apache.org/repos/asf/flume/repo
Commit: http://git-wip-us.apache.org/repos/asf/flume/commit/4188e4de
Tree: http://git-wip-us.apache.org/repos/asf/flume/tree/4188e4de
Diff: http://git-wip-us.apache.org/repos/asf/flume/diff/4188e4de
Branch: refs/heads/trunk
Commit: 4188e4dedb4af0792bfac3086e3b2a7d415f2248
Parents: 94f568b
Author: Hari Shreedharan <hs...@apache.org>
Authored: Tue Apr 14 16:21:26 2015 -0700
Committer: Hari Shreedharan <hs...@apache.org>
Committed: Tue Apr 14 16:22:23 2015 -0700
----------------------------------------------------------------------
flume-ng-doc/sphinx/FlumeUserGuide.rst | 6 +++---
1 file changed, 3 insertions(+), 3 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/flume/blob/4188e4de/flume-ng-doc/sphinx/FlumeUserGuide.rst
----------------------------------------------------------------------
diff --git a/flume-ng-doc/sphinx/FlumeUserGuide.rst b/flume-ng-doc/sphinx/FlumeUserGuide.rst
index 43ca5db..8d91cec 100644
--- a/flume-ng-doc/sphinx/FlumeUserGuide.rst
+++ b/flume-ng-doc/sphinx/FlumeUserGuide.rst
@@ -1728,10 +1728,10 @@ hdfs.roundValue 1 Rounded down to the highest multiple of th
hdfs.roundUnit second The unit of the round down value - ``second``, ``minute`` or ``hour``.
hdfs.timeZone Local Time Name of the timezone that should be used for resolving the directory path, e.g. America/Los_Angeles.
hdfs.useLocalTimeStamp false Use the local time (instead of the timestamp from the event header) while replacing the escape sequences.
-hdfs.closeTries 0 Number of times the sink must try to close a file. If set to 1, this sink will not re-try a failed close
+hdfs.closeTries 0 Number of times the sink must try renaming a file, after initiating a close attempt. If set to 1, this sink will not re-try a failed rename
(due to, for example, NameNode or DataNode failure), and may leave the file in an open state with a .tmp extension.
- If set to 0, the sink will try to close the file until the file is eventually closed
- (there is no limit on the number of times it would try).
+ If set to 0, the sink will try to rename the file until the file is eventually renamed (there is no limit on the number of times it would try).
+ The file may still remain open if the close call fails but the data will be intact and in this case, the file will be closed only after a Flume restart.
hdfs.retryInterval 180 Time in seconds between consecutive attempts to close a file. Each close call costs multiple RPC round-trips to the Namenode,
so setting this too low can cause a lot of load on the name node. If set to 0 or less, the sink will not
attempt to close the file if the first attempt fails, and may leave the file open or with a ".tmp" extension.