You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@flume.apache.org by be...@apache.org on 2017/02/17 22:16:09 UTC
flume git commit: Add Impala and Hive recommendation on
hdfs.writeFormat setting in the user guide
Repository: flume
Updated Branches:
refs/heads/trunk 630083228 -> 4b6b841ab
Add Impala and Hive recommendation on hdfs.writeFormat setting in the user guide
This closes #89
Reviewers: Denes Arvay, Jeff Holoman
(Attila Simon via Bessenyei Bal�zs Don�t)
Project: http://git-wip-us.apache.org/repos/asf/flume/repo
Commit: http://git-wip-us.apache.org/repos/asf/flume/commit/4b6b841a
Tree: http://git-wip-us.apache.org/repos/asf/flume/tree/4b6b841a
Diff: http://git-wip-us.apache.org/repos/asf/flume/diff/4b6b841a
Branch: refs/heads/trunk
Commit: 4b6b841ab79162151af8d5e162fcc963f8009c69
Parents: 6300832
Author: Attila Simon <sa...@cloudera.com>
Authored: Fri Nov 18 16:42:14 2016 +0100
Committer: Bessenyei Bal�zs Don�t <be...@apache.org>
Committed: Fri Feb 17 22:12:43 2017 +0000
----------------------------------------------------------------------
flume-ng-doc/sphinx/FlumeUserGuide.rst | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/flume/blob/4b6b841a/flume-ng-doc/sphinx/FlumeUserGuide.rst
----------------------------------------------------------------------
diff --git a/flume-ng-doc/sphinx/FlumeUserGuide.rst b/flume-ng-doc/sphinx/FlumeUserGuide.rst
index afa6625..d863068 100644
--- a/flume-ng-doc/sphinx/FlumeUserGuide.rst
+++ b/flume-ng-doc/sphinx/FlumeUserGuide.rst
@@ -2012,7 +2012,7 @@ hdfs.fileType SequenceFile File format: currently ``SequenceFile``, `
(2)CompressedStream requires set hdfs.codeC with an available codeC
hdfs.maxOpenFiles 5000 Allow only this number of open files. If this number is exceeded, the oldest file is closed.
hdfs.minBlockReplicas -- Specify minimum number of replicas per HDFS block. If not specified, it comes from the default Hadoop config in the classpath.
-hdfs.writeFormat -- Format for sequence file records. One of "Text" or "Writable" (the default).
+hdfs.writeFormat Writable Format for sequence file records. One of ``Text`` or ``Writable``. Set to ``Text`` before creating data files with Flume, otherwise those files cannot be read by either Apache Impala (incubating) or Apache Hive.
hdfs.callTimeout 10000 Number of milliseconds allowed for HDFS operations, such as open, write, flush, close.
This number should be increased if many HDFS timeout operations are occurring.
hdfs.threadsPoolSize 10 Number of threads per HDFS sink for HDFS IO ops (open, write, etc.)