You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by rx...@apache.org on 2020/07/29 10:41:31 UTC

[pulsar] 22/25: [docs] Fix wrong required properties for HDFS2 sink (#7643)

This is an automated email from the ASF dual-hosted git repository.

rxl pushed a commit to branch branch-2.6
in repository https://gitbox.apache.org/repos/asf/pulsar.git

commit 50493d07d42c25dc2c2f018626fc21f645bce4c4
Author: Yunze Xu <xy...@163.com>
AuthorDate: Tue Jul 28 17:38:25 2020 +0800

    [docs] Fix wrong required properties for HDFS2 sink (#7643)
    
    * Fix wrong required properties for HDFS2 sink
    
    * Fix description of filenamePrefix
    
    (cherry picked from commit bf90e55214d04c3f8b34433c119c43a49bb1c1e8)
---
 site2/docs/io-hdfs2-sink.md | 6 ++++--
 1 file changed, 4 insertions(+), 2 deletions(-)

diff --git a/site2/docs/io-hdfs2-sink.md b/site2/docs/io-hdfs2-sink.md
index 9769695..56c4c7b 100644
--- a/site2/docs/io-hdfs2-sink.md
+++ b/site2/docs/io-hdfs2-sink.md
@@ -21,8 +21,8 @@ The configuration of the HDFS2 sink connector has the following properties.
 | `compression` | Compression |false |None |The compression code used to compress or de-compress the files on HDFS. <br/><br/>Below are the available options:<br/><li>BZIP2<br/><li>DEFLATE<br/><li>GZIP<br/><li>LZ4<br/><li>SNAPPY|
 | `kerberosUserPrincipal` |String| false| None|The principal account of Kerberos user used for authentication. |
 | `keytab` | String|false|None| The full pathname of the Kerberos keytab file used for authentication. |
-| `filenamePrefix` |String| false |None |The prefix of the files created inside the HDFS directory.<br/><br/>**Example**<br/> The value of topicA result in files named topicA-. |
-| `fileExtension` | String| false | None| The extension added to the files written to HDFS.<br/><br/>**Example**<br/>'.txt'<br/> '.seq' |
+| `filenamePrefix` |String| true, if `compression` is set to `None`. | None |The prefix of the files created inside the HDFS directory.<br/><br/>**Example**<br/> The value of topicA result in files named topicA-. |
+| `fileExtension` | String| true | None | The extension added to the files written to HDFS.<br/><br/>**Example**<br/>'.txt'<br/> '.seq' |
 | `separator` | char|false |None |The character used to separate records in a text file. <br/><br/>If no value is provided, the contents from all records are concatenated together in one continuous byte array. |
 | `syncInterval` | long| false |0| The interval between calls to flush data to HDFS disk in milliseconds. |
 | `maxPendingRecords` |int| false|Integer.MAX_VALUE |  The maximum number of records that hold in memory before acking. <br/><br/>Setting this property to 1 makes every record send to disk before the record is acked.<br/><br/>Setting this property to a higher value allows buffering records before flushing them to disk. 
@@ -38,6 +38,7 @@ Before using the HDFS2 sink connector, you need to create a configuration file t
         "hdfsConfigResources": "core-site.xml",
         "directory": "/foo/bar",
         "filenamePrefix": "prefix",
+        "fileExtension": ".log",
         "compression": "SNAPPY"
     }
     ```
@@ -49,5 +50,6 @@ Before using the HDFS2 sink connector, you need to create a configuration file t
         hdfsConfigResources: "core-site.xml"
         directory: "/foo/bar"
         filenamePrefix: "prefix"
+        fileExtension: ".log"
         compression: "SNAPPY"
     ```