[GitHub] [hudi] yanghua commented on a change in pull request #3436: [HUDI-2289] add ks3 support doc for hudi

[GitBox <gi...@apache.org>]

yanghua commented on a change in pull request #3436:
URL: https://github.com/apache/hudi/pull/3436#discussion_r685707469



##########
File path: docs/_docs/3_3_ks3_filesystem.md
##########
@@ -0,0 +1,52 @@
+---
+title: KS3 Filesystem
+keywords: hudi, hive, aws, s3, spark, presto, ks3
+permalink: /docs/ks3_hoodie.html
+summary: In this page, we go over how to configure Hudi with KS3 filesystem.
+last_modified_at: 2021-08-09T15:59:57-04:00
+---
+In this page, we explain how to get your Hudi spark job to store into KS3.
+
+## KS3 configs
+
+There are two configurations required for Hudi-KS3 compatibility:
+
+- Adding KS3 Credentials for Hudi
+- Adding required Jars to classpath
+
+### KS3 Credentials
+
+Simplest way to use Hudi with KS3, is to configure your `SparkSession` or `SparkContext` with KS3 credentials. Hudi will automatically pick this up and talk to KS3.
+
+Alternatively, add the required configs in your core-site.xml from where Hudi can fetch them. Replace the `fs.defaultFS` with your KS3 bucket name and Hudi should be able to read/write from the bucket.
+
+```xml
+  <property>
+      <name>fs.defaultFS</name>
+      <value>hdfs://ks3node</value>
+  </property>
+
+  <property>
+      <name>fs.ks3.impl</name>
+      <value>com.ksyun.kmr.hadoop.fs.Ks3FileSystem</value>
+  </property>
+
+  <property>
+      <name>fs.ks3.AccessKey</name>
+      <value>KS3_KEY</value>
+  </property>
+
+  <property>
+       <name>fs.ks3.AccessSecret</name>
+       <value>KS3_SECRET</value>
+  </property>
+
+```
+
+

Review comment:
       duplicated empty lines




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org