[incubator-pinot] branch master updated: Editing pluggable storage docs (#3932)

[je...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

jenniferdai pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git


The following commit(s) were added to refs/heads/master by this push:
     new 244a5b5  Editing pluggable storage docs (#3932)
244a5b5 is described below

commit 244a5b5ed3746b3965c93e14193d4026e769e9ca
Author: Jennifer Dai <je...@users.noreply.github.com>
AuthorDate: Fri Mar 8 12:43:27 2019 -0800

    Editing pluggable storage docs (#3932)
---
 docs/pluggable_storage.rst | 31 +++++++++++++++++++++++++++++--
 1 file changed, 29 insertions(+), 2 deletions(-)

diff --git a/docs/pluggable_storage.rst b/docs/pluggable_storage.rst
index 16b4b6b..6266add 100644
--- a/docs/pluggable_storage.rst
+++ b/docs/pluggable_storage.rst
@@ -37,6 +37,33 @@ New Storage Type implementation
 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 In order to add a new type of storage backend (say, Amazon s3) implement the following class:
 
-#. S3FS extends `PinotFS <https://github.com/apache/incubator-pinot/blob/master/pinot-filesystem/src/main/java/org/apache/pinot/filesystem/PinotFS.java>`_
+S3FS extends `PinotFS <https://github.com/apache/incubator-pinot/blob/master/pinot-filesystem/src/main/java/org/apache/pinot/filesystem/PinotFS.java>`_
 
-The properties for the stream implementation are to be set in your controller and server configurations, `like so <https://github.com/apache/incubator-pinot/wiki/Pluggable-Storage>`_.
+Configurations
+^^^^^^^^^^^^^^
+These properties for the stream implementation are to be set in your controller and server configurations.
+
+Pinot supports different kinds of storage; eg: NFS, HDFS, ADL. In order to get this working with your cluster, you will need to configure the following.
+
+In your controller and server configs, please set the FS class you would like to support. pinot.controller.storage.factory.class.${YOUR_URI_SCHEME} to the full path of the FS class you would like to include
+
+You also need to configure pinot.controller.local.temp.dir for the local dir on the controller machine.
+
+For filesystem specific configs, you can pass in the following with either the pinot.controller prefix or the pinot.server prefix.
+
+All the following configs need to be prefixed with storage.factory.
+
+AzurePinotFS requires the following configs according to your environment:
+
+adl.accountId, adl.authEndpoint, adl.clientId, adl.clientSecret
+
+Please also make sure to set the following config with the value "adl"
+segment.fetcher.protocols : adl
+
+
+HadoopPinotFS requires the following configs according to your environment:
+
+hadoop.kerberos.principle, hadoop.kerberos.keytab, hadoop.conf.path
+
+Please make sure to also set the following config with the value "hdfs"
+segment.fetcher.protocols : hdfs


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org