You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by cw...@apache.org on 2018/11/30 21:01:04 UTC
[incubator-druid] branch 0.13.0-incubating updated: remove
extensions from default configs that have configuration/library
dependencies and update docs (#6694) (#6695)
This is an automated email from the ASF dual-hosted git repository.
cwylie pushed a commit to branch 0.13.0-incubating
in repository https://gitbox.apache.org/repos/asf/incubator-druid.git
The following commit(s) were added to refs/heads/0.13.0-incubating by this push:
new 8a9ef68 remove extensions from default configs that have configuration/library dependencies and update docs (#6694) (#6695)
8a9ef68 is described below
commit 8a9ef687353a3fd3ba82e2f980e31dbd38b9dd6f
Author: David Lim <da...@apache.org>
AuthorDate: Fri Nov 30 14:00:58 2018 -0700
remove extensions from default configs that have configuration/library dependencies and update docs (#6694) (#6695)
---
docs/content/development/extensions-core/s3.md | 9 ++++++++-
docs/content/operations/including-extensions.md | 4 ++--
docs/content/operations/pull-deps.md | 2 --
examples/conf/druid/_common/common.runtime.properties | 4 ++--
.../tutorial/conf/druid/_common/common.runtime.properties | 2 +-
5 files changed, 13 insertions(+), 8 deletions(-)
diff --git a/docs/content/development/extensions-core/s3.md b/docs/content/development/extensions-core/s3.md
index 21b3652..dcd81cd 100644
--- a/docs/content/development/extensions-core/s3.md
+++ b/docs/content/development/extensions-core/s3.md
@@ -27,10 +27,17 @@ Make sure to [include](../../operations/including-extensions.html) `druid-s3-ext
## Deep Storage
-S3-compatible deep storage is basically either S3 or something like Google Storage which exposes the same API as S3.
+S3-compatible deep storage means either AWS S3 or a compatible service like Google Storage which exposes the same API as S3.
### Configuration
+The AWS SDK requires that the target region be specified. Two ways of doing this are by using the JVM system property `aws.region` or the environment variable `AWS_REGION`.
+
+As an example, to set the region to 'us-east-1' through system properties:
+
+- Add `-Daws.region=us-east-1` to the jvm.config file for all Druid services.
+- Add `-Daws.region=us-east-1` to `druid.indexer.runner.javaOpts` in middleManager/runtime.properties so that the property will be passed to peon (worker) processes.
+
|Property|Description|Default|
|--------|-----------|-------|
|`druid.s3.accessKey`|S3 access key.|Must be set.|
diff --git a/docs/content/operations/including-extensions.md b/docs/content/operations/including-extensions.md
index 4b59463..2de6b7f 100644
--- a/docs/content/operations/including-extensions.md
+++ b/docs/content/operations/including-extensions.md
@@ -44,8 +44,8 @@ common.runtime.properties for your setup.
</div>
<div class="note caution">
-Because of licensing, the mysql-metadata-storage extension is not packaged with the default Druid tarball. In order to get it, you can download it from <a href="http://druid.io/downloads.html">druid.io</a>,
-then unpack and move it into the extensions directory. Make sure to include the name of the extension in the loadList configuration.
+Because of licensing, the mysql-metadata-storage extension does not include the required MySQL JDBC driver. For instructions
+on how to install this library, see the <a href="../development/extensions-core/mysql.html">MySQL extension page</a>.
</div>
## Loading community and third-party extensions (contrib extensions)
diff --git a/docs/content/operations/pull-deps.md b/docs/content/operations/pull-deps.md
index c439a16..d9abf57 100644
--- a/docs/content/operations/pull-deps.md
+++ b/docs/content/operations/pull-deps.md
@@ -112,8 +112,6 @@ extensions
│ ├── twitter4j-core-3.0.3.jar
│ └── twitter4j-stream-3.0.3.jar
└── mysql-metadata-storage
- ├── jdbi-2.32.jar
- ├── mysql-connector-java-5.1.34.jar
└── mysql-metadata-storage-#{DRUIDVERSION}.jar
```
diff --git a/examples/conf/druid/_common/common.runtime.properties b/examples/conf/druid/_common/common.runtime.properties
index 95d01e1..b7d1870 100644
--- a/examples/conf/druid/_common/common.runtime.properties
+++ b/examples/conf/druid/_common/common.runtime.properties
@@ -23,7 +23,7 @@
# This is not the full list of Druid extensions, but common ones that people often use. You may need to change this list
# based on your particular setup.
-druid.extensions.loadList=["druid-kafka-eight", "druid-s3-extensions", "druid-histogram", "druid-datasketches", "druid-lookups-cached-global", "mysql-metadata-storage"]
+druid.extensions.loadList=["druid-histogram", "druid-datasketches", "druid-lookups-cached-global"]
# If you have a different version of Hadoop, place your Hadoop client jar files in your hadoop-dependencies directory
# and uncomment the line below to point to your directory.
@@ -53,7 +53,7 @@ druid.metadata.storage.connector.connectURI=jdbc:derby://metadata.store.ip:1527/
druid.metadata.storage.connector.host=metadata.store.ip
druid.metadata.storage.connector.port=1527
-# For MySQL:
+# For MySQL (make sure to include the MySQL JDBC driver on the classpath):
#druid.metadata.storage.type=mysql
#druid.metadata.storage.connector.connectURI=jdbc:mysql://db.example.com:3306/druid
#druid.metadata.storage.connector.user=...
diff --git a/examples/quickstart/tutorial/conf/druid/_common/common.runtime.properties b/examples/quickstart/tutorial/conf/druid/_common/common.runtime.properties
index 61b0ecb..5b6b0ac 100644
--- a/examples/quickstart/tutorial/conf/druid/_common/common.runtime.properties
+++ b/examples/quickstart/tutorial/conf/druid/_common/common.runtime.properties
@@ -60,7 +60,7 @@ druid.metadata.storage.connector.connectURI=jdbc:derby://localhost:1527/var/drui
druid.metadata.storage.connector.host=localhost
druid.metadata.storage.connector.port=1527
-# For MySQL:
+# For MySQL (make sure to include the MySQL JDBC driver on the classpath):
#druid.metadata.storage.type=mysql
#druid.metadata.storage.connector.connectURI=jdbc:mysql://db.example.com:3306/druid
#druid.metadata.storage.connector.user=...
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org