You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@griffin.apache.org by gu...@apache.org on 2018/09/20 06:08:35 UTC
incubator-griffin git commit: Deployment and compose doc improvements
Repository: incubator-griffin
Updated Branches:
refs/heads/master 887ea3389 -> b6c6c9644
Deployment and compose doc improvements
Author: Nikolay Sokolov <ch...@gmail.com>
Closes #417 from chemikadze/deployment-documentation.
Project: http://git-wip-us.apache.org/repos/asf/incubator-griffin/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-griffin/commit/b6c6c964
Tree: http://git-wip-us.apache.org/repos/asf/incubator-griffin/tree/b6c6c964
Diff: http://git-wip-us.apache.org/repos/asf/incubator-griffin/diff/b6c6c964
Branch: refs/heads/master
Commit: b6c6c96449cc7d26cfaab45c082790393a1a57ba
Parents: 887ea33
Author: Nikolay Sokolov <ch...@gmail.com>
Authored: Thu Sep 20 14:08:30 2018 +0800
Committer: William Guo <gu...@apache.org>
Committed: Thu Sep 20 14:08:30 2018 +0800
----------------------------------------------------------------------
griffin-doc/deploy/deploy-guide.md | 41 ++++++++++++++++++++
.../docker/compose/docker-compose-batch.yml | 14 +++----
2 files changed, 48 insertions(+), 7 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/b6c6c964/griffin-doc/deploy/deploy-guide.md
----------------------------------------------------------------------
diff --git a/griffin-doc/deploy/deploy-guide.md b/griffin-doc/deploy/deploy-guide.md
index a12db2e..b2f3536 100644
--- a/griffin-doc/deploy/deploy-guide.md
+++ b/griffin-doc/deploy/deploy-guide.md
@@ -64,6 +64,40 @@ Init quartz tables in MySQL using [Init_quartz_mysql_innodb.sql.sql](../../servi
mysql -u <username> -p quartz < Init_quartz_mysql_innodb.sql.sql
```
+#### Elasticsearch
+
+You might want to create Elasticsearch index in advance, in order to set number of shards, replicas, and other settings to desired values:
+```
+curl -XPUT http://es:9200/griffin -d '
+{
+ "aliases": {},
+ "mappings": {
+ "accuracy": {
+ "properties": {
+ "name": {
+ "fields": {
+ "keyword": {
+ "ignore_above": 256,
+ "type": "keyword"
+ }
+ },
+ "type": "text"
+ },
+ "tmst": {
+ "type": "long"
+ }
+ }
+ }
+ },
+ "settings": {
+ "index": {
+ "number_of_replicas": "1",
+ "number_of_shards": "5"
+ }
+ }
+}
+'
+```
You should also modify some configurations of Griffin for your environment.
@@ -135,6 +169,13 @@ You should also modify some configurations of Griffin for your environment.
```
- \<griffin measure path> is the location where you should put the jar file of measure module.
+
+- <b>service/src/main/resources/env/env_batch.json</b>
+
+ Adjust sinks according to your requirement. At least, you will need to adjust HDFS output
+ directory (hdfs:///griffin/persist by default), and Elasticsearch URL (http://es:9200/griffin/accuracy by default).
+ Similar changes are required in `env_streaming.json`.
+
### Build and Run
http://git-wip-us.apache.org/repos/asf/incubator-griffin/blob/b6c6c964/griffin-doc/docker/compose/docker-compose-batch.yml
----------------------------------------------------------------------
diff --git a/griffin-doc/docker/compose/docker-compose-batch.yml b/griffin-doc/docker/compose/docker-compose-batch.yml
index 592be52..bd993d7 100644
--- a/griffin-doc/docker/compose/docker-compose-batch.yml
+++ b/griffin-doc/docker/compose/docker-compose-batch.yml
@@ -26,13 +26,13 @@ griffin:
- /var/lib/mysql
ports:
- 32122:2122
- - 38088:8088
- - 33306:3306
- - 35432:5432
- - 38042:8042
- - 39083:9083
- - 38998:8998
- - 38080:8080
+ - 38088:8088 # yarn rm web ui
+ - 33306:3306 # mysql
+ - 35432:5432 # postgres
+ - 38042:8042 # yarn nm web ui
+ - 39083:9083 # hive-metastore
+ - 38998:8998 # livy
+ - 38080:8080 # griffin ui
tty: true
container_name: griffin