You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kylin.apache.org by sh...@apache.org on 2018/06/25 07:01:50 UTC
[kylin] branch document updated: Add job engine HA
This is an automated email from the ASF dual-hosted git repository.
shaofengshi pushed a commit to branch document
in repository https://gitbox.apache.org/repos/asf/kylin.git
The following commit(s) were added to refs/heads/document by this push:
new e3504df Add job engine HA
e3504df is described below
commit e3504dfc90df797f6bcd039937775b28c334f027
Author: shaofengshi <sh...@apache.org>
AuthorDate: Mon Jun 25 14:36:29 2018 +0800
Add job engine HA
---
website/_docs/install/advance_settings.md | 11 +++++++++++
website/_docs23/install/configuration.md | 1 -
2 files changed, 11 insertions(+), 1 deletion(-)
diff --git a/website/_docs/install/advance_settings.md b/website/_docs/install/advance_settings.md
index 280c4ce..ce21b91 100644
--- a/website/_docs/install/advance_settings.md
+++ b/website/_docs/install/advance_settings.md
@@ -80,6 +80,17 @@ export KYLIN_JVM_SETTINGS="-Xms1024M -Xmx4096M -Xss1024K -XX:MaxPermSize=128M -v
# export KYLIN_JVM_SETTINGS="-Xms16g -Xmx16g -XX:MaxPermSize=512m -XX:NewSize=3g -XX:MaxNewSize=3g -XX:SurvivorRatio=4 -XX:+CMSClassUnloadingEnabled -XX:+CMSParallelRemarkEnabled -XX:+UseConcMarkSweepGC -XX:+CMSIncrementalMode -XX:CMSInitiatingOccupancyFraction=70 -XX:+DisableExplicitGC -XX:+HeapDumpOnOutOfMemoryError"
{% endhighlight %}
+## Enable multiple job engines (HA)
+Since Kylin 2.0, Kylin support multiple job engines running together, which is more extensible, available and reliable than the default job scheduler.
+
+To enable the distributed job scheduler, you need to set or update the configs in the kylin.properties:
+
+```
+kylin.job.scheduler.default=2
+kylin.job.lock=org.apache.kylin.storage.hbase.util.ZookeeperDistributedJobLock
+```
+Please add all job servers and query servers to the `kylin.server.cluster-servers`.
+
## Enable LDAP or SSO authentication
Check [How to Enable Security with LDAP and SSO](../howto/howto_ldap_and_sso.html)
diff --git a/website/_docs23/install/configuration.md b/website/_docs23/install/configuration.md
index 5d47743..3f12ff5 100644
--- a/website/_docs23/install/configuration.md
+++ b/website/_docs23/install/configuration.md
@@ -181,7 +181,6 @@ The main configuration file of Kylin.
| kylin.engine.spark.rdd-partition-cut-mb | 10.0 | Spark Cubing RDD partition split size. | Yes |
| kylin.engine.spark.min-partition | 1 | Spark Cubing RDD min partition number | Yes |
| kylin.engine.spark.max-partition | 5000 | RDD max partition number | Yes |
-| kylin.engine.spark.storage-level | MEMORY_AND_DISK_SER | RDD persistent level. | Yes |
| kylin.query.skip-empty-segments | true | Whether directly skip empty segment (metadata shows size be 0) when run SQL query. | Yes |
| kylin.query.force-limit | -1 | | |
| kylin.query.max-scan-bytes | 0 | | |