You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@linkis.apache.org by ca...@apache.org on 2022/08/26 13:33:07 UTC

[incubator-linkis] branch dev-1.3.0 updated: [ spark ] module configuration item arrangement (#3036)

This is an automated email from the ASF dual-hosted git repository.

casion pushed a commit to branch dev-1.3.0
in repository https://gitbox.apache.org/repos/asf/incubator-linkis.git


The following commit(s) were added to refs/heads/dev-1.3.0 by this push:
     new 14ef16ef2 [ spark ] module configuration item arrangement (#3036)
14ef16ef2 is described below

commit 14ef16ef26a4b8c501d304c6144e8ef440a35ef0
Author: 成彬彬 <10...@users.noreply.github.com>
AuthorDate: Fri Aug 26 21:33:03 2022 +0800

    [ spark ] module configuration item arrangement (#3036)
---
 docs/spark.md | 31 +++++++++++++++++++++++++++++++
 1 file changed, 31 insertions(+)

diff --git a/docs/spark.md b/docs/spark.md
new file mode 100644
index 000000000..499064346
--- /dev/null
+++ b/docs/spark.md
@@ -0,0 +1,31 @@
+## spark 配置
+
+
+| 模块名(服务名) | 参数名 | 默认值 | 描述 | 是否引用|
+| -------- | -------- | ----- |----- |  -----   |
+|spark|linkis.bgservice.store.prefix|hdfs:///tmp/bdp-ide/|bgservice.store.prefix|
+|spark|linkis.bgservice.store.suffix|  |bgservice.store.suffix|
+|spark|wds.linkis.dolphin.decimal.precision|32 |dolphin.decimal.precision|
+|spark|wds.linkis.dolphin.decimal.scale| 10 | dolphin.decimal.scale|
+|spark|wds.linkis.park.extension.max.pool|2 |extension.max.pool|
+|spark|wds.linkis.process.threadpool.max| 100|process.threadpool.max  |
+|spark|wds.linkis.engine.spark.session.hook| | spark.session.hook|
+|spark|wds.linkis.engine.spark.spark-loop.init.time| 120s |spark.spark-loop.init.time|
+|spark|wds.linkis.engine.spark.language-repl.init.time| 30s| spark.language-repl.init.time |
+|spark|wds.linkis.spark.sparksubmit.path| spark-submit|spark.sparksubmit.path|
+|spark|wds.linkis.spark.output.line.limit|10| spark.output.line.limit|
+|spark|wds.linkis.spark.useHiveContext|true| spark.useHiveContext |
+|spark|wds.linkis.enginemanager.core.jar|  | enginemanager.core.jar|
+|spark|wds.linkis.ecp.spark.default.jar|linkis-engineconn-core-1.2.0.jar|spark.default.jar|
+|spark|wds.linkis.dws.ujes.spark.extension.timeout| 3000L |spark.extension.timeout|
+|spark|wds.linkis.engine.spark.fraction.length| 30 |spark.fraction.length|
+|spark|wds.linkis.show.df.max.res| |show.df.max.res|
+|spark|wds.linkis.mdq.application.name| linkis-ps-datasource |mdq.application.name||
+|spark|wds.linkis.dolphin.limit.len| 5000|dolphin.limit.len|
+|spark|wds.linkis.spark.engine.is.viewfs.env| true | spark.engine.is.viewfs.env|
+|spark|wds.linkis.spark.engineconn.fatal.log|error writing class;OutOfMemoryError|spark.engineconn.fatal.log|
+|spark|wds.linkis.spark.engine.scala.replace_package_header.enable| true |spark.engine.scala.replace_package_header.enable|
+
+
+
+ 
\ No newline at end of file


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@linkis.apache.org
For additional commands, e-mail: commits-help@linkis.apache.org