[linkis-website] branch dev updated: update 1.4.0 feature docs (#704)

[ca...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

casion pushed a commit to branch dev
in repository https://gitbox.apache.org/repos/asf/linkis-website.git


The following commit(s) were added to refs/heads/dev by this push:
     new 2de61b723e update 1.4.0 feature docs (#704)
2de61b723e is described below

commit 2de61b723e8ae6dd25ce4dbd88b0cf7e32146469
Author: GuoPhilipse <46...@users.noreply.github.com>
AuthorDate: Wed Jun 21 12:42:41 2023 +0800

    update 1.4.0 feature docs (#704)
    
    * update 1.4.0 feature docs
    
    * improve 1.4.0 feature docs
---
 docs/feature/base-engine-compatibilty.md           | 36 +++++++++++++++++++++
 docs/feature/remove-json4s-from-linkis.md          | 11 +++++++
 docs/feature/remove-underlying-engine-depdency.md  | 17 ++++++++++
 docs/feature/upgrade-base-engine-version.md        | 20 ++++++++++++
 .../current/feature/base-engine-compatibilty.md    | 37 ++++++++++++++++++++++
 .../current/feature/remove-json4s-from-linkis.md   | 11 +++++++
 .../feature/remove-underlying-engine-depdency.md   | 17 ++++++++++
 .../current/feature/upgrade-base-engine-version.md | 17 ++++++++++
 8 files changed, 166 insertions(+)

diff --git a/docs/feature/base-engine-compatibilty.md b/docs/feature/base-engine-compatibilty.md
new file mode 100644
index 0000000000..e0c615f40a
--- /dev/null
+++ b/docs/feature/base-engine-compatibilty.md
@@ -0,0 +1,36 @@
+---
+title: reduce base engine compatibility issues
+sidebar_position: 0.2
+---
+
+## 1. Requirement Background
+before we may need to modify linkis source code to fit different hive and spark version and compilation may fail for some certain versions, we need to reduce compilation and installation problems caused by base engine versions
+
+## 2. Instructions for use
+for different hive compilation, we only to compile with target hive versions, such as
+```
+mvn clean install package -Dhive.version=3.1.3
+
+```
+
+for different spark compilation, we only to compile with target spark versions, here are normal scenes for usage.
+```
+spark3+hadoop3
+mvn install package
+
+spark3+hadoop2
+mvn install package  -Phadoop-2.7
+
+spark2+hadoop2
+mvn install package -Pspark-2.4 -Phadoop-2.7
+
+spark2+ hadoop3
+mvn install package -Pspark-2.4
+
+```
+## 3. Precautions
+spark subversion can be specified by -Dspark.version=xxx
+hadoop subversion can be specified by -Dhadoop.version=xxx
+
+for example :
+mvn install package -Pspark-3.2 -Phadoop-3.3 -Dspark.version=3.1.3
\ No newline at end of file
diff --git a/docs/feature/remove-json4s-from-linkis.md b/docs/feature/remove-json4s-from-linkis.md
new file mode 100644
index 0000000000..69a7f5d04f
--- /dev/null
+++ b/docs/feature/remove-json4s-from-linkis.md
@@ -0,0 +1,11 @@
+---
+title: remove json4s from linkis
+sidebar_position: 0.2
+---
+
+## 1. Requirement Background
+we need to bind specific json4s version and spark version, we need to reduce the dependency.
+for example: spark2.4 use json4s v3.5.3, spark3.2 use json4s v3.7.0-M11
+
+## 2. Instructions for use
+no need to specific json4s versions when we specify different spark versions
\ No newline at end of file
diff --git a/docs/feature/remove-underlying-engine-depdency.md b/docs/feature/remove-underlying-engine-depdency.md
new file mode 100644
index 0000000000..8dc0159998
--- /dev/null
+++ b/docs/feature/remove-underlying-engine-depdency.md
@@ -0,0 +1,17 @@
+---
+title: EngineConn no longer imports the dependencies of the underlying engine
+sidebar_position: 0.2
+---
+
+## 1. Requirement Background
+engine version hides in EngineConn, we may need to change several modules pom files if some engine version changes, we should move it to project pom file.
+
+## 2. Instructions for use
+if we need to compile only one engineconn module, we will need to compile with `-pl` to specific modules
+```
+mvn install package -pl linkis-engineconn-plugins/spark -Dspark.version=3.2.2
+
+```
+## 3. Precautions
+engine version can also be specified like -Dspark.version=xxx 、 -Dpresto.version=0.235
+now all our supported engine version has been moved to project pom file. please compile with the `-pl` command
\ No newline at end of file
diff --git a/docs/feature/upgrade-base-engine-version.md b/docs/feature/upgrade-base-engine-version.md
new file mode 100644
index 0000000000..164781e392
--- /dev/null
+++ b/docs/feature/upgrade-base-engine-version.md
@@ -0,0 +1,20 @@
+---
+title: upgrade hadoop\spark\hive default version to 3.x
+sidebar_position: 0.2
+---
+
+## 1. Requirement Background
+fow now we support different hadoop, hive ,spark version compile, and lower engine version may have potential CVE risk
+
+## 2. Instructions for use
+default hadoop version changes from 2.7.2 to 3.3.4
+default hive version changes from 2.3.3 to 3.1.3
+default spark version changes from 2.4.3 to 3.2.1
+
+
+## 3. Precautions
+for the default compilation, versions will be spark3.2.1+hadoop3.3.4+hive3.1.3.
+```
+mvn install package
+```
+profile spark-3.2 、 hadoop-3.3 、spark-2.4-hadoop-3.3 profiles have been removed and profile hadoop-2.7 and spark-2.4 have been added instead.
\ No newline at end of file
diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/feature/base-engine-compatibilty.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/feature/base-engine-compatibilty.md
new file mode 100644
index 0000000000..65fb8ece36
--- /dev/null
+++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/feature/base-engine-compatibilty.md
@@ -0,0 +1,37 @@
+---
+title: 减少基础引擎不同版本兼容性问题
+sidebar_position: 0.2
+---
+
+## 1. 需求背景
+之前我们需要修改linkis代码来适配不同的hive版本、spark版本，因为兼容性问题，编译可能会失败，我们可以减少这些基础引擎的兼容性问题。
+
+## 2. 使用说明
+不同的hive版本的编译，我们只需要指定`-D=xxx`就可以了，比如：
+```
+mvn clean install package -Dhive.version=3.1.3
+
+```
+不同版本的spark编译，我们也只需要指定`-D=xxx`就可以了，常用的使用场景如下：
+```
+spark3+hadoop3
+mvn install package
+
+spark3+hadoop2
+mvn install package  -Phadoop-2.7
+
+spark2+hadoop2
+mvn install package -Pspark-2.4 -Phadoop-2.7
+
+spark2+ hadoop3
+mvn install package -Pspark-2.4
+
+```
+## 3. 注意事项
+spark的子版本可以通过`-Dspark.version=xxx` 来指定
+hadoop的子版本可以通过`-Dhadoop.version=xxx` 来指定
+
+举个例子 :
+```
+mvn install package -Pspark-3.2 -Phadoop-3.3 -Dspark.version=3.1.3
+```
\ No newline at end of file
diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/feature/remove-json4s-from-linkis.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/feature/remove-json4s-from-linkis.md
new file mode 100644
index 0000000000..02ed6b76a2
--- /dev/null
+++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/feature/remove-json4s-from-linkis.md
@@ -0,0 +1,11 @@
+---
+title:  linkis中移除json4s依赖
+sidebar_position: 0.2
+---
+
+## 1. 需求背景
+spark 不同版本依赖不同的json4s版本，不利于spark多版本的支持，我们需要减少这个json4s依赖，从linkis中移除json4s.
+比如: spark2.4 需要json4s v3.5.3, spark3.2需要json4s v3.7.0-M11
+
+## 2. 使用说明
+spark自定义版本源码编译时不需要修改json4s的依赖
\ No newline at end of file
diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/feature/remove-underlying-engine-depdency.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/feature/remove-underlying-engine-depdency.md
new file mode 100644
index 0000000000..81061b048b
--- /dev/null
+++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/feature/remove-underlying-engine-depdency.md
@@ -0,0 +1,17 @@
+---
+title: EngineConn模块定义依赖引擎版本
+sidebar_position: 0.2
+---
+
+## 1. 需求背景
+引擎的版本定义默认在 `EngineConn`中，一旦相关版本变更，需要修改多处，我们可以把相关的版本定义统一放到顶层pom文件中
+
+## 2. 使用说明
+编译指定引擎模块时，需要在项目根目录编译，并使用`-pl`来编译具体的引擎模块，比如：
+```
+mvn install package -pl linkis-engineconn-plugins/spark -Dspark.version=3.2.2
+
+```
+## 3. 注意事项
+引擎的版本可以通过mvn编译-D参数来指定，比如 -Dspark.version=xxx 、 -Dpresto.version=0.235
+目前所有的底层引擎版本新都已经移到顶层pom文件中，编译指定引擎模块时，需要在项目根目录编译，并使用`-pl`来编译具体的引擎模块
\ No newline at end of file
diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/feature/upgrade-base-engine-version.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/feature/upgrade-base-engine-version.md
new file mode 100644
index 0000000000..42f1c9277c
--- /dev/null
+++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/feature/upgrade-base-engine-version.md
@@ -0,0 +1,17 @@
+---
+title: 升级基础引擎版本到较新版本
+sidebar_position: 0.2
+---
+
+## 1. 需求背景
+目前我们已经支持不同版本的hadoop,hive,spark进行编译，并且低版本的引擎可能有潜在的风险点，我们可以升级默认的基础引擎版本到较新版本
+
+## 2. 使用说明
+默认hadoop版本从2.7.2升级到3.3.4,默认hive版本从2.3.3升级到3.1.3,默认spark版本从2.4.3升级到3.2.1
+
+## 3. 注意事项
+默认版本编译时，基础版本为：spark3.2.1+hadoop3.3.4+hive3.1.3
+```
+mvn install package
+```
+由于默认基础引擎的默认版本升级，`spark-3.2`、`hadoop-3.3`和`spark-2.4-hadoop-3.3` profile被移除，新增profile `hadoop-2.7` and `spark-2.4`.
\ No newline at end of file


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@linkis.apache.org
For additional commands, e-mail: commits-help@linkis.apache.org