(doris) 02/03: [fix](class-loader) fix class loader conflict on BE side (#29942)

[yi...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

yiguolei pushed a commit to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git

commit 12af86176a62347497bc3d5e07f72014872ae02c
Author: Mingyu Chen <mo...@163.com>
AuthorDate: Sun Jan 14 10:36:18 2024 +0800

    [fix](class-loader) fix class loader conflict on BE side (#29942)
    
    1. make `hadoop-common` in be java extension as `provided`.
    2. must load be java extension jars before hadoop jars
---
 bin/start_be.sh                                  | 2 ++
 fe/be-java-extensions/preload-extensions/pom.xml | 2 ++
 2 files changed, 4 insertions(+)

diff --git a/bin/start_be.sh b/bin/start_be.sh
index 434c06cfe34..046be07e36e 100755
--- a/bin/start_be.sh
+++ b/bin/start_be.sh
@@ -89,6 +89,8 @@ if [[ "${MAX_FILE_COUNT}" -lt 60000 ]]; then
 fi
 
 # add java libs
+# Must add hadoop libs, because we should load specified jars
+# instead of jars in hadoop libs, such as avro
 preload_jars=("preload-extensions")
 preload_jars+=("java-udf")
 
diff --git a/fe/be-java-extensions/preload-extensions/pom.xml b/fe/be-java-extensions/preload-extensions/pom.xml
index 830ee1ea8f4..a63c0a9b238 100644
--- a/fe/be-java-extensions/preload-extensions/pom.xml
+++ b/fe/be-java-extensions/preload-extensions/pom.xml
@@ -60,6 +60,8 @@ under the License.
         <dependency>
             <groupId>org.apache.hadoop</groupId>
             <artifactId>hadoop-common</artifactId>
+            <!-- Must be provided, we use hadoop_libs in BE's 3rd party instead -->
+            <scope>provided</scope>
         </dependency>
         <dependency>
             <groupId>org.apache.hudi</groupId>


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org