You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by yi...@apache.org on 2026/04/11 13:05:08 UTC
(doris) branch branch-4.1 updated: branch-4.1:[fix](fe) Preload paimon jindo for paimon scanner (#62349)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-4.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-4.1 by this push:
new 0fff0329f38 branch-4.1:[fix](fe) Preload paimon jindo for paimon scanner (#62349)
0fff0329f38 is described below
commit 0fff0329f382d1e321ffb89203b1f2dc4150df41
Author: Calvin Kirs <gu...@selectdb.com>
AuthorDate: Sat Apr 11 21:05:01 2026 +0800
branch-4.1:[fix](fe) Preload paimon jindo for paimon scanner (#62349)
#62350
`paimon-scanner` runs under a dedicated scanner classloader, while
`preload-extensions` is loaded from the parent classpath with higher
priority. Doris currently uses parent-first classloading for
scanner jars.
When `paimon-jindo` is packaged only inside `paimon-scanner`, runtime
may still resolve `org.apache.paimon.*` classes from the parent
classpath first. In this case, the Paimon `FileIO`/
`ServiceLoader` view seen at runtime is split across different
classloaders, and the Jindo file IO loader is not discovered correctly.
This can lead to errors like:
`org.apache.paimon.fs.UnsupportedSchemeException: Could not find a file
io implementation for scheme 'oss'`
This PR removes `paimon-jindo` from `paimon-scanner` and moves it to
`preload-extensions`, so the Jindo FileIO implementation is available
from the highest-priority parent classpath and stays
consistent with the Paimon core classes used during scanner execution.
This keeps the runtime dependency layout aligned with Doris' existing
classloading model and avoids scanner-local plugin jars being hidden by
parent-first resolution.
### What problem does this PR solve?
Issue Number: close #xxx
Related PR: #xxx
Problem Summary:
### Release note
None
### Check List (For Author)
- Test <!-- At least one of them must be included. -->
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason <!-- Add your reason? -->
- Behavior changed:
- [ ] No.
- [ ] Yes. <!-- Explain the behavior change -->
- Does this need documentation?
- [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
---
fe/be-java-extensions/paimon-scanner/pom.xml | 4 ----
fe/be-java-extensions/preload-extensions/pom.xml | 5 +++++
2 files changed, 5 insertions(+), 4 deletions(-)
diff --git a/fe/be-java-extensions/paimon-scanner/pom.xml b/fe/be-java-extensions/paimon-scanner/pom.xml
index 32d1e55cda0..60ff39c2681 100644
--- a/fe/be-java-extensions/paimon-scanner/pom.xml
+++ b/fe/be-java-extensions/paimon-scanner/pom.xml
@@ -60,10 +60,6 @@ under the License.
<groupId>org.apache.paimon</groupId>
<artifactId>paimon-format</artifactId>
</dependency>
- <dependency>
- <groupId>org.apache.paimon</groupId>
- <artifactId>paimon-jindo</artifactId>
- </dependency>
</dependencies>
diff --git a/fe/be-java-extensions/preload-extensions/pom.xml b/fe/be-java-extensions/preload-extensions/pom.xml
index a94f3ab69e1..c7d22571797 100644
--- a/fe/be-java-extensions/preload-extensions/pom.xml
+++ b/fe/be-java-extensions/preload-extensions/pom.xml
@@ -83,6 +83,11 @@ under the License.
<groupId>org.apache.paimon</groupId>
<artifactId>paimon-s3</artifactId>
</dependency>
+
+ <dependency>
+ <groupId>org.apache.paimon</groupId>
+ <artifactId>paimon-jindo</artifactId>
+ </dependency>
<!-- For Avro and Hudi Scanner PreLoad -->
<dependency>
<groupId>org.apache.hadoop</groupId>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org