You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "jackylee-ch (via GitHub)" <gi...@apache.org> on 2025/10/20 12:33:12 UTC
[PR] [spark] Refine paimon_sparkx_common dependency [paimon]
jackylee-ch opened a new pull request, #6435:
URL: https://github.com/apache/paimon/pull/6435
### Purpose
While executing `mvn test -Pspark4 -pl "org.apache.paimon:paimon-spark-4.0_2.13"`, I encountered a failure in the unit tests because `paimon-spark3-common` was being loaded.
<img width="2464" height="1158" alt="image" src="https://github.com/user-attachments/assets/a4ac23b4-9e09-4eb5-a81a-7eb3d9dae73b" />
Further investigation revealed that when running `mvn dependency:tree -pl "org.apache.paimon:paimon-spark-4.0_2.13"`, I could see the `paimon-spark3-common` dependency brought in via `paimon-spark-ut_2.13`. The root cause is that the profile defined in `paimon-spark-ut_2.13-1.4.0-SNAPSHOT.jar` was not being propagated, which caused the default `paimon-sparkx-common` configuration to be applied.
<img width="706" height="72" alt="image" src="https://github.com/user-attachments/assets/62cea389-1d7c-4efa-a6a2-4857097151cf" />
This PR resolves the issue by explicitly specifying the profile, ensuring that the profile metadata is passed along, and thus enabling `mvn test -Pspark4 -pl "org.apache.paimon:paimon-spark-4.0_2.13"` to run successfully.
### Tests
GA
### API and Format
No.
### Documentation
No.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [spark] Refine paimon_sparkx_common dependency [paimon]
Posted by "Zouxxyy (via GitHub)" <gi...@apache.org>.
Zouxxyy commented on PR #6435:
URL: https://github.com/apache/paimon/pull/6435#issuecomment-3758206574
Hi, I think I'm encountering the same issue. I tried your PR, but it didn't work for me. So I've submitted a new one—could you please give it a try? Thanks!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [spark] Refine paimon_sparkx_common dependency [paimon]
Posted by "Zouxxyy (via GitHub)" <gi...@apache.org>.
Zouxxyy commented on PR #6435:
URL: https://github.com/apache/paimon/pull/6435#issuecomment-3758285992
#7065 This was only avoided by using the `exclude` method. If you have a better way, please feel free to share it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [spark] Refine paimon_sparkx_common dependency [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi closed pull request #6435: [spark] Refine paimon_sparkx_common dependency
URL: https://github.com/apache/paimon/pull/6435
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [spark] Refine paimon_sparkx_common dependency [paimon]
Posted by "jackylee-ch (via GitHub)" <gi...@apache.org>.
jackylee-ch commented on PR #6435:
URL: https://github.com/apache/paimon/pull/6435#issuecomment-4534962375
@JingsongLi Hello, I see that the current PR is currently closed without merged. If it look good, would you consider merging it in?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org