You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "JeremyXin (via GitHub)" <gi...@apache.org> on 2026/06/12 10:13:00 UTC
[I] [Bug] [seatunnel-translation] seatunnel-translation-base test dependencies introduce unrelated connector modules into incremental IT builds [seatunnel]
JeremyXin opened a new issue, #11074:
URL: https://github.com/apache/seatunnel/issues/11074
### Search before asking
- [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
For CI optimization, one potential problem was identified as follows.
`seatunnel-translation-base` currently includes `connector-file-base` and `connector-doris` as test dependencies for ParallelSourceTest.
This causes unrelated connector incremental IT jobs to pull these modules into the Maven reactor through the shared translation -> starter -> e2e dependency chain.
As a result, changes in an unrelated connector such as `connector-elasticsearch-v2` may still trigger unnecessary build steps for `connector-file-base` or `connector-doris`, increasing CI cost and noise.
The root cause is that connector-specific test dependencies were added to a shared base module. ParallelSourceTest should verify the common split assignment behavior without depending on concrete connector implementations.
### SeaTunnel Version
2.3.13
### SeaTunnel Config
```conf
None
```
### Running Command
```shell
None
```
### Error Exception
```log
None
```
### Zeta or Flink or Spark Version
Zeta
### Java or Scala Version
Java 1.8
### Screenshots
<img width="2262" height="356" alt="Image" src="https://github.com/user-attachments/assets/cf7a5384-ad1e-4028-bed4-2f7d35135368" />
### Are you willing to submit PR?
- [x] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [seatunnel-translation] seatunnel-translation-base test dependencies introduce unrelated connector modules into incremental IT builds [seatunnel]
Posted by "DanielLeens (via GitHub)" <gi...@apache.org>.
DanielLeens commented on issue #11074:
URL: https://github.com/apache/seatunnel/issues/11074#issuecomment-4696885165
Small correction: GitHub is not accepting \ as an assignee on the repository side right now, so the issue assignment itself did not go through.\n\nThe main tracking path is still clear because PR #11075 is already open from the same reporter, so we can continue the implementation discussion there.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [seatunnel-translation] seatunnel-translation-base test dependencies introduce unrelated connector modules into incremental IT builds [seatunnel]
Posted by "DanielLeens (via GitHub)" <gi...@apache.org>.
DanielLeens commented on issue #11074:
URL: https://github.com/apache/seatunnel/issues/11074#issuecomment-4696885653
Small correction: GitHub is not accepting @JeremyXin as an assignee on the repository side right now, so the issue assignment itself did not go through.
The main tracking path is still clear because PR #11075 is already open from the same reporter, so we can continue the implementation discussion there.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [seatunnel-translation] seatunnel-translation-base test dependencies introduce unrelated connector modules into incremental IT builds [seatunnel]
Posted by "davidzollo (via GitHub)" <gi...@apache.org>.
davidzollo commented on issue #11074:
URL: https://github.com/apache/seatunnel/issues/11074#issuecomment-6376375660
Closing this issue as completed after rechecking the original report and its resolution.
`seatunnel-translation-base` no longer pulls `connector-file-base` and `connector-doris` into unrelated incremental builds through its test dependencies. The common split-assignment test uses mock source/split types instead.
Resolution evidence:
- [PR #11075](https://github.com/apache/seatunnel/pull/11075), merged into `dev` on 2026-06-22 ([merge commit `152c4108825a`](https://github.com/apache/seatunnel/commit/152c4108825a9bf614db912033c305360fb1dd03)).
The corresponding implementation remains present in [`dev` at `14a27ac26a0a`](https://github.com/apache/seatunnel/commit/14a27ac26a0a71b56722f86cdf8ec2779094ceaf).
<!-- seatunnel-closure-audit:20261023:11074 -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [seatunnel-translation] seatunnel-translation-base test dependencies introduce unrelated connector modules into incremental IT builds [seatunnel]
Posted by "DanielLeens (via GitHub)" <gi...@apache.org>.
DanielLeens commented on issue #11074:
URL: https://github.com/apache/seatunnel/issues/11074#issuecomment-4696882583
Thanks for writing this up clearly.
I checked the current test boundary in `seatunnel-translation-base`, and this does look like a real issue rather than just a CI preference.
The current base test module still declares `connector-file-base` and `connector-doris` as test dependencies, and `ParallelSourceTest` directly uses concrete File/Doris source classes to verify generic split-assignment behavior. That means unrelated connector changes can indeed pull extra modules into the Maven reactor through the shared translation path, which matches the CI expansion you described.
Since you marked that you are willing to submit a PR, and you already opened PR #11075 for the fix, I assigned this issue to you so we can track the implementation there.
Let's continue the concrete code discussion in #11075.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [seatunnel-translation] seatunnel-translation-base test dependencies introduce unrelated connector modules into incremental IT builds [seatunnel]
Posted by "davidzollo (via GitHub)" <gi...@apache.org>.
davidzollo closed issue #11074: [Bug] [seatunnel-translation] seatunnel-translation-base test dependencies introduce unrelated connector modules into incremental IT builds
URL: https://github.com/apache/seatunnel/issues/11074
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org