You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "voonhous (via GitHub)" <gi...@apache.org> on 2026/09/12 21:29:26 UTC
[PR] chore(ci): time out the Spark test jobs at 75 min [hudi]
voonhous opened a new pull request, #19931:
URL: https://github.com/apache/hudi/pull/19931
### Describe the issue this Pull Request addresses
Part of #19524, stacked on #19919. The nine Java 17 Spark test jobs have no `timeout-minutes`, so a job whose surefire fork stops answering runs to GitHub's six-hour default and holds a runner for that long.
### Summary and Changelog
- `timeout-minutes: 75` on `test-spark-java17-ut-functional`, `ut-other`, `ut-fat-and-ftc`, `fta`, `ftb`, `scala-dml-1`, `scala-dml-2`, `scala-other-1` and `scala-other-2`, the value `test-spark-client-and-hadoop-common` already uses. The other five test jobs already have one (40 to 90).
The longest of the nine measured 44 minutes on a slow runner under the resharded workflow, so the cap only fires on a hang.
<details>
<summary>The hang that motivated it</summary>
On attempt 3 of [run 34711686507](https://github.com/apache/hudi/actions/runs/34711686507), `ut-other` ([job 103611929617](https://github.com/apache/hudi/actions/runs/34711686507/job/103611929617)) finished all 184 hudi-common test classes green in 26 seconds, then printed nothing for 76 minutes: the surefire fork never reported completion, and the runner had to kill Maven and one fork JVM when the job was cancelled by hand. The same commit's two earlier attempts ran the job in 32 minutes. Surefire's `forkedProcessExitTimeoutInSeconds` did not fire because the fork never reached the exit path it guards.
</details>
### Impact
CI configuration only.
### Risk Level
low. A job that legitimately needs more than 75 minutes would fail; none of the nine has come within 30 minutes of that.
### Documentation Update
none
### Contributor's checklist
- [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [x] Enough context is provided in the sections above
- [x] Adequate tests were added if applicable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): time out the Spark test jobs at 75 min [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19931:
URL: https://github.com/apache/hudi/pull/19931#issuecomment-5650958252
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2910e59577e393dfdc238769ecd5e0bcd2c2a784",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=17062",
"triggerID" : "2910e59577e393dfdc238769ecd5e0bcd2c2a784",
"triggerType" : "PUSH"
}, {
"hash" : "53ef161452cc92dc333b272ff1b2c7018955ee5d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=17065",
"triggerID" : "53ef161452cc92dc333b272ff1b2c7018955ee5d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2910e59577e393dfdc238769ecd5e0bcd2c2a784 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=17062)
* 53ef161452cc92dc333b272ff1b2c7018955ee5d Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=17065)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): time out the Spark test jobs at 75 min [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19931:
URL: https://github.com/apache/hudi/pull/19931#issuecomment-5648864303
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2910e59577e393dfdc238769ecd5e0bcd2c2a784",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2910e59577e393dfdc238769ecd5e0bcd2c2a784",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2910e59577e393dfdc238769ecd5e0bcd2c2a784 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): time out the Spark test jobs at 75 min [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19931:
URL: https://github.com/apache/hudi/pull/19931#issuecomment-5649392422
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2910e59577e393dfdc238769ecd5e0bcd2c2a784",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=17062",
"triggerID" : "2910e59577e393dfdc238769ecd5e0bcd2c2a784",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2910e59577e393dfdc238769ecd5e0bcd2c2a784 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=17062)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): time out the Spark test jobs at 75 min [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #19931:
URL: https://github.com/apache/hudi/pull/19931#issuecomment-5648874944
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/19931?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:white_check_mark: All modified and coverable lines are covered by tests.
:white_check_mark: Project coverage is 80.19%. Comparing base ([`648996f`](https://app.codecov.io/gh/apache/hudi/commit/648996f002c3c9e24a1e2bf53f97fe03e8bc4c81?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`2910e59`](https://app.codecov.io/gh/apache/hudi/commit/2910e59577e393dfdc238769ecd5e0bcd2c2a784?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 7 commits behind head on master.
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #19931 +/- ##
============================================
- Coverage 80.20% 80.19% -0.02%
+ Complexity 34661 34660 -1
============================================
Files 2546 2546
Lines 142452 142608 +156
Branches 17330 17484 +154
============================================
+ Hits 114260 114368 +108
- Misses 20281 20283 +2
- Partials 7911 7957 +46
```
| [Components](https://app.codecov.io/gh/apache/hudi/pull/19931/components?src=pr&el=components&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hudi-common](https://app.codecov.io/gh/apache/hudi/pull/19931/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `83.80% <ø> (-0.04%)` | :arrow_down: |
| [hudi-client](https://app.codecov.io/gh/apache/hudi/pull/19931/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `83.31% <ø> (+0.03%)` | :arrow_up: |
| [hudi-flink](https://app.codecov.io/gh/apache/hudi/pull/19931/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `85.49% <ø> (-0.08%)` | :arrow_down: |
| [hudi-spark-datasource](https://app.codecov.io/gh/apache/hudi/pull/19931/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `73.21% <ø> (-0.07%)` | :arrow_down: |
| [hudi-utilities](https://app.codecov.io/gh/apache/hudi/pull/19931/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `78.15% <ø> (-0.02%)` | :arrow_down: |
| [hudi-cli](https://app.codecov.io/gh/apache/hudi/pull/19931/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `69.99% <ø> (ø)` | |
| [hudi-hadoop](https://app.codecov.io/gh/apache/hudi/pull/19931/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `70.90% <ø> (+0.09%)` | :arrow_up: |
| [hudi-sync](https://app.codecov.io/gh/apache/hudi/pull/19931/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `76.09% <ø> (+0.09%)` | :arrow_up: |
| [hudi-io](https://app.codecov.io/gh/apache/hudi/pull/19931/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `81.61% <ø> (ø)` | |
| [hudi-timeline-service](https://app.codecov.io/gh/apache/hudi/pull/19931/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `83.34% <ø> (ø)` | |
| [hudi-cloud](https://app.codecov.io/gh/apache/hudi/pull/19931/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `80.99% <ø> (ø)` | |
| [hudi-kafka-connect](https://app.codecov.io/gh/apache/hudi/pull/19931/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `53.20% <ø> (ø)` | |
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/19931/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/19931/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `43.83% <ø> (-0.09%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
[see 85 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/19931/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
- :package: [JS Bundle Analysis](https://docs.codecov.com/docs/javascript-bundle-analysis): Save yourself from yourself by tracking and limiting bundle sizes in JS merges.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): time out the Spark test jobs at 75 min [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19931:
URL: https://github.com/apache/hudi/pull/19931#issuecomment-5648892794
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2910e59577e393dfdc238769ecd5e0bcd2c2a784",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=17062",
"triggerID" : "2910e59577e393dfdc238769ecd5e0bcd2c2a784",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2910e59577e393dfdc238769ecd5e0bcd2c2a784 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=17062)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): time out the Spark test jobs at 75 min [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19931:
URL: https://github.com/apache/hudi/pull/19931#issuecomment-5650908926
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2910e59577e393dfdc238769ecd5e0bcd2c2a784",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=17062",
"triggerID" : "2910e59577e393dfdc238769ecd5e0bcd2c2a784",
"triggerType" : "PUSH"
}, {
"hash" : "53ef161452cc92dc333b272ff1b2c7018955ee5d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "53ef161452cc92dc333b272ff1b2c7018955ee5d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2910e59577e393dfdc238769ecd5e0bcd2c2a784 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=17062)
* 53ef161452cc92dc333b272ff1b2c7018955ee5d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): time out the Spark test jobs at 75 min [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19931:
URL: https://github.com/apache/hudi/pull/19931#issuecomment-5651415013
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2910e59577e393dfdc238769ecd5e0bcd2c2a784",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=17062",
"triggerID" : "2910e59577e393dfdc238769ecd5e0bcd2c2a784",
"triggerType" : "PUSH"
}, {
"hash" : "53ef161452cc92dc333b272ff1b2c7018955ee5d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=17065",
"triggerID" : "53ef161452cc92dc333b272ff1b2c7018955ee5d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 53ef161452cc92dc333b272ff1b2c7018955ee5d Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=17065)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org