You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "yihua (via GitHub)" <gi...@apache.org> on 2026/08/04 22:19:04 UTC
[PR] chore(ci): trim the CI matrix and reset required checks to unblock PRs [hudi]
yihua opened a new pull request, #19514:
URL: https://github.com/apache/hudi/pull/19514
### Describe the issue this Pull Request addresses
ASF infra has disabled GitHub Actions on apache/hudi because of how much runner time the CI matrix consumes. Nothing can be verified or merged until the usage comes down, so this cuts the matrix to a size the project can afford to run today and resets branch protection to match.
### Summary and Changelog
Java CI (`.github/workflows/bot.yml`) keeps one configuration per area rather than the full cross-product: one Spark 3.5 lane on Java 11, one Spark 4.2 lane on Java 17, one Flink 2.1 lane, one Spark 3.5 and one Spark 4.2 bundle validation, and the Spark 3.5 integration tests. `validate-source` stays, since it is the ASF license and RAT check and finishes in under a minute. The Trino connector workflow is unchanged.
Everything dropped is commented out in place, not deleted, and marked `[CI-TRIM]`, so restoring a lane is a matter of stripping a `#` prefix. Parked jobs: `test-spark-java-tests-part1/2/3`, `test-spark-scala-dml-tests`, `test-spark-scala-other-tests`, `docker-java17-test`, `validate-bundles-java11`, `integration-tests-hive-sync`, `build-spark-java17`, `build-flink-java17`. Parked matrix entries: Spark 3.5, 4.0 and 4.1 rows from the five Java 17 datasource jobs, the Flink 1.18, 1.19, 1.20 and 2.0 rows from `test-flink-1`, and the non-kept rows from `validate-bundles` and `validate-bundle-spark4`.
`.asf.yaml` no longer lists the per-job contexts under `required_status_checks`. It keeps the four cheap gates (`validate-source`, `validate-pr`, `validate-pr-title`, `validate-commit-coauthor`) and adds `validate-ci-baseline`, a new do-nothing job in bot.yml. Because that context does not exist on master today, a PR that already collected green checks from the old matrix cannot merge on them: branch protection holds it until CI runs again. It is meant to be removed once no pre-trim PR is still open. Listing per-job contexts is also what made every matrix change a two-sided edit, so leaving them out keeps this reversible.
Two comments that the trim made inaccurate are corrected: the `paths:` rationale in `hudi_trino_ci.yml` (which cited `test-hudi-trino-plugin` being a required check) and the bot.yml line in `.github/workflows/README.md`. `hudi-integ-test/pom.xml` notes that nothing runs the integ2 suite while `integration-tests-hive-sync` is parked.
### Impact
No product code changes. The impact is on what CI catches, and it is worth being explicit about two gaps rather than discovering them later:
- Several profile-gated module trees are no longer compiled by any job: `hudi-spark-datasource/hudi-spark3.3.x|3.4.x|4.0.x|4.1.x` and `hudi-flink-datasource/hudi-flink1.18.x|1.19.x|1.20.x|2.0.x`. A change to a shared class that updates only the Spark 3.5 and 4.2 implementations will now pass every check and break those builds on master.
- The surviving `validate-bundles` row is scala-2.13, which takes the branch that packages only the Spark-side bundles, so `hudi-flink-bundle`, `hudi-kafka-connect-bundle` and `hudi-metaserver-server-bundle` are no longer built or validated anywhere. The `flink1.20` in that check's name is now only part of the rendered context string.
If the project wants a cheap backstop for the first gap, a compile-only (`-DskipTests`) lane over the parked profiles would cover it at a fraction of the runner cost of the jobs being parked. Happy to add it here or as a follow-up.
### Risk Level
low
The change is mechanical and reversible: every removed line has an exact commented-out counterpart, so restoring any lane is a prefix strip. Verified that both workflows still parse, that `actionlint` reports nothing beyond the pre-existing shellcheck info on untouched lines, and that every surviving job renders the exact check name it did before, since matrix key order determines that string and a mismatch would leave a required context pending forever. Also verified that no surviving job has a `needs:` on a parked job, that no workflow-level env var lost all its consumers, and that all five required contexts are produced by workflows that still trigger on `pull_request` against master.
One thing to sequence: `validate-ci-baseline` can only report once Actions is enabled on the repository again, so this should merge alongside or after the re-enable, not before.
### Documentation Update
none
### Contributor's checklist
- [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [x] Enough context is provided in the sections above
- [x] Adequate tests were added if applicable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): trim the CI matrix and reset required checks to unblock PRs [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on code in PR #19514:
URL: https://github.com/apache/hudi/pull/19514#discussion_r3717729156
##########
.github/workflows/bot.yml:
##########
@@ -32,6 +32,13 @@ env:
FLINK_IT_FILTER2: -Dit.test=!ITTestHoodieDataSource
jobs:
+ # [CI-TRIM] to revisit for CI improvement
+ validate-ci-baseline:
Review Comment:
`validate-ci-baseline` is used to indicate that the PR needs rebasing to pick up the trimmed CI run because it is a required check in `.asf.yaml`. Without rebasing, the CI run won't pass the required check, thus making it unmergeable as a forcing function. The author should only rebase the PR when needed to avoid flooding GitHub Actions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): trim the CI matrix and reset required checks to unblock PRs [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on code in PR #19514:
URL: https://github.com/apache/hudi/pull/19514#discussion_r3717731754
##########
.asf.yaml:
##########
@@ -47,75 +47,18 @@ github:
required_status_checks:
strict: false
contexts:
+ # The CI matrix in .github/workflows/bot.yml was cut down to unblock PRs after ASF
+ # infra disabled GitHub Actions on this repository over its runner usage. Listing
+ # the per-job contexts here is what made every matrix change a two-sided edit, so
+ # the test jobs are no longer required individually; reviewers gate on the checks
+ # the PR shows. `validate-ci-baseline` is a new context that only the reduced
+ # matrix produces, so a PR that collected its green checks before the trim cannot
+ # merge on them: branch protection holds it until CI runs again.
+ - validate-ci-baseline
Review Comment:
This is an interim change. Later on, we'll refactor and enhance the GitHub Actions jobs again and remove this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): trim the CI matrix and reset required checks to unblock PRs [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19514:
URL: https://github.com/apache/hudi/pull/19514#issuecomment-5195272716
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8cda980356f9f7b437d1102f0c0a5f21780ff7bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16068",
"triggerID" : "8cda980356f9f7b437d1102f0c0a5f21780ff7bc",
"triggerType" : "PUSH"
}, {
"hash" : "9bbf8c7e3c8b69edeacded66d3120b2002cc6953",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16070",
"triggerID" : "9bbf8c7e3c8b69edeacded66d3120b2002cc6953",
"triggerType" : "PUSH"
}, {
"hash" : "5b76e9f9463cd136978961224b493e89f65ffba9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16097",
"triggerID" : "5b76e9f9463cd136978961224b493e89f65ffba9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9bbf8c7e3c8b69edeacded66d3120b2002cc6953 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16070)
* 5b76e9f9463cd136978961224b493e89f65ffba9 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16097)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): trim the CI matrix and reset required checks to unblock PRs [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19514:
URL: https://github.com/apache/hudi/pull/19514#issuecomment-5185376361
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8cda980356f9f7b437d1102f0c0a5f21780ff7bc",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16068",
"triggerID" : "8cda980356f9f7b437d1102f0c0a5f21780ff7bc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8cda980356f9f7b437d1102f0c0a5f21780ff7bc Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16068)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): trim the CI matrix and reset required checks to unblock PRs [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19514:
URL: https://github.com/apache/hudi/pull/19514#issuecomment-5195208545
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8cda980356f9f7b437d1102f0c0a5f21780ff7bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16068",
"triggerID" : "8cda980356f9f7b437d1102f0c0a5f21780ff7bc",
"triggerType" : "PUSH"
}, {
"hash" : "9bbf8c7e3c8b69edeacded66d3120b2002cc6953",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16070",
"triggerID" : "9bbf8c7e3c8b69edeacded66d3120b2002cc6953",
"triggerType" : "PUSH"
}, {
"hash" : "5b76e9f9463cd136978961224b493e89f65ffba9",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b76e9f9463cd136978961224b493e89f65ffba9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9bbf8c7e3c8b69edeacded66d3120b2002cc6953 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16070)
* 5b76e9f9463cd136978961224b493e89f65ffba9 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): trim the CI matrix and reset required checks to unblock PRs [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19514:
URL: https://github.com/apache/hudi/pull/19514#issuecomment-5196223297
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8cda980356f9f7b437d1102f0c0a5f21780ff7bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16068",
"triggerID" : "8cda980356f9f7b437d1102f0c0a5f21780ff7bc",
"triggerType" : "PUSH"
}, {
"hash" : "9bbf8c7e3c8b69edeacded66d3120b2002cc6953",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16070",
"triggerID" : "9bbf8c7e3c8b69edeacded66d3120b2002cc6953",
"triggerType" : "PUSH"
}, {
"hash" : "5b76e9f9463cd136978961224b493e89f65ffba9",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16097",
"triggerID" : "5b76e9f9463cd136978961224b493e89f65ffba9",
"triggerType" : "PUSH"
}, {
"hash" : "fe3df716a772299d454e2ebb560f06dfcee30a96",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fe3df716a772299d454e2ebb560f06dfcee30a96",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5b76e9f9463cd136978961224b493e89f65ffba9 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16097)
* fe3df716a772299d454e2ebb560f06dfcee30a96 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): trim the CI matrix and reset required checks to unblock PRs [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19514:
URL: https://github.com/apache/hudi/pull/19514#issuecomment-5185493666
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8cda980356f9f7b437d1102f0c0a5f21780ff7bc",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16068",
"triggerID" : "8cda980356f9f7b437d1102f0c0a5f21780ff7bc",
"triggerType" : "PUSH"
}, {
"hash" : "9bbf8c7e3c8b69edeacded66d3120b2002cc6953",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9bbf8c7e3c8b69edeacded66d3120b2002cc6953",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8cda980356f9f7b437d1102f0c0a5f21780ff7bc Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16068)
* 9bbf8c7e3c8b69edeacded66d3120b2002cc6953 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): trim the CI matrix and reset required checks to unblock PRs [hudi]
Posted by "wombatu-kun (via GitHub)" <gi...@apache.org>.
wombatu-kun commented on code in PR #19514:
URL: https://github.com/apache/hudi/pull/19514#discussion_r3717550973
##########
.github/workflows/bot.yml:
##########
@@ -32,6 +32,13 @@ env:
FLINK_IT_FILTER2: -Dit.test=!ITTestHoodieDataSource
jobs:
+ # [CI-TRIM] to revisit for CI improvement
+ validate-ci-baseline:
Review Comment:
Following up on the `validate-ci-baseline` thread with a number, since it also changes the rebase ask in #19515.
Because the baseline job sits in `bot.yml`, a pre-trim PR cannot pick up the new context without triggering the whole workflow. I measured a recent full run at 2,610 runner-minutes (43.5 h); summing the same per-job times over the 17 surviving matrix entries gives an estimated ~10 h per run. So reviving one pre-trim PR costs roughly that, for a required check that is a single `echo`. There are 506 open PRs, which puts the full sweep at ~5,000 runner-hours, above the 3,600 h five-day limit on its own. Combined with the point above, the job currently pays the cost of the test jobs without gating on any of them.
Would it work to move `validate-ci-baseline` into its own small workflow? A PR would pick up the context in seconds, and the heavy matrix would run when someone actually pushes to it. That would also drop the rebase requirement for most PRs: `pull_request` here defaults to `[opened, synchronize, reopened]`, so a close/reopen re-reports on the same head SHA, and with `strict: false` and GHA building `refs/pull/N/merge` against current master, a rebase adds no signal over that except where the branch genuinely conflicts.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): trim the CI matrix and reset required checks to unblock PRs [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19514:
URL: https://github.com/apache/hudi/pull/19514#issuecomment-5186099814
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8cda980356f9f7b437d1102f0c0a5f21780ff7bc",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16068",
"triggerID" : "8cda980356f9f7b437d1102f0c0a5f21780ff7bc",
"triggerType" : "PUSH"
}, {
"hash" : "9bbf8c7e3c8b69edeacded66d3120b2002cc6953",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16070",
"triggerID" : "9bbf8c7e3c8b69edeacded66d3120b2002cc6953",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8cda980356f9f7b437d1102f0c0a5f21780ff7bc Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16068)
* 9bbf8c7e3c8b69edeacded66d3120b2002cc6953 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16070)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): trim the CI matrix and reset required checks to unblock PRs [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19514:
URL: https://github.com/apache/hudi/pull/19514#issuecomment-5185813459
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8cda980356f9f7b437d1102f0c0a5f21780ff7bc",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16068",
"triggerID" : "8cda980356f9f7b437d1102f0c0a5f21780ff7bc",
"triggerType" : "PUSH"
}, {
"hash" : "9bbf8c7e3c8b69edeacded66d3120b2002cc6953",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16070",
"triggerID" : "9bbf8c7e3c8b69edeacded66d3120b2002cc6953",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8cda980356f9f7b437d1102f0c0a5f21780ff7bc Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16068)
* 9bbf8c7e3c8b69edeacded66d3120b2002cc6953 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16070)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): trim the CI matrix and reset required checks to unblock PRs [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19514:
URL: https://github.com/apache/hudi/pull/19514#issuecomment-5185333194
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8cda980356f9f7b437d1102f0c0a5f21780ff7bc",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8cda980356f9f7b437d1102f0c0a5f21780ff7bc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8cda980356f9f7b437d1102f0c0a5f21780ff7bc UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): trim the CI matrix and reset required checks to unblock PRs [hudi]
Posted by "wombatu-kun (via GitHub)" <gi...@apache.org>.
wombatu-kun commented on code in PR #19514:
URL: https://github.com/apache/hudi/pull/19514#discussion_r3717450269
##########
.asf.yaml:
##########
@@ -47,75 +47,18 @@ github:
required_status_checks:
strict: false
contexts:
+ # The CI matrix in .github/workflows/bot.yml was cut down to unblock PRs after ASF
+ # infra disabled GitHub Actions on this repository over its runner usage. Listing
+ # the per-job contexts here is what made every matrix change a two-sided edit, so
+ # the test jobs are no longer required individually; reviewers gate on the checks
+ # the PR shows. `validate-ci-baseline` is a new context that only the reduced
+ # matrix produces, so a PR that collected its green checks before the trim cannot
+ # merge on them: branch protection holds it until CI runs again.
+ - validate-ci-baseline
Review Comment:
`validate-ci-baseline` has no `needs:`, so with every test context dropped and `allow_auto_merge` still enabled in this file, a PR with auto-merge on can land the moment the five cheap checks report, whatever the test jobs and Azure did. Is that acceptable for the interim, or should the baseline job depend on the surviving test jobs (with `if: always()` plus an explicit `needs.*.result` check) so one stable context still gates on them?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): trim the CI matrix and reset required checks to unblock PRs [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #19514:
URL: https://github.com/apache/hudi/pull/19514#issuecomment-5196461164
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/19514?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:white_check_mark: All modified and coverable lines are covered by tests.
:white_check_mark: Project coverage is 77.16%. Comparing base ([`1f8e53a`](https://app.codecov.io/gh/apache/hudi/commit/1f8e53a703fa0d3adb1a9d33855c8e1b69bc8612?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`fe3df71`](https://app.codecov.io/gh/apache/hudi/commit/fe3df716a772299d454e2ebb560f06dfcee30a96?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 3 commits behind head on master.
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #19514 +/- ##
============================================
- Coverage 77.17% 77.16% -0.01%
+ Complexity 33948 33946 -2
============================================
Files 2575 2576 +1
Lines 143397 143379 -18
Branches 17579 17576 -3
============================================
- Hits 110662 110643 -19
- Misses 24476 24478 +2
+ Partials 8259 8258 -1
```
| [Components](https://app.codecov.io/gh/apache/hudi/pull/19514/components?src=pr&el=components&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hudi-common](https://app.codecov.io/gh/apache/hudi/pull/19514/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `82.39% <0.00%> (-0.02%)` | :arrow_down: |
| [hudi-client](https://app.codecov.io/gh/apache/hudi/pull/19514/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `82.55% <ø> (ø)` | |
| [hudi-flink](https://app.codecov.io/gh/apache/hudi/pull/19514/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `83.97% <ø> (+<0.01%)` | :arrow_up: |
| [hudi-spark-datasource](https://app.codecov.io/gh/apache/hudi/pull/19514/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `75.10% <ø> (ø)` | |
| [hudi-utilities](https://app.codecov.io/gh/apache/hudi/pull/19514/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `73.63% <ø> (ø)` | |
| [hudi-cli](https://app.codecov.io/gh/apache/hudi/pull/19514/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `15.32% <ø> (ø)` | |
| [hudi-hadoop](https://app.codecov.io/gh/apache/hudi/pull/19514/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `63.74% <ø> (ø)` | |
| [hudi-sync](https://app.codecov.io/gh/apache/hudi/pull/19514/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `70.95% <ø> (ø)` | |
| [hudi-io](https://app.codecov.io/gh/apache/hudi/pull/19514/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `79.60% <ø> (ø)` | |
| [hudi-timeline-service](https://app.codecov.io/gh/apache/hudi/pull/19514/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `83.44% <ø> (ø)` | |
| [hudi-cloud](https://app.codecov.io/gh/apache/hudi/pull/19514/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `63.98% <ø> (-0.02%)` | :arrow_down: |
| [hudi-kafka-connect](https://app.codecov.io/gh/apache/hudi/pull/19514/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `53.20% <ø> (ø)` | |
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/19514/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/19514/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `43.75% <ø> (+0.04%)` | :arrow_up: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
- :package: [JS Bundle Analysis](https://docs.codecov.com/docs/javascript-bundle-analysis): Save yourself from yourself by tracking and limiting bundle sizes in JS merges.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): trim the CI matrix and reset required checks to unblock PRs [hudi]
Posted by "voonhous (via GitHub)" <gi...@apache.org>.
voonhous closed pull request #19514: chore(ci): trim the CI matrix and reset required checks to unblock PRs
URL: https://github.com/apache/hudi/pull/19514
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): trim the CI matrix and reset required checks to unblock PRs [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua merged PR #19514:
URL: https://github.com/apache/hudi/pull/19514
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): trim the CI matrix and reset required checks to unblock PRs [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19514:
URL: https://github.com/apache/hudi/pull/19514#issuecomment-5196348877
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8cda980356f9f7b437d1102f0c0a5f21780ff7bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16068",
"triggerID" : "8cda980356f9f7b437d1102f0c0a5f21780ff7bc",
"triggerType" : "PUSH"
}, {
"hash" : "9bbf8c7e3c8b69edeacded66d3120b2002cc6953",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16070",
"triggerID" : "9bbf8c7e3c8b69edeacded66d3120b2002cc6953",
"triggerType" : "PUSH"
}, {
"hash" : "5b76e9f9463cd136978961224b493e89f65ffba9",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16097",
"triggerID" : "5b76e9f9463cd136978961224b493e89f65ffba9",
"triggerType" : "PUSH"
}, {
"hash" : "fe3df716a772299d454e2ebb560f06dfcee30a96",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16103",
"triggerID" : "fe3df716a772299d454e2ebb560f06dfcee30a96",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5b76e9f9463cd136978961224b493e89f65ffba9 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16097)
* fe3df716a772299d454e2ebb560f06dfcee30a96 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16103)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): trim the CI matrix and reset required checks to unblock PRs [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19514:
URL: https://github.com/apache/hudi/pull/19514#issuecomment-5186360983
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8cda980356f9f7b437d1102f0c0a5f21780ff7bc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16068",
"triggerID" : "8cda980356f9f7b437d1102f0c0a5f21780ff7bc",
"triggerType" : "PUSH"
}, {
"hash" : "9bbf8c7e3c8b69edeacded66d3120b2002cc6953",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16070",
"triggerID" : "9bbf8c7e3c8b69edeacded66d3120b2002cc6953",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9bbf8c7e3c8b69edeacded66d3120b2002cc6953 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=16070)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org