You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "voonhous (via GitHub)" <gi...@apache.org> on 2026/09/13 10:59:39 UTC
[PR] chore(ci): [DNM] end-state measurement of the CI campaign [hudi]
voonhous opened a new pull request, #19937:
URL: https://github.com/apache/hudi/pull/19937
### Describe the issue this Pull Request addresses
Do not merge. Measurement only, for #19910: every open CI change on one branch, so the end state of the campaign gets its own runner-minute and longest-job samples. It is #19932 (the Scala stack on the CI stack) plus #19931 (job timeouts) and #19933 (hadoop-mr folded into utilities-rest). No code of its own.
### Summary and Changelog
- 13 Java CI jobs and 5 engine jobs, every one with a timeout.
- Four Scala SQL shards sharing one SparkContext and running two suites at a time.
Three samples, this run and two full reruns:
| metric | master baseline | + CI stack (#19919) | + Scala stack (#19932) | end state, sample 1 | sample 2 | sample 3 |
|---|---|---|---|---|---|---|
| runner-minutes per run | 615 | 516 to 551 | 491 to 514 | pending | pending | pending |
| longest job | 77 | 39 to 41 | 33 to 39 | pending | pending | pending |
| test jobs | 19 | 19 | 19 | 18 | 18 | 18 |
### Impact
None; closed after the samples.
### Risk Level
none
### Documentation Update
none
### Contributor's checklist
- [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [x] Enough context is provided in the sections above
- [x] Adequate tests were added if applicable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): [DNM] end-state measurement of the CI campaign [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #19937:
URL: https://github.com/apache/hudi/pull/19937#issuecomment-5652947011
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/19937?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `92.00000%` with `2 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 80.10%. Comparing base ([`648996f`](https://app.codecov.io/gh/apache/hudi/commit/648996f002c3c9e24a1e2bf53f97fe03e8bc4c81?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`209e195`](https://app.codecov.io/gh/apache/hudi/commit/209e195fcbefc75c7652b7a2086c89be057e61ea?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 7 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/19937?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...org/apache/hudi/index/HoodieInMemoryHashIndex.java](https://app.codecov.io/gh/apache/hudi/pull/19937?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Findex%2FHoodieInMemoryHashIndex.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2luZGV4L0hvb2RpZUluTWVtb3J5SGFzaEluZGV4LmphdmE=) | 83.33% | [2 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/19937?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #19937 +/- ##
============================================
- Coverage 80.20% 80.10% -0.11%
+ Complexity 34661 34582 -79
============================================
Files 2546 2546
Lines 142452 142622 +170
Branches 17330 17483 +153
============================================
- Hits 114260 114246 -14
- Misses 20281 20376 +95
- Partials 7911 8000 +89
```
| [Components](https://app.codecov.io/gh/apache/hudi/pull/19937/components?src=pr&el=components&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hudi-common](https://app.codecov.io/gh/apache/hudi/pull/19937/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `83.81% <ø> (-0.04%)` | :arrow_down: |
| [hudi-client](https://app.codecov.io/gh/apache/hudi/pull/19937/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `83.31% <83.33%> (+0.02%)` | :arrow_up: |
| [hudi-flink](https://app.codecov.io/gh/apache/hudi/pull/19937/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `84.70% <ø> (-0.88%)` | :arrow_down: |
| [hudi-spark-datasource](https://app.codecov.io/gh/apache/hudi/pull/19937/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `73.24% <ø> (-0.04%)` | :arrow_down: |
| [hudi-utilities](https://app.codecov.io/gh/apache/hudi/pull/19937/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `78.15% <ø> (-0.02%)` | :arrow_down: |
| [hudi-cli](https://app.codecov.io/gh/apache/hudi/pull/19937/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `69.99% <ø> (ø)` | |
| [hudi-hadoop](https://app.codecov.io/gh/apache/hudi/pull/19937/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `70.94% <100.00%> (+0.13%)` | :arrow_up: |
| [hudi-sync](https://app.codecov.io/gh/apache/hudi/pull/19937/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `76.02% <ø> (+0.02%)` | :arrow_up: |
| [hudi-io](https://app.codecov.io/gh/apache/hudi/pull/19937/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `81.61% <ø> (ø)` | |
| [hudi-timeline-service](https://app.codecov.io/gh/apache/hudi/pull/19937/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `84.33% <ø> (+0.98%)` | :arrow_up: |
| [hudi-cloud](https://app.codecov.io/gh/apache/hudi/pull/19937/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `80.99% <ø> (ø)` | |
| [hudi-kafka-connect](https://app.codecov.io/gh/apache/hudi/pull/19937/components?src=pr&el=component&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `53.96% <ø> (+0.76%)` | :arrow_up: |
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/19937/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [flink-integration-tests](https://app.codecov.io/gh/apache/hudi/pull/19937/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `35.55% <52.00%> (-13.57%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/19937?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...java/org/apache/hudi/common/util/ParquetUtils.java](https://app.codecov.io/gh/apache/hudi/pull/19937?src=pr&el=tree&filepath=hudi-hadoop-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fcommon%2Futil%2FParquetUtils.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1oYWRvb3AtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NvbW1vbi91dGlsL1BhcnF1ZXRVdGlscy5qYXZh) | `91.94% <100.00%> (+0.36%)` | :arrow_up: |
| [.../java/org/apache/hudi/hadoop/fs/HadoopFSUtils.java](https://app.codecov.io/gh/apache/hudi/pull/19937?src=pr&el=tree&filepath=hudi-hadoop-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fhadoop%2Ffs%2FHadoopFSUtils.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1oYWRvb3AtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hhZG9vcC9mcy9IYWRvb3BGU1V0aWxzLmphdmE=) | `84.57% <100.00%> (+0.33%)` | :arrow_up: |
| [...hudi/hadoop/fs/inline/InLineFsDataInputStream.java](https://app.codecov.io/gh/apache/hudi/pull/19937?src=pr&el=tree&filepath=hudi-hadoop-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fhadoop%2Ffs%2Finline%2FInLineFsDataInputStream.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1oYWRvb3AtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hhZG9vcC9mcy9pbmxpbmUvSW5MaW5lRnNEYXRhSW5wdXRTdHJlYW0uamF2YQ==) | `57.14% <100.00%> (+2.42%)` | :arrow_up: |
| [...org/apache/hudi/index/HoodieInMemoryHashIndex.java](https://app.codecov.io/gh/apache/hudi/pull/19937?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Findex%2FHoodieInMemoryHashIndex.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2luZGV4L0hvb2RpZUluTWVtb3J5SGFzaEluZGV4LmphdmE=) | `91.89% <83.33%> (-5.26%)` | :arrow_down: |
... and [137 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/19937/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
- :package: [JS Bundle Analysis](https://docs.codecov.com/docs/javascript-bundle-analysis): Save yourself from yourself by tracking and limiting bundle sizes in JS merges.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): [DNM] end-state measurement of the CI campaign [hudi]
Posted by "voonhous (via GitHub)" <gi...@apache.org>.
voonhous closed pull request #19937: chore(ci): [DNM] end-state measurement of the CI campaign
URL: https://github.com/apache/hudi/pull/19937
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): [DNM] end-state measurement of the CI campaign [hudi]
Posted by "voonhous (via GitHub)" <gi...@apache.org>.
voonhous commented on PR #19937:
URL: https://github.com/apache/hudi/pull/19937#issuecomment-5653661849
Three samples are on the description and on #19910, with the test-count parity check against master. Measurement only, closing as planned.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): [DNM] end-state measurement of the CI campaign [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19937:
URL: https://github.com/apache/hudi/pull/19937#issuecomment-5652969323
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "209e195fcbefc75c7652b7a2086c89be057e61ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "209e195fcbefc75c7652b7a2086c89be057e61ea",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 209e195fcbefc75c7652b7a2086c89be057e61ea UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): [DNM] end-state measurement of the CI campaign [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19937:
URL: https://github.com/apache/hudi/pull/19937#issuecomment-5652995196
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "209e195fcbefc75c7652b7a2086c89be057e61ea",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=17078",
"triggerID" : "209e195fcbefc75c7652b7a2086c89be057e61ea",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 209e195fcbefc75c7652b7a2086c89be057e61ea Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=17078)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] chore(ci): [DNM] end-state measurement of the CI campaign [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #19937:
URL: https://github.com/apache/hudi/pull/19937#issuecomment-5653520620
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "209e195fcbefc75c7652b7a2086c89be057e61ea",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=17078",
"triggerID" : "209e195fcbefc75c7652b7a2086c89be057e61ea",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 209e195fcbefc75c7652b7a2086c89be057e61ea Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=17078)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org