You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "mahsoodebrahim (via GitHub)" <gi...@apache.org> on 2026/05/08 19:41:39 UTC
[PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
mahsoodebrahim opened a new pull request, #18709:
URL: https://github.com/apache/hudi/pull/18709
feat(spark): add show_inflight_commits and cleanup_stale_inflight_commits stored procedures
### Describe the issue this Pull Request addresses
A stuck inflight commit (write, compaction, log-compaction, or clustering) blocks async clean, archival, and subsequent compaction on a Hudi table. Today operators have to drop into `hudi-cli` and run a `repair rollback` per stuck instant — fine for single-table triage, awkward when an oncall is looking at several tables and just wants to inspect or remediate via Spark SQL.
This PR adds two `CALL` procedures so that workflow can stay in SQL.
### Summary and Changelog
Two new Spark SQL stored procedures:
**`show_inflight_commits(table, min_age_minutes?)`** — lists pending `REQUESTED` and `INFLIGHT` instants from the active timeline across all action types (write, rollback, clean, restore, indexing). The optional `min_age_minutes` filter narrows the result to stale instants only.
Output: `(instant_time, action, state)`.
**`cleanup_stale_inflight_commits(table, allowed_inflight_interval_minutes?, include_ingestion_commits?, dry_run?)`** — rolls back stale inflight write-timeline commits older than the threshold (default 180 minutes). Per-action routing:
- `COMMIT` / `DELTA_COMMIT` / `REPLACE_COMMIT` → `client.rollback()` (same pattern as `RollbackToInstantTimeProcedure`).
- `COMPACTION` / `LOG_COMPACTION` / `CLUSTERING` → dedicated `table.rollbackInflight*` methods, mirroring `RunRollbackInflightTableServiceProcedure.scala`. `HoodieSparkTable`, `tsClient`, and the pending-rollback lookup are constructed lazily on the first such instant — matched sets that contain no table-service inflights pay zero `HoodieSparkTable.create` overhead.
- `include_ingestion_commits` defaults to `false`. Opting in allows rollback of `COMMIT`/`DELTA_COMMIT` inflights, which can drop in-progress ingestion data; documented as a safety warning in the procedure's Scaladoc.
- `dry_run` defaults to `false`. When `true`, matched instants are listed with `rollback_status = NULL` ("matched but not actioned") and the write client is not constructed.
Output: `(instant_time, action, rollback_status)` where `rollback_status` is `true` = succeeded, `false` = failed, `NULL` = dry-run preview.
Files added:
- `hudi-spark-datasource/hudi-spark-common/src/main/java/org/apache/hudi/HoodieTimelineCleanupUtil.java` — single public method `inflightWriteCommitsOlderThan` backing the cleanup procedure.
- `hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/ShowInflightCommitsProcedure.scala`
- `hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/CleanupStaleInflightCommitsProcedure.scala`
- `hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/procedure/TestShowInflightCommitsProcedure.scala`
- `hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/procedure/TestCleanupStaleInflightCommitsProcedure.scala`
Files modified:
- `hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/HoodieProcedures.scala` — register the two new procedures (2 lines).
### Impact
**Public API.** Adds two new `CALL` procedure names (`show_inflight_commits`, `cleanup_stale_inflight_commits`) and one new public utility class (`org.apache.hudi.HoodieTimelineCleanupUtil`). The output schemas are part of the procedures' going-forward contracts:
- `show_inflight_commits`: `(instant_time STRING, action STRING, state STRING)`. The `state` column distinguishes `REQUESTED` from `INFLIGHT`, which is useful when triaging — a `REQUESTED` instant can usually be deleted directly while an `INFLIGHT` one needs a true rollback.
- `cleanup_stale_inflight_commits`: `(instant_time STRING, action STRING, rollback_status BOOLEAN nullable)`. `rollback_status` is three-valued: `true` = succeeded, `false` = failed, `NULL` = dry-run preview.
**Performance.** No impact on existing code paths. Within the cleanup procedure, the `HoodieSparkTable` / `tsClient` / pending-rollback lookup state is `lazy val`, so tables whose matched-instant set contains no compaction / log-compaction / clustering pay zero `HoodieSparkTable.create` overhead. Dry-run mode skips `HoodieCLIUtils.createHoodieWriteClient` entirely.
**No breaking changes.**
### Risk Level
**low** — additive only:
- 5 new files plus a 2-line registration edit in `HoodieProcedures.scala`. No existing procedure or write-path behavior is modified.
- Per-action rollback routing reuses APIs already invoked in `RollbackToInstantTimeProcedure` and `RunRollbackInflightTableServiceProcedure`; no new low-level rollback logic is introduced.
- Each per-instant rollback is wrapped in a `try`/`catch`; failures are surfaced as `rollback_status = false` rather than aborting the procedure mid-set.
- 13 unit tests cover the empty / threshold / `include_ingestion_commits` gating / `dry_run` paths plus the dedicated `COMPACTION_ACTION`, `CLUSTERING_ACTION`, partitioned-COW, and MOR `DELTA_COMMIT_ACTION` branches. `mvn checkstyle:check` and `mvn scalastyle:check` are both clean.
The defensive `try`/`catch` arms (rollback throws → `rollback_status = false`) are not directly exercised by tests because triggering them deterministically requires fabricating timeline corruption; the arms mirror the same pattern used elsewhere and are intentionally minimal.
### Documentation Update
A follow-up website PR against `apache/hudi-site` is needed to document the two new procedures alongside the existing `CALL` procedure docs. No new configs are added and no default values of existing configs are changed.
### Contributor's checklist
- [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [x] Enough context is provided in the sections above
- [x] Adequate tests were added if applicable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412619012
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.92857%` with `102 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 58.45%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 6.45% | [58 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (34e9c7c) and HEAD (a63d034). Click for more details.
>
> <details><summary>HEAD has 19 uploads less than BASE</summary>
>
>| Flag | BASE (34e9c7c) | HEAD (a63d034) |
>|------|------|------|
>|spark-scala-tests|12|6|
>|spark-java-tests|18|6|
>|utilities|1|0|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 67.92% 58.45% -9.47%
+ Complexity 29003 24995 -4008
============================================
Files 2522 2525 +3
Lines 141166 141289 +123
Branches 17506 17524 +18
============================================
- Hits 95881 82597 -13284
- Misses 37415 51313 +13898
+ Partials 7870 7379 -491
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.38% <0.00%> (+0.21%)` | :arrow_up: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.54% <0.00%> (-17.46%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.70% <8.92%> (-12.20%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `6.45% <6.45%> (ø)` | |
... and [682 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4483558359
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "a63d034124180364c70b37770bbc0f4a5590e46e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=13903",
"triggerID" : "a63d034124180364c70b37770bbc0f4a5590e46e",
"triggerType" : "PUSH"
}, {
"hash" : "807cd801412175073cea62b801a8955e7983b48f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "807cd801412175073cea62b801a8955e7983b48f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a63d034124180364c70b37770bbc0f4a5590e46e Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=13903)
* 807cd801412175073cea62b801a8955e7983b48f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484756973
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `88.98305%` with `13 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 68.18%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 82.35% | [5 Missing and 7 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
+ Coverage 68.16% 68.18% +0.01%
- Complexity 29158 29192 +34
============================================
Files 2521 2524 +3
Lines 141371 141489 +118
Branches 17549 17560 +11
============================================
+ Hits 96365 96472 +107
- Misses 37076 37078 +2
- Partials 7930 7939 +9
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.39% <0.00%> (-0.04%)` | :arrow_down: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.87% <0.00%> (-0.08%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.91% <88.98%> (+0.07%)` | :arrow_up: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.52% <0.00%> (-0.05%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `82.35% <82.35%> (ø)` | |
... and [16 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "mahsoodebrahim (via GitHub)" <gi...@apache.org>.
mahsoodebrahim commented on code in PR #18709:
URL: https://github.com/apache/hudi/pull/18709#discussion_r3263054086
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/CleanupStaleInflightCommitsProcedure.scala:
##########
@@ -0,0 +1,209 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi.command.procedures
+
+import org.apache.hudi.{HoodieCLIUtils, HoodieTimelineCleanupUtil}
+import org.apache.hudi.client.SparkRDDWriteClient
+import org.apache.hudi.common.HoodiePendingRollbackInfo
+import org.apache.hudi.common.table.HoodieTableMetaClient
+import org.apache.hudi.common.table.timeline.HoodieTimeline
+import org.apache.hudi.common.util.{Option => HOption}
+import org.apache.hudi.config.HoodieWriteConfig
+import org.apache.hudi.hadoop.fs.HadoopFSUtils
+import org.apache.hudi.table.HoodieSparkTable
+
+import org.apache.spark.internal.Logging
+import org.apache.spark.sql.Row
+import org.apache.spark.sql.types.{DataTypes, Metadata, StructField, StructType}
+
+import java.util.function.Supplier
+
+import scala.collection.JavaConverters._
+
+/**
+ * Spark SQL stored procedure to roll back stale inflight write commits older than a configurable
+ * age threshold.
+ *
+ * SAFETY WARNING: Unlike rollback_to_instant_time which targets a single named instant, this
+ * procedure rolls back a SET of instants matched by age. A misconfigured threshold can erase
+ * recent in-progress writes when include_ingestion_commits=true. Operators should call
+ * show_inflight_commits first to preview the pending instants, and use dry_run => true (see
+ * below) when in doubt about which instants will be processed.
+ *
+ * This procedure targets the write timeline (COMMIT, DELTA_COMMIT, COMPACTION, LOG_COMPACTION,
+ * REPLACE_COMMIT, CLUSTERING actions). Stale rollback, clean, or restore inflights visible in
+ * show_inflight_commits are NOT covered by this procedure.
+ *
+ * Compaction, log-compaction, and clustering inflights are handled via the targeted table
+ * methods (table.rollbackInflightCompaction / rollbackInflightLogCompaction /
+ * rollbackInflightClustering) — the supporting state (HoodieSparkTable, table-service client,
+ * pending-rollback lookup) is constructed lazily on the first such instant and reused.
+ *
+ * Parameters:
+ * - table: Required. Catalog name of the Hudi table.
+ * - allowed_inflight_interval_minutes: Optional (default 180). Instants older than this many
+ * minutes are considered stale and eligible for rollback.
+ * - include_ingestion_commits: Optional (default false). DANGEROUS when true: enabling
+ * this allows the procedure to roll back COMMIT_ACTION and
+ * DELTA_COMMIT_ACTION inflights, which means it can drop
+ * in-progress ingestion data. The default false is the
+ * safe choice; true is for operators recovering from a
+ * known-stuck ingestion job.
+ * - dry_run: Optional (default false). When true, the matched-instant
+ * set is resolved exactly as in normal mode but no rollback
+ * calls are issued. Each returned row carries
+ * rollback_status = NULL meaning "matched but not acted
+ * upon". Re-run with dry_run => false to act.
+ *
+ * Output columns (one row per processed instant):
+ * - instant_time: The instant's requested timestamp.
+ * - action: The action type.
+ * - rollback_status: true if the rollback succeeded, false if the rollback failed,
+ * NULL if dry_run was true (matched but not actioned).
+ *
+ * Example usage:
+ * {{{
+ * -- Clean stale table-service inflights (default 180-min threshold)
+ * CALL cleanup_stale_inflight_commits(table => 'my_table');
+ *
+ * -- Preview what would be processed without acting
+ * CALL cleanup_stale_inflight_commits(table => 'my_table', dry_run => true);
+ *
+ * -- Clean stale inflights older than 1 hour, including ingestion commits (DANGEROUS)
+ * CALL cleanup_stale_inflight_commits(
+ * table => 'my_table',
+ * allowed_inflight_interval_minutes => 60,
+ * include_ingestion_commits => true
+ * );
+ * }}}
+ *
+ * For inflight commit types not covered by this procedure (clean, restore, rollback inflights),
+ * use hudi-cli's `repair rollback` command.
+ */
+class CleanupStaleInflightCommitsProcedure extends BaseProcedure with ProcedureBuilder with Logging {
+
+ private val PARAMETERS = Array[ProcedureParameter](
+ ProcedureParameter.required(0, "table", DataTypes.StringType),
+ ProcedureParameter.optional(1, "allowed_inflight_interval_minutes", DataTypes.IntegerType, 180),
+ ProcedureParameter.optional(2, "include_ingestion_commits", DataTypes.BooleanType, false),
+ ProcedureParameter.optional(3, "dry_run", DataTypes.BooleanType, false)
+ )
+
+ private val OUTPUT_TYPE = new StructType(Array[StructField](
+ StructField("instant_time", DataTypes.StringType, nullable = true, Metadata.empty),
+ StructField("action", DataTypes.StringType, nullable = true, Metadata.empty),
+ StructField("rollback_status", DataTypes.BooleanType, nullable = true, Metadata.empty)
+ ))
+
+ override def parameters: Array[ProcedureParameter] = PARAMETERS
+
+ override def outputType: StructType = OUTPUT_TYPE
+
+ override def build: Procedure = new CleanupStaleInflightCommitsProcedure()
+
+ override def call(args: ProcedureArgs): Seq[Row] = {
+ super.checkArgs(PARAMETERS, args)
+
+ val tableName = getArgValueOrDefault(args, PARAMETERS(0))
+ val allowedMinutes = getArgValueOrDefault(args, PARAMETERS(1)).get.asInstanceOf[Int]
+ val includeIngestionCommits = getArgValueOrDefault(args, PARAMETERS(2)).get.asInstanceOf[Boolean]
+ val dryRun = getArgValueOrDefault(args, PARAMETERS(3)).get.asInstanceOf[Boolean]
+
+ val basePath = getBasePath(tableName)
+ val metaClient = HoodieTableMetaClient.builder
+ .setConf(HadoopFSUtils.getStorageConfWithCopy(jsc.hadoopConfiguration))
+ .setBasePath(basePath)
+ .build
+
+ val staleInflights = HoodieTimelineCleanupUtil
+ .inflightWriteCommitsOlderThan(metaClient, allowedMinutes.toLong, includeIngestionCommits)
+
+ if (staleInflights.isEmpty) {
+ Seq.empty[Row]
+ } else if (dryRun) {
+ // Dry-run: do not open the table for write — emit preview rows with NULL rollback_status
+ // to mean "matched but not actioned". Re-run with dry_run => false to act.
+ staleInflights.asScala.map { instant =>
+ Row(instant.requestedTime, instant.getAction, null)
+ }.toSeq
+ } else {
+ // Pass ROLLBACK_USING_MARKERS_ENABLE=false via the createHoodieWriteClient confs Map.
+ // Inflight commits may not have marker files, so timeline-based rollback is required.
+ // The user-specified confs win over defaults / table config / session conf — see
+ // HoodieCLIUtils.scala "Priority: defaults < catalog props < table config < sparkSession conf < specified conf".
+ val confs = Map(HoodieWriteConfig.ROLLBACK_USING_MARKERS_ENABLE.key() -> "false")
+ var client: SparkRDDWriteClient[_] = null
+ try {
+ client = HoodieCLIUtils.createHoodieWriteClient(sparkSession, basePath, confs,
+ tableName.asInstanceOf[scala.Option[String]])
+
+ // Lazy state for compaction / log-compaction / clustering branches.
+ // For matched sets that contain no such instants, none of these are constructed.
+ lazy val tsClient = client.getTableServiceClient
+ lazy val table = HoodieSparkTable.create(client.getConfig, client.getEngineContext)
+ lazy val getPendingRollbackInstantFunc: java.util.function.Function[String, HOption[HoodiePendingRollbackInfo]] =
+ new java.util.function.Function[String, HOption[HoodiePendingRollbackInfo]] {
+ override def apply(commitToRollback: String): HOption[HoodiePendingRollbackInfo] = {
+ tsClient.getPendingRollbackInfo(table.getMetaClient, commitToRollback, false)
+ }
+ }
+
+ val rows = staleInflights.asScala.map { instant =>
+ val status: java.lang.Boolean = try {
+ val result: Boolean = instant.getAction match {
+ case HoodieTimeline.COMPACTION_ACTION =>
Review Comment:
Good catch. Added an explicit inflight-state recheck in the case _ => branch before calling client.rollback():
```
val stillInflight = metaClient.reloadActiveTimeline()
.filterInflightsAndRequested()
.containsInstant(instant.requestedTime)
if (!stillInflight) {
logWarning(...)
false
} else {
client.rollback(instant.requestedTime)
}
```
This reloads the active timeline immediately before the rollback call and skips it if the instant is no longer `INFLIGHT/REQUESTED`, returning `rollback_status = false` with a warning instead of rolling back a now-completed commit. The `table.rollbackInflight*` branches above already fail loudly via `revertInstantFromInflightToRequested` if the inflight is gone — this brings the `client.rollback()` branch to the same level of safety.
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/CleanupStaleInflightCommitsProcedure.scala:
##########
@@ -0,0 +1,209 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi.command.procedures
+
+import org.apache.hudi.{HoodieCLIUtils, HoodieTimelineCleanupUtil}
+import org.apache.hudi.client.SparkRDDWriteClient
+import org.apache.hudi.common.HoodiePendingRollbackInfo
+import org.apache.hudi.common.table.HoodieTableMetaClient
+import org.apache.hudi.common.table.timeline.HoodieTimeline
+import org.apache.hudi.common.util.{Option => HOption}
+import org.apache.hudi.config.HoodieWriteConfig
+import org.apache.hudi.hadoop.fs.HadoopFSUtils
+import org.apache.hudi.table.HoodieSparkTable
+
+import org.apache.spark.internal.Logging
+import org.apache.spark.sql.Row
+import org.apache.spark.sql.types.{DataTypes, Metadata, StructField, StructType}
+
+import java.util.function.Supplier
+
+import scala.collection.JavaConverters._
+
+/**
+ * Spark SQL stored procedure to roll back stale inflight write commits older than a configurable
+ * age threshold.
+ *
+ * SAFETY WARNING: Unlike rollback_to_instant_time which targets a single named instant, this
+ * procedure rolls back a SET of instants matched by age. A misconfigured threshold can erase
+ * recent in-progress writes when include_ingestion_commits=true. Operators should call
+ * show_inflight_commits first to preview the pending instants, and use dry_run => true (see
+ * below) when in doubt about which instants will be processed.
+ *
+ * This procedure targets the write timeline (COMMIT, DELTA_COMMIT, COMPACTION, LOG_COMPACTION,
+ * REPLACE_COMMIT, CLUSTERING actions). Stale rollback, clean, or restore inflights visible in
+ * show_inflight_commits are NOT covered by this procedure.
+ *
+ * Compaction, log-compaction, and clustering inflights are handled via the targeted table
+ * methods (table.rollbackInflightCompaction / rollbackInflightLogCompaction /
+ * rollbackInflightClustering) — the supporting state (HoodieSparkTable, table-service client,
+ * pending-rollback lookup) is constructed lazily on the first such instant and reused.
+ *
+ * Parameters:
+ * - table: Required. Catalog name of the Hudi table.
+ * - allowed_inflight_interval_minutes: Optional (default 180). Instants older than this many
+ * minutes are considered stale and eligible for rollback.
+ * - include_ingestion_commits: Optional (default false). DANGEROUS when true: enabling
+ * this allows the procedure to roll back COMMIT_ACTION and
+ * DELTA_COMMIT_ACTION inflights, which means it can drop
+ * in-progress ingestion data. The default false is the
+ * safe choice; true is for operators recovering from a
+ * known-stuck ingestion job.
+ * - dry_run: Optional (default false). When true, the matched-instant
+ * set is resolved exactly as in normal mode but no rollback
+ * calls are issued. Each returned row carries
+ * rollback_status = NULL meaning "matched but not acted
+ * upon". Re-run with dry_run => false to act.
+ *
+ * Output columns (one row per processed instant):
+ * - instant_time: The instant's requested timestamp.
+ * - action: The action type.
+ * - rollback_status: true if the rollback succeeded, false if the rollback failed,
+ * NULL if dry_run was true (matched but not actioned).
+ *
+ * Example usage:
+ * {{{
+ * -- Clean stale table-service inflights (default 180-min threshold)
+ * CALL cleanup_stale_inflight_commits(table => 'my_table');
+ *
+ * -- Preview what would be processed without acting
+ * CALL cleanup_stale_inflight_commits(table => 'my_table', dry_run => true);
+ *
+ * -- Clean stale inflights older than 1 hour, including ingestion commits (DANGEROUS)
+ * CALL cleanup_stale_inflight_commits(
+ * table => 'my_table',
+ * allowed_inflight_interval_minutes => 60,
+ * include_ingestion_commits => true
+ * );
+ * }}}
+ *
+ * For inflight commit types not covered by this procedure (clean, restore, rollback inflights),
+ * use hudi-cli's `repair rollback` command.
+ */
+class CleanupStaleInflightCommitsProcedure extends BaseProcedure with ProcedureBuilder with Logging {
+
+ private val PARAMETERS = Array[ProcedureParameter](
+ ProcedureParameter.required(0, "table", DataTypes.StringType),
+ ProcedureParameter.optional(1, "allowed_inflight_interval_minutes", DataTypes.IntegerType, 180),
+ ProcedureParameter.optional(2, "include_ingestion_commits", DataTypes.BooleanType, false),
+ ProcedureParameter.optional(3, "dry_run", DataTypes.BooleanType, false)
+ )
+
+ private val OUTPUT_TYPE = new StructType(Array[StructField](
+ StructField("instant_time", DataTypes.StringType, nullable = true, Metadata.empty),
+ StructField("action", DataTypes.StringType, nullable = true, Metadata.empty),
+ StructField("rollback_status", DataTypes.BooleanType, nullable = true, Metadata.empty)
+ ))
+
+ override def parameters: Array[ProcedureParameter] = PARAMETERS
+
+ override def outputType: StructType = OUTPUT_TYPE
+
+ override def build: Procedure = new CleanupStaleInflightCommitsProcedure()
+
+ override def call(args: ProcedureArgs): Seq[Row] = {
+ super.checkArgs(PARAMETERS, args)
+
+ val tableName = getArgValueOrDefault(args, PARAMETERS(0))
+ val allowedMinutes = getArgValueOrDefault(args, PARAMETERS(1)).get.asInstanceOf[Int]
+ val includeIngestionCommits = getArgValueOrDefault(args, PARAMETERS(2)).get.asInstanceOf[Boolean]
+ val dryRun = getArgValueOrDefault(args, PARAMETERS(3)).get.asInstanceOf[Boolean]
+
+ val basePath = getBasePath(tableName)
+ val metaClient = HoodieTableMetaClient.builder
+ .setConf(HadoopFSUtils.getStorageConfWithCopy(jsc.hadoopConfiguration))
+ .setBasePath(basePath)
+ .build
+
+ val staleInflights = HoodieTimelineCleanupUtil
+ .inflightWriteCommitsOlderThan(metaClient, allowedMinutes.toLong, includeIngestionCommits)
+
+ if (staleInflights.isEmpty) {
+ Seq.empty[Row]
+ } else if (dryRun) {
+ // Dry-run: do not open the table for write — emit preview rows with NULL rollback_status
+ // to mean "matched but not actioned". Re-run with dry_run => false to act.
+ staleInflights.asScala.map { instant =>
+ Row(instant.requestedTime, instant.getAction, null)
+ }.toSeq
+ } else {
+ // Pass ROLLBACK_USING_MARKERS_ENABLE=false via the createHoodieWriteClient confs Map.
+ // Inflight commits may not have marker files, so timeline-based rollback is required.
+ // The user-specified confs win over defaults / table config / session conf — see
+ // HoodieCLIUtils.scala "Priority: defaults < catalog props < table config < sparkSession conf < specified conf".
+ val confs = Map(HoodieWriteConfig.ROLLBACK_USING_MARKERS_ENABLE.key() -> "false")
+ var client: SparkRDDWriteClient[_] = null
+ try {
+ client = HoodieCLIUtils.createHoodieWriteClient(sparkSession, basePath, confs,
+ tableName.asInstanceOf[scala.Option[String]])
+
+ // Lazy state for compaction / log-compaction / clustering branches.
+ // For matched sets that contain no such instants, none of these are constructed.
+ lazy val tsClient = client.getTableServiceClient
+ lazy val table = HoodieSparkTable.create(client.getConfig, client.getEngineContext)
+ lazy val getPendingRollbackInstantFunc: java.util.function.Function[String, HOption[HoodiePendingRollbackInfo]] =
+ new java.util.function.Function[String, HOption[HoodiePendingRollbackInfo]] {
+ override def apply(commitToRollback: String): HOption[HoodiePendingRollbackInfo] = {
+ tsClient.getPendingRollbackInfo(table.getMetaClient, commitToRollback, false)
+ }
+ }
+
+ val rows = staleInflights.asScala.map { instant =>
+ val status: java.lang.Boolean = try {
+ val result: Boolean = instant.getAction match {
+ case HoodieTimeline.COMPACTION_ACTION =>
Review Comment:
Added an explicit inflight-state recheck in the case _ => branch before calling client.rollback():
```
val stillInflight = metaClient.reloadActiveTimeline()
.filterInflightsAndRequested()
.containsInstant(instant.requestedTime)
if (!stillInflight) {
logWarning(...)
false
} else {
client.rollback(instant.requestedTime)
}
```
This reloads the active timeline immediately before the rollback call and skips it if the instant is no longer `INFLIGHT/REQUESTED`, returning `rollback_status = false` with a warning instead of rolling back a now-completed commit. The `table.rollbackInflight*` branches above already fail loudly via `revertInstantFromInflightToRequested` if the inflight is gone — this brings the `client.rollback()` branch to the same level of safety.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484611376
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.47458%` with `108 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 47.15%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 5.88% | [64 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (9026c7d) and HEAD (807cd80). Click for more details.
>
> <details><summary>HEAD has 23 uploads less than BASE</summary>
>
>| Flag | BASE (9026c7d) | HEAD (807cd80) |
>|------|------|------|
>|spark-scala-tests|12|4|
>|utilities|1|0|
>|common-and-other-modules|1|0|
>|spark-java-tests|18|5|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 68.16% 47.15% -21.02%
+ Complexity 29158 16846 -12312
=============================================
Files 2521 2057 -464
Lines 141371 117686 -23685
Branches 17549 15316 -2233
=============================================
- Hits 96365 55494 -40871
- Misses 37076 56204 +19128
+ Partials 7930 5988 -1942
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.86% <0.00%> (-17.09%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.88% <8.47%> (-11.97%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `5.88% <5.88%> (ø)` | |
... and [1568 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412611607
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.92857%` with `102 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 48.15%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 6.45% | [58 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (34e9c7c) and HEAD (a63d034). Click for more details.
>
> <details><summary>HEAD has 26 uploads less than BASE</summary>
>
>| Flag | BASE (34e9c7c) | HEAD (a63d034) |
>|------|------|------|
>|spark-scala-tests|12|5|
>|spark-java-tests|18|1|
>|common-and-other-modules|1|0|
>|utilities|1|0|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 67.92% 48.15% -19.77%
+ Complexity 29003 16843 -12160
=============================================
Files 2522 2031 -491
Lines 141166 114792 -26374
Branches 17506 14710 -2796
=============================================
- Hits 95881 55281 -40600
- Misses 37415 53516 +16101
+ Partials 7870 5995 -1875
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.02% <0.00%> (-15.98%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.80% <8.92%> (-12.10%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `6.45% <6.45%> (ø)` | |
... and [1578 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412652138
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `91.96429%` with `9 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 68.17%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 87.09% | [2 Missing and 6 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
+ Coverage 67.92% 68.17% +0.25%
- Complexity 29003 29113 +110
============================================
Files 2522 2525 +3
Lines 141166 141289 +123
Branches 17506 17524 +18
============================================
+ Hits 95881 96319 +438
+ Misses 37415 37059 -356
- Partials 7870 7911 +41
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.38% <0.00%> (+0.21%)` | :arrow_up: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.89% <0.00%> (-0.10%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.96% <91.96%> (+0.06%)` | :arrow_up: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.59% <0.00%> (-0.04%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `87.09% <87.09%> (ø)` | |
... and [21 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484576376
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.47458%` with `108 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 46.69%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 5.88% | [64 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (9026c7d) and HEAD (807cd80). Click for more details.
>
> <details><summary>HEAD has 31 uploads less than BASE</summary>
>
>| Flag | BASE (9026c7d) | HEAD (807cd80) |
>|------|------|------|
>|spark-scala-tests|12|1|
>|utilities|1|0|
>|common-and-other-modules|1|0|
>|spark-java-tests|18|0|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 68.16% 46.69% -21.47%
+ Complexity 29158 15327 -13831
=============================================
Files 2521 1970 -551
Lines 141371 107541 -33830
Branches 17549 13057 -4492
=============================================
- Hits 96365 50218 -46147
- Misses 37076 52053 +14977
+ Partials 7930 5270 -2660
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.11% <8.47%> (-11.74%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `5.88% <5.88%> (ø)` | |
... and [1668 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412607224
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.92857%` with `102 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 46.38%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 6.45% | [58 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (34e9c7c) and HEAD (a63d034). Click for more details.
>
> <details><summary>HEAD has 30 uploads less than BASE</summary>
>
>| Flag | BASE (34e9c7c) | HEAD (a63d034) |
>|------|------|------|
>|spark-scala-tests|12|2|
>|spark-java-tests|18|0|
>|common-and-other-modules|1|0|
>|utilities|1|0|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 67.92% 46.38% -21.54%
+ Complexity 29003 15512 -13491
=============================================
Files 2522 1983 -539
Lines 141166 109723 -31443
Branches 17506 13627 -3879
=============================================
- Hits 95881 50900 -44981
- Misses 37415 53434 +16019
+ Partials 7870 5389 -2481
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.10% <8.92%> (-11.81%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `6.45% <6.45%> (ø)` | |
... and [1655 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4409378224
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "a63d034124180364c70b37770bbc0f4a5590e46e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=13903",
"triggerID" : "a63d034124180364c70b37770bbc0f4a5590e46e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a63d034124180364c70b37770bbc0f4a5590e46e Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=13903)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "hudi-agent (via GitHub)" <gi...@apache.org>.
hudi-agent commented on code in PR #18709:
URL: https://github.com/apache/hudi/pull/18709#discussion_r3211517961
##########
hudi-spark-datasource/hudi-spark-common/src/main/java/org/apache/hudi/HoodieTimelineCleanupUtil.java:
##########
@@ -0,0 +1,59 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi;
+
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieInstantTimeGenerator;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+import java.time.Duration;
+import java.util.Date;
+import java.util.List;
+import java.util.function.Predicate;
+import java.util.stream.Collectors;
+import java.util.stream.Stream;
+
+public class HoodieTimelineCleanupUtil {
+ private static final Logger LOG = LoggerFactory.getLogger(HoodieTimelineCleanupUtil.class);
+
+ public static List<HoodieInstant> inflightWriteCommitsOlderThan(HoodieTableMetaClient metaClient, long mins, boolean includeIngestionCommits) {
Review Comment:
🤖 nit: could you rename `mins` to `ageMinutes`? `mins` is a common abbreviation for both "minutes" and "minimum", so `ageMinutes` makes the intent unambiguous at every call site.
<sub><i>- AI-generated; verify before applying. React 👍/👎 to flag quality.</i></sub>
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/CleanupStaleInflightCommitsProcedure.scala:
##########
@@ -0,0 +1,209 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi.command.procedures
+
+import org.apache.hudi.{HoodieCLIUtils, HoodieTimelineCleanupUtil}
+import org.apache.hudi.client.SparkRDDWriteClient
+import org.apache.hudi.common.HoodiePendingRollbackInfo
+import org.apache.hudi.common.table.HoodieTableMetaClient
+import org.apache.hudi.common.table.timeline.HoodieTimeline
+import org.apache.hudi.common.util.{Option => HOption}
+import org.apache.hudi.config.HoodieWriteConfig
+import org.apache.hudi.hadoop.fs.HadoopFSUtils
+import org.apache.hudi.table.HoodieSparkTable
+
+import org.apache.spark.internal.Logging
+import org.apache.spark.sql.Row
+import org.apache.spark.sql.types.{DataTypes, Metadata, StructField, StructType}
+
+import java.util.function.Supplier
+
+import scala.collection.JavaConverters._
+
+/**
+ * Spark SQL stored procedure to roll back stale inflight write commits older than a configurable
+ * age threshold.
+ *
+ * SAFETY WARNING: Unlike rollback_to_instant_time which targets a single named instant, this
+ * procedure rolls back a SET of instants matched by age. A misconfigured threshold can erase
+ * recent in-progress writes when include_ingestion_commits=true. Operators should call
+ * show_inflight_commits first to preview the pending instants, and use dry_run => true (see
+ * below) when in doubt about which instants will be processed.
+ *
+ * This procedure targets the write timeline (COMMIT, DELTA_COMMIT, COMPACTION, LOG_COMPACTION,
+ * REPLACE_COMMIT, CLUSTERING actions). Stale rollback, clean, or restore inflights visible in
+ * show_inflight_commits are NOT covered by this procedure.
+ *
+ * Compaction, log-compaction, and clustering inflights are handled via the targeted table
+ * methods (table.rollbackInflightCompaction / rollbackInflightLogCompaction /
+ * rollbackInflightClustering) — the supporting state (HoodieSparkTable, table-service client,
+ * pending-rollback lookup) is constructed lazily on the first such instant and reused.
+ *
+ * Parameters:
+ * - table: Required. Catalog name of the Hudi table.
+ * - allowed_inflight_interval_minutes: Optional (default 180). Instants older than this many
+ * minutes are considered stale and eligible for rollback.
+ * - include_ingestion_commits: Optional (default false). DANGEROUS when true: enabling
+ * this allows the procedure to roll back COMMIT_ACTION and
+ * DELTA_COMMIT_ACTION inflights, which means it can drop
+ * in-progress ingestion data. The default false is the
+ * safe choice; true is for operators recovering from a
+ * known-stuck ingestion job.
+ * - dry_run: Optional (default false). When true, the matched-instant
+ * set is resolved exactly as in normal mode but no rollback
+ * calls are issued. Each returned row carries
+ * rollback_status = NULL meaning "matched but not acted
+ * upon". Re-run with dry_run => false to act.
+ *
+ * Output columns (one row per processed instant):
+ * - instant_time: The instant's requested timestamp.
+ * - action: The action type.
+ * - rollback_status: true if the rollback succeeded, false if the rollback failed,
+ * NULL if dry_run was true (matched but not actioned).
+ *
+ * Example usage:
+ * {{{
+ * -- Clean stale table-service inflights (default 180-min threshold)
+ * CALL cleanup_stale_inflight_commits(table => 'my_table');
+ *
+ * -- Preview what would be processed without acting
+ * CALL cleanup_stale_inflight_commits(table => 'my_table', dry_run => true);
+ *
+ * -- Clean stale inflights older than 1 hour, including ingestion commits (DANGEROUS)
+ * CALL cleanup_stale_inflight_commits(
+ * table => 'my_table',
+ * allowed_inflight_interval_minutes => 60,
+ * include_ingestion_commits => true
+ * );
+ * }}}
+ *
+ * For inflight commit types not covered by this procedure (clean, restore, rollback inflights),
+ * use hudi-cli's `repair rollback` command.
+ */
+class CleanupStaleInflightCommitsProcedure extends BaseProcedure with ProcedureBuilder with Logging {
+
+ private val PARAMETERS = Array[ProcedureParameter](
+ ProcedureParameter.required(0, "table", DataTypes.StringType),
+ ProcedureParameter.optional(1, "allowed_inflight_interval_minutes", DataTypes.IntegerType, 180),
+ ProcedureParameter.optional(2, "include_ingestion_commits", DataTypes.BooleanType, false),
+ ProcedureParameter.optional(3, "dry_run", DataTypes.BooleanType, false)
+ )
+
+ private val OUTPUT_TYPE = new StructType(Array[StructField](
+ StructField("instant_time", DataTypes.StringType, nullable = true, Metadata.empty),
+ StructField("action", DataTypes.StringType, nullable = true, Metadata.empty),
+ StructField("rollback_status", DataTypes.BooleanType, nullable = true, Metadata.empty)
+ ))
+
+ override def parameters: Array[ProcedureParameter] = PARAMETERS
+
+ override def outputType: StructType = OUTPUT_TYPE
+
+ override def build: Procedure = new CleanupStaleInflightCommitsProcedure()
+
+ override def call(args: ProcedureArgs): Seq[Row] = {
+ super.checkArgs(PARAMETERS, args)
+
+ val tableName = getArgValueOrDefault(args, PARAMETERS(0))
+ val allowedMinutes = getArgValueOrDefault(args, PARAMETERS(1)).get.asInstanceOf[Int]
+ val includeIngestionCommits = getArgValueOrDefault(args, PARAMETERS(2)).get.asInstanceOf[Boolean]
+ val dryRun = getArgValueOrDefault(args, PARAMETERS(3)).get.asInstanceOf[Boolean]
+
+ val basePath = getBasePath(tableName)
+ val metaClient = HoodieTableMetaClient.builder
+ .setConf(HadoopFSUtils.getStorageConfWithCopy(jsc.hadoopConfiguration))
+ .setBasePath(basePath)
+ .build
+
+ val staleInflights = HoodieTimelineCleanupUtil
+ .inflightWriteCommitsOlderThan(metaClient, allowedMinutes.toLong, includeIngestionCommits)
+
+ if (staleInflights.isEmpty) {
+ Seq.empty[Row]
+ } else if (dryRun) {
+ // Dry-run: do not open the table for write — emit preview rows with NULL rollback_status
+ // to mean "matched but not actioned". Re-run with dry_run => false to act.
+ staleInflights.asScala.map { instant =>
+ Row(instant.requestedTime, instant.getAction, null)
+ }.toSeq
+ } else {
+ // Pass ROLLBACK_USING_MARKERS_ENABLE=false via the createHoodieWriteClient confs Map.
+ // Inflight commits may not have marker files, so timeline-based rollback is required.
+ // The user-specified confs win over defaults / table config / session conf — see
+ // HoodieCLIUtils.scala "Priority: defaults < catalog props < table config < sparkSession conf < specified conf".
+ val confs = Map(HoodieWriteConfig.ROLLBACK_USING_MARKERS_ENABLE.key() -> "false")
+ var client: SparkRDDWriteClient[_] = null
+ try {
+ client = HoodieCLIUtils.createHoodieWriteClient(sparkSession, basePath, confs,
+ tableName.asInstanceOf[scala.Option[String]])
+
+ // Lazy state for compaction / log-compaction / clustering branches.
+ // For matched sets that contain no such instants, none of these are constructed.
+ lazy val tsClient = client.getTableServiceClient
+ lazy val table = HoodieSparkTable.create(client.getConfig, client.getEngineContext)
+ lazy val getPendingRollbackInstantFunc: java.util.function.Function[String, HOption[HoodiePendingRollbackInfo]] =
+ new java.util.function.Function[String, HOption[HoodiePendingRollbackInfo]] {
+ override def apply(commitToRollback: String): HOption[HoodiePendingRollbackInfo] = {
+ tsClient.getPendingRollbackInfo(table.getMetaClient, commitToRollback, false)
+ }
+ }
+
+ val rows = staleInflights.asScala.map { instant =>
+ val status: java.lang.Boolean = try {
+ val result: Boolean = instant.getAction match {
+ case HoodieTimeline.COMPACTION_ACTION =>
Review Comment:
🤖 Have you considered the case where a concurrent writer completes the inflight between detection in `inflightWriteCommitsOlderThan` and this `client.rollback(...)` call? `BaseHoodieTableServiceClient.rollback` looks up `commitInstantOpt` from `getCommitsTimeline()` (completed + pending), so if T just completed and is the latest commit, `validateRollbackCommitSequence` passes (no instants after T) and the now-completed commit gets rolled back destructively. The `table.rollbackInflight*` branches above fail loudly via `revertInstantFromInflightToRequested` if the inflight is gone, but this branch doesn't have an inflight-state recheck. With the 180-min default it's a narrow window, but `allowed_inflight_interval_minutes => 1` widens it significantly. Worth either re-reading the timeline inside the loop and skipping if the instant is no longer in `INFLIGHT`/`REQUESTED`, or documenting the assumption.
<sub><i>- AI-generated; verify before applying. React 👍/👎 to flag quality.</i></sub>
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/ShowInflightCommitsProcedure.scala:
##########
@@ -0,0 +1,113 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi.command.procedures
+
+import org.apache.hudi.common.table.HoodieTableMetaClient
+import org.apache.hudi.common.table.timeline.HoodieInstantTimeGenerator
+import org.apache.hudi.hadoop.fs.HadoopFSUtils
+
+import org.apache.spark.sql.Row
+import org.apache.spark.sql.types.{DataTypes, Metadata, StructField, StructType}
+
+import java.time.Duration
+import java.util.Date
+import java.util.function.Supplier
+
+import scala.collection.JavaConverters._
+
+/**
+ * Spark SQL stored procedure to list all pending inflight and requested instants on a Hudi table.
+ *
+ * Unlike cleanup_stale_inflight_commits (which targets the write timeline only), this procedure
+ * queries the full active timeline and therefore includes inflight rollback, clean, restore, and
+ * indexing instants in addition to write-action instants. A stale rollback or clean inflight
+ * visible here cannot be cleaned by cleanup_stale_inflight_commits.
+ *
+ * Parameters:
+ * - table: Required. Catalog name of the Hudi table.
+ * - min_age_minutes: Optional (default 0). When > 0, only instants older than this many minutes
+ * are returned. When 0 (default), all pending instants are returned.
+ *
+ * Output columns (one row per pending instant):
+ * - instant_time: The instant's requested timestamp.
+ * - action: The action type (commit, delta_commit, compaction, replace, rollback, clean, etc.).
+ * - state: The instant's state (REQUESTED or INFLIGHT).
+ *
+ * Example usage:
+ * {{{
+ * -- Show all pending inflights
+ * CALL show_inflight_commits(table => 'my_table');
+ *
+ * -- Show only inflights older than 2 hours
+ * CALL show_inflight_commits(table => 'my_table', min_age_minutes => 120);
+ * }}}
+ */
+class ShowInflightCommitsProcedure extends BaseProcedure with ProcedureBuilder {
+
+ private val PARAMETERS = Array[ProcedureParameter](
+ ProcedureParameter.required(0, "table", DataTypes.StringType),
+ ProcedureParameter.optional(1, "min_age_minutes", DataTypes.IntegerType, 0)
+ )
+
+ private val OUTPUT_TYPE = new StructType(Array[StructField](
+ StructField("instant_time", DataTypes.StringType, nullable = true, Metadata.empty),
+ StructField("action", DataTypes.StringType, nullable = true, Metadata.empty),
+ StructField("state", DataTypes.StringType, nullable = true, Metadata.empty)
+ ))
+
+ override def parameters: Array[ProcedureParameter] = PARAMETERS
+
+ override def outputType: StructType = OUTPUT_TYPE
+
+ override def build: Procedure = new ShowInflightCommitsProcedure()
+
+ override def call(args: ProcedureArgs): Seq[Row] = {
+ super.checkArgs(PARAMETERS, args)
+
+ val tableName = getArgValueOrDefault(args, PARAMETERS(0))
+ val minAgeMinutes = getArgValueOrDefault(args, PARAMETERS(1)).get.asInstanceOf[Int]
+
+ val basePath = getBasePath(tableName)
+ val metaClient = HoodieTableMetaClient.builder
+ .setConf(HadoopFSUtils.getStorageConfWithCopy(jsc.hadoopConfiguration))
+ .setBasePath(basePath)
+ .build
+
+ val baseTimeline = metaClient.reloadActiveTimeline().filterInflightsAndRequested()
+
+ val timeline = if (minAgeMinutes > 0) {
+ val goBackMs = Duration.ofMinutes(minAgeMinutes).getSeconds * 1000L
Review Comment:
🤖 nit: same as in `HoodieTimelineCleanupUtil` — `Duration.ofMinutes(minAgeMinutes).toMillis()` would be simpler than `.getSeconds * 1000L`.
<sub><i>- AI-generated; verify before applying. React 👍/👎 to flag quality.</i></sub>
##########
hudi-spark-datasource/hudi-spark-common/src/main/java/org/apache/hudi/HoodieTimelineCleanupUtil.java:
##########
@@ -0,0 +1,59 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi;
+
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieInstantTimeGenerator;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+import java.time.Duration;
+import java.util.Date;
+import java.util.List;
+import java.util.function.Predicate;
+import java.util.stream.Collectors;
+import java.util.stream.Stream;
+
+public class HoodieTimelineCleanupUtil {
+ private static final Logger LOG = LoggerFactory.getLogger(HoodieTimelineCleanupUtil.class);
+
+ public static List<HoodieInstant> inflightWriteCommitsOlderThan(HoodieTableMetaClient metaClient, long mins, boolean includeIngestionCommits) {
+ long goBackMs = Duration.ofMinutes(mins).getSeconds() * 1000;
Review Comment:
🤖 nit: `Duration.ofMinutes(mins).toMillis()` is more direct than `.getSeconds() * 1000` — avoids the manual unit conversion and is harder to get wrong.
<sub><i>- AI-generated; verify before applying. React 👍/👎 to flag quality.</i></sub>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412644579
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `91.96429%` with `9 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 67.35%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 87.09% | [2 Missing and 6 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 67.92% 67.35% -0.57%
+ Complexity 29003 28772 -231
============================================
Files 2522 2525 +3
Lines 141166 141289 +123
Branches 17506 17524 +18
============================================
- Hits 95881 95166 -715
- Misses 37415 38160 +745
- Partials 7870 7963 +93
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.38% <0.00%> (+0.21%)` | :arrow_up: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.21% <0.00%> (-3.78%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.96% <91.96%> (+0.06%)` | :arrow_up: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.59% <0.00%> (-0.04%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `87.09% <87.09%> (ø)` | |
... and [154 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4409357787
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "a63d034124180364c70b37770bbc0f4a5590e46e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a63d034124180364c70b37770bbc0f4a5590e46e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a63d034124180364c70b37770bbc0f4a5590e46e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484700578
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `88.98305%` with `13 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 68.10%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 82.35% | [5 Missing and 7 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 68.16% 68.10% -0.06%
+ Complexity 29158 29155 -3
============================================
Files 2521 2524 +3
Lines 141371 141489 +118
Branches 17549 17560 +11
============================================
+ Hits 96365 96366 +1
- Misses 37076 37187 +111
- Partials 7930 7936 +6
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.39% <0.00%> (-0.04%)` | :arrow_down: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.51% <0.00%> (-0.44%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.91% <88.98%> (+0.07%)` | :arrow_up: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.52% <0.00%> (-0.05%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `82.35% <82.35%> (ø)` | |
... and [29 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484581900
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.47458%` with `108 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 45.80%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 5.88% | [64 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (9026c7d) and HEAD (807cd80). Click for more details.
>
> <details><summary>HEAD has 29 uploads less than BASE</summary>
>
>| Flag | BASE (9026c7d) | HEAD (807cd80) |
>|------|------|------|
>|spark-scala-tests|12|3|
>|utilities|1|0|
>|common-and-other-modules|1|0|
>|spark-java-tests|18|0|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 68.16% 45.80% -22.37%
+ Complexity 29158 15746 -13412
=============================================
Files 2521 2005 -516
Lines 141371 112403 -28968
Branches 17549 14107 -3442
=============================================
- Hits 96365 51483 -44882
- Misses 37076 55283 +18207
+ Partials 7930 5637 -2293
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.83% <8.47%> (-12.01%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `5.88% <5.88%> (ø)` | |
... and [1648 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412608012
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.92857%` with `102 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 45.93%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 6.45% | [58 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (34e9c7c) and HEAD (a63d034). Click for more details.
>
> <details><summary>HEAD has 29 uploads less than BASE</summary>
>
>| Flag | BASE (34e9c7c) | HEAD (a63d034) |
>|------|------|------|
>|spark-scala-tests|12|3|
>|spark-java-tests|18|0|
>|common-and-other-modules|1|0|
>|utilities|1|0|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 67.92% 45.93% -21.99%
+ Complexity 29003 15720 -13283
=============================================
Files 2522 2001 -521
Lines 141166 112111 -29055
Branches 17506 14139 -3367
=============================================
- Hits 95881 51496 -44385
- Misses 37415 55040 +17625
+ Partials 7870 5575 -2295
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.93% <8.92%> (-11.97%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `6.45% <6.45%> (ø)` | |
... and [1644 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412683617
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `91.96429%` with `9 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 68.17%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 87.09% | [2 Missing and 6 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
+ Coverage 67.92% 68.17% +0.25%
- Complexity 29003 29113 +110
============================================
Files 2522 2525 +3
Lines 141166 141289 +123
Branches 17506 17524 +18
============================================
+ Hits 95881 96321 +440
+ Misses 37415 37057 -358
- Partials 7870 7911 +41
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.38% <0.00%> (+0.21%)` | :arrow_up: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.96% <0.00%> (-0.04%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.96% <91.96%> (+0.06%)` | :arrow_up: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.59% <0.00%> (-0.04%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `87.09% <87.09%> (ø)` | |
... and [19 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484644583
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `88.98305%` with `13 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 66.28%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 82.35% | [5 Missing and 7 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 68.16% 66.28% -1.89%
+ Complexity 29158 28322 -836
============================================
Files 2521 2524 +3
Lines 141371 141489 +118
Branches 17549 17560 +11
============================================
- Hits 96365 93784 -2581
- Misses 37076 39771 +2695
- Partials 7930 7934 +4
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.39% <0.00%> (-0.04%)` | :arrow_down: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `39.48% <0.00%> (-9.46%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.53% <88.98%> (-0.32%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.52% <0.00%> (-0.05%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `82.35% <82.35%> (ø)` | |
... and [290 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484690113
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `88.98305%` with `13 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 68.00%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 82.35% | [5 Missing and 7 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 68.16% 68.00% -0.17%
+ Complexity 29158 29079 -79
============================================
Files 2521 2524 +3
Lines 141371 141489 +118
Branches 17549 17560 +11
============================================
- Hits 96365 96213 -152
- Misses 37076 37368 +292
+ Partials 7930 7908 -22
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.39% <0.00%> (-0.04%)` | :arrow_down: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.05% <0.00%> (-0.90%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.83% <88.98%> (-0.02%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.52% <0.00%> (-0.05%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `82.35% <82.35%> (ø)` | |
... and [54 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484686681
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `88.98305%` with `13 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 68.00%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 82.35% | [5 Missing and 7 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 68.16% 68.00% -0.17%
+ Complexity 29158 29079 -79
============================================
Files 2521 2524 +3
Lines 141371 141489 +118
Branches 17549 17560 +11
============================================
- Hits 96365 96213 -152
- Misses 37076 37368 +292
+ Partials 7930 7908 -22
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.39% <0.00%> (-0.04%)` | :arrow_down: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.05% <0.00%> (-0.90%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.83% <88.98%> (-0.02%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.52% <0.00%> (-0.05%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `82.35% <82.35%> (ø)` | |
... and [54 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "mahsoodebrahim (via GitHub)" <gi...@apache.org>.
mahsoodebrahim commented on code in PR #18709:
URL: https://github.com/apache/hudi/pull/18709#discussion_r3263054740
##########
hudi-spark-datasource/hudi-spark-common/src/main/java/org/apache/hudi/HoodieTimelineCleanupUtil.java:
##########
@@ -0,0 +1,59 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi;
+
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieInstantTimeGenerator;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+import java.time.Duration;
+import java.util.Date;
+import java.util.List;
+import java.util.function.Predicate;
+import java.util.stream.Collectors;
+import java.util.stream.Stream;
+
+public class HoodieTimelineCleanupUtil {
+ private static final Logger LOG = LoggerFactory.getLogger(HoodieTimelineCleanupUtil.class);
+
+ public static List<HoodieInstant> inflightWriteCommitsOlderThan(HoodieTableMetaClient metaClient, long mins, boolean includeIngestionCommits) {
Review Comment:
Updated
##########
hudi-spark-datasource/hudi-spark-common/src/main/java/org/apache/hudi/HoodieTimelineCleanupUtil.java:
##########
@@ -0,0 +1,59 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi;
+
+import org.apache.hudi.common.table.HoodieTableMetaClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieInstantTimeGenerator;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+import java.time.Duration;
+import java.util.Date;
+import java.util.List;
+import java.util.function.Predicate;
+import java.util.stream.Collectors;
+import java.util.stream.Stream;
+
+public class HoodieTimelineCleanupUtil {
+ private static final Logger LOG = LoggerFactory.getLogger(HoodieTimelineCleanupUtil.class);
+
+ public static List<HoodieInstant> inflightWriteCommitsOlderThan(HoodieTableMetaClient metaClient, long mins, boolean includeIngestionCommits) {
+ long goBackMs = Duration.ofMinutes(mins).getSeconds() * 1000;
Review Comment:
Updated
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/ShowInflightCommitsProcedure.scala:
##########
@@ -0,0 +1,113 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi.command.procedures
+
+import org.apache.hudi.common.table.HoodieTableMetaClient
+import org.apache.hudi.common.table.timeline.HoodieInstantTimeGenerator
+import org.apache.hudi.hadoop.fs.HadoopFSUtils
+
+import org.apache.spark.sql.Row
+import org.apache.spark.sql.types.{DataTypes, Metadata, StructField, StructType}
+
+import java.time.Duration
+import java.util.Date
+import java.util.function.Supplier
+
+import scala.collection.JavaConverters._
+
+/**
+ * Spark SQL stored procedure to list all pending inflight and requested instants on a Hudi table.
+ *
+ * Unlike cleanup_stale_inflight_commits (which targets the write timeline only), this procedure
+ * queries the full active timeline and therefore includes inflight rollback, clean, restore, and
+ * indexing instants in addition to write-action instants. A stale rollback or clean inflight
+ * visible here cannot be cleaned by cleanup_stale_inflight_commits.
+ *
+ * Parameters:
+ * - table: Required. Catalog name of the Hudi table.
+ * - min_age_minutes: Optional (default 0). When > 0, only instants older than this many minutes
+ * are returned. When 0 (default), all pending instants are returned.
+ *
+ * Output columns (one row per pending instant):
+ * - instant_time: The instant's requested timestamp.
+ * - action: The action type (commit, delta_commit, compaction, replace, rollback, clean, etc.).
+ * - state: The instant's state (REQUESTED or INFLIGHT).
+ *
+ * Example usage:
+ * {{{
+ * -- Show all pending inflights
+ * CALL show_inflight_commits(table => 'my_table');
+ *
+ * -- Show only inflights older than 2 hours
+ * CALL show_inflight_commits(table => 'my_table', min_age_minutes => 120);
+ * }}}
+ */
+class ShowInflightCommitsProcedure extends BaseProcedure with ProcedureBuilder {
+
+ private val PARAMETERS = Array[ProcedureParameter](
+ ProcedureParameter.required(0, "table", DataTypes.StringType),
+ ProcedureParameter.optional(1, "min_age_minutes", DataTypes.IntegerType, 0)
+ )
+
+ private val OUTPUT_TYPE = new StructType(Array[StructField](
+ StructField("instant_time", DataTypes.StringType, nullable = true, Metadata.empty),
+ StructField("action", DataTypes.StringType, nullable = true, Metadata.empty),
+ StructField("state", DataTypes.StringType, nullable = true, Metadata.empty)
+ ))
+
+ override def parameters: Array[ProcedureParameter] = PARAMETERS
+
+ override def outputType: StructType = OUTPUT_TYPE
+
+ override def build: Procedure = new ShowInflightCommitsProcedure()
+
+ override def call(args: ProcedureArgs): Seq[Row] = {
+ super.checkArgs(PARAMETERS, args)
+
+ val tableName = getArgValueOrDefault(args, PARAMETERS(0))
+ val minAgeMinutes = getArgValueOrDefault(args, PARAMETERS(1)).get.asInstanceOf[Int]
+
+ val basePath = getBasePath(tableName)
+ val metaClient = HoodieTableMetaClient.builder
+ .setConf(HadoopFSUtils.getStorageConfWithCopy(jsc.hadoopConfiguration))
+ .setBasePath(basePath)
+ .build
+
+ val baseTimeline = metaClient.reloadActiveTimeline().filterInflightsAndRequested()
+
+ val timeline = if (minAgeMinutes > 0) {
+ val goBackMs = Duration.ofMinutes(minAgeMinutes).getSeconds * 1000L
Review Comment:
Updated
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484764945
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `88.98305%` with `13 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 68.18%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 82.35% | [5 Missing and 7 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
+ Coverage 68.16% 68.18% +0.01%
- Complexity 29158 29192 +34
============================================
Files 2521 2524 +3
Lines 141371 141489 +118
Branches 17549 17560 +11
============================================
+ Hits 96365 96472 +107
- Misses 37076 37078 +2
- Partials 7930 7939 +9
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.39% <0.00%> (-0.04%)` | :arrow_down: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.87% <0.00%> (-0.08%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.91% <88.98%> (+0.07%)` | :arrow_up: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.52% <0.00%> (-0.05%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `82.35% <82.35%> (ø)` | |
... and [16 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4409873388
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "a63d034124180364c70b37770bbc0f4a5590e46e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=13903",
"triggerID" : "a63d034124180364c70b37770bbc0f4a5590e46e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a63d034124180364c70b37770bbc0f4a5590e46e Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=13903)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412609944
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.92857%` with `102 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 45.49%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 6.45% | [58 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (34e9c7c) and HEAD (a63d034). Click for more details.
>
> <details><summary>HEAD has 27 uploads less than BASE</summary>
>
>| Flag | BASE (34e9c7c) | HEAD (a63d034) |
>|------|------|------|
>|spark-scala-tests|12|5|
>|spark-java-tests|18|0|
>|common-and-other-modules|1|0|
>|utilities|1|0|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 67.92% 45.49% -22.43%
+ Complexity 29003 15961 -13042
=============================================
Files 2522 2031 -491
Lines 141166 114792 -26374
Branches 17506 14710 -2796
=============================================
- Hits 95881 52226 -43655
- Misses 37415 56793 +19378
+ Partials 7870 5773 -2097
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.80% <8.92%> (-12.10%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `6.45% <6.45%> (ø)` | |
... and [1626 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412649881
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `91.96429%` with `9 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 68.17%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 87.09% | [2 Missing and 6 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
+ Coverage 67.92% 68.17% +0.24%
- Complexity 29003 29112 +109
============================================
Files 2522 2525 +3
Lines 141166 141289 +123
Branches 17506 17524 +18
============================================
+ Hits 95881 96317 +436
+ Misses 37415 37060 -355
- Partials 7870 7912 +42
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.38% <0.00%> (+0.21%)` | :arrow_up: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.85% <0.00%> (-0.14%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.96% <91.96%> (+0.06%)` | :arrow_up: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.59% <0.00%> (-0.04%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `87.09% <87.09%> (ø)` | |
... and [22 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412619273
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.92857%` with `102 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 58.45%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 6.45% | [58 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (34e9c7c) and HEAD (a63d034). Click for more details.
>
> <details><summary>HEAD has 19 uploads less than BASE</summary>
>
>| Flag | BASE (34e9c7c) | HEAD (a63d034) |
>|------|------|------|
>|spark-scala-tests|12|6|
>|spark-java-tests|18|6|
>|utilities|1|0|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 67.92% 58.45% -9.47%
+ Complexity 29003 24995 -4008
============================================
Files 2522 2525 +3
Lines 141166 141289 +123
Branches 17506 17524 +18
============================================
- Hits 95881 82597 -13284
- Misses 37415 51313 +13898
+ Partials 7870 7379 -491
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.38% <0.00%> (+0.21%)` | :arrow_up: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.54% <0.00%> (-17.46%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.70% <8.92%> (-12.20%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `6.45% <6.45%> (ø)` | |
... and [682 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 merged PR #18709:
URL: https://github.com/apache/hudi/pull/18709
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484749881
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `88.98305%` with `13 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 68.18%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 82.35% | [5 Missing and 7 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
+ Coverage 68.16% 68.18% +0.01%
- Complexity 29158 29192 +34
============================================
Files 2521 2524 +3
Lines 141371 141489 +118
Branches 17549 17560 +11
============================================
+ Hits 96365 96472 +107
- Misses 37076 37078 +2
- Partials 7930 7939 +9
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.39% <0.00%> (-0.04%)` | :arrow_down: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.84% <0.00%> (-0.11%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.91% <88.98%> (+0.07%)` | :arrow_up: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.52% <0.00%> (-0.05%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `82.35% <82.35%> (ø)` | |
... and [16 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4483921124
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "a63d034124180364c70b37770bbc0f4a5590e46e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=13903",
"triggerID" : "a63d034124180364c70b37770bbc0f4a5590e46e",
"triggerType" : "PUSH"
}, {
"hash" : "807cd801412175073cea62b801a8955e7983b48f",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=14081",
"triggerID" : "807cd801412175073cea62b801a8955e7983b48f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 807cd801412175073cea62b801a8955e7983b48f Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=14081)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484706337
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `88.98305%` with `13 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 68.18%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 82.35% | [5 Missing and 7 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
+ Coverage 68.16% 68.18% +0.01%
- Complexity 29158 29191 +33
============================================
Files 2521 2524 +3
Lines 141371 141489 +118
Branches 17549 17560 +11
============================================
+ Hits 96365 96469 +104
- Misses 37076 37080 +4
- Partials 7930 7940 +10
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.39% <0.00%> (-0.04%)` | :arrow_down: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.81% <0.00%> (-0.14%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.91% <88.98%> (+0.07%)` | :arrow_up: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.52% <0.00%> (-0.05%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `82.35% <82.35%> (ø)` | |
... and [18 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484703179
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `88.98305%` with `13 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 68.12%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 82.35% | [5 Missing and 7 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 68.16% 68.12% -0.04%
- Complexity 29158 29161 +3
============================================
Files 2521 2524 +3
Lines 141371 141489 +118
Branches 17549 17560 +11
============================================
+ Hits 96365 96390 +25
- Misses 37076 37159 +83
- Partials 7930 7940 +10
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.39% <0.00%> (-0.04%)` | :arrow_down: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.56% <0.00%> (-0.39%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.91% <88.98%> (+0.07%)` | :arrow_up: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.52% <0.00%> (-0.05%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `82.35% <82.35%> (ø)` | |
... and [30 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484668078
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `88.98305%` with `13 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 66.35%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 82.35% | [5 Missing and 7 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 68.16% 66.35% -1.82%
+ Complexity 29158 28354 -804
============================================
Files 2521 2524 +3
Lines 141371 141489 +118
Branches 17549 17560 +11
============================================
- Hits 96365 93884 -2481
- Misses 37076 39649 +2573
- Partials 7930 7956 +26
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.39% <0.00%> (-0.04%)` | :arrow_down: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `39.48% <0.00%> (-9.46%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.65% <88.98%> (-0.20%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.52% <0.00%> (-0.05%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `82.35% <82.35%> (ø)` | |
... and [272 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484559777
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:white_check_mark: All modified and coverable lines are covered by tests.
:white_check_mark: Project coverage is 53.99%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
> :exclamation: There is a different number of reports uploaded between BASE (9026c7d) and HEAD (807cd80). Click for more details.
>
> <details><summary>HEAD has 32 uploads less than BASE</summary>
>
>| Flag | BASE (9026c7d) | HEAD (807cd80) |
>|------|------|------|
>|spark-scala-tests|12|0|
>|utilities|1|0|
>|common-and-other-modules|1|0|
>|spark-java-tests|18|0|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 68.16% 53.99% -14.17%
+ Complexity 29158 12460 -16698
=============================================
Files 2521 1434 -1087
Lines 141371 72192 -69179
Branches 17549 8249 -9300
=============================================
- Hits 96365 38982 -57383
+ Misses 37076 29711 -7365
+ Partials 7930 3499 -4431
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
[see 1866 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484613473
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.47458%` with `108 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 60.30%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 5.88% | [64 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (9026c7d) and HEAD (807cd80). Click for more details.
>
> <details><summary>HEAD has 21 uploads less than BASE</summary>
>
>| Flag | BASE (9026c7d) | HEAD (807cd80) |
>|------|------|------|
>|spark-scala-tests|12|4|
>|spark-java-tests|18|5|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 68.16% 60.30% -7.87%
+ Complexity 29158 25689 -3469
============================================
Files 2521 2524 +3
Lines 141371 141489 +118
Branches 17549 17560 +11
============================================
- Hits 96365 85322 -11043
- Misses 37076 48817 +11741
+ Partials 7930 7350 -580
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.39% <0.00%> (-0.04%)` | :arrow_down: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.86% <0.00%> (-17.09%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.88% <8.47%> (-11.97%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.52% <0.00%> (-0.05%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `5.88% <5.88%> (ø)` | |
... and [561 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484610570
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.47458%` with `108 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 47.13%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 5.88% | [64 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (9026c7d) and HEAD (807cd80). Click for more details.
>
> <details><summary>HEAD has 24 uploads less than BASE</summary>
>
>| Flag | BASE (9026c7d) | HEAD (807cd80) |
>|------|------|------|
>|spark-scala-tests|12|3|
>|utilities|1|0|
>|common-and-other-modules|1|0|
>|spark-java-tests|18|5|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 68.16% 47.13% -21.03%
+ Complexity 29158 16844 -12314
=============================================
Files 2521 2057 -464
Lines 141371 117686 -23685
Branches 17549 15316 -2233
=============================================
- Hits 96365 55471 -40894
- Misses 37076 56212 +19136
+ Partials 7930 6003 -1927
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.86% <0.00%> (-17.09%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.83% <8.47%> (-12.01%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `5.88% <5.88%> (ø)` | |
... and [1570 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484694923
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `88.98305%` with `13 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 68.03%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 82.35% | [5 Missing and 7 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 68.16% 68.03% -0.14%
+ Complexity 29158 29092 -66
============================================
Files 2521 2524 +3
Lines 141371 141489 +118
Branches 17549 17560 +11
============================================
- Hits 96365 96260 -105
- Misses 37076 37309 +233
+ Partials 7930 7920 -10
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.39% <0.00%> (-0.04%)` | :arrow_down: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.30% <0.00%> (-0.65%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.83% <88.98%> (-0.02%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.52% <0.00%> (-0.05%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `82.35% <82.35%> (ø)` | |
... and [43 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412647036
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `91.96429%` with `9 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 67.42%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 87.09% | [2 Missing and 6 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 67.92% 67.42% -0.51%
+ Complexity 29003 28807 -196
============================================
Files 2522 2525 +3
Lines 141166 141289 +123
Branches 17506 17524 +18
============================================
- Hits 95881 95258 -623
- Misses 37415 38061 +646
- Partials 7870 7970 +100
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.38% <0.00%> (+0.21%)` | :arrow_up: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.47% <0.00%> (-3.53%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.96% <91.96%> (+0.06%)` | :arrow_up: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.59% <0.00%> (-0.04%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `87.09% <87.09%> (ø)` | |
... and [144 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412618095
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.92857%` with `102 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 47.87%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 6.45% | [58 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (34e9c7c) and HEAD (a63d034). Click for more details.
>
> <details><summary>HEAD has 21 uploads less than BASE</summary>
>
>| Flag | BASE (34e9c7c) | HEAD (a63d034) |
>|------|------|------|
>|spark-scala-tests|12|6|
>|spark-java-tests|18|5|
>|common-and-other-modules|1|0|
>|utilities|1|0|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 67.92% 47.87% -20.05%
+ Complexity 29003 17136 -11867
=============================================
Files 2522 2052 -470
Lines 141166 117281 -23885
Branches 17506 15247 -2259
=============================================
- Hits 95881 56153 -39728
- Misses 37415 54956 +17541
+ Partials 7870 6172 -1698
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.54% <0.00%> (-17.46%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.70% <8.92%> (-12.20%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `6.45% <6.45%> (ø)` | |
... and [1564 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412602617
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:white_check_mark: All modified and coverable lines are covered by tests.
:white_check_mark: Project coverage is 54.03%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
> :exclamation: There is a different number of reports uploaded between BASE (34e9c7c) and HEAD (a63d034). Click for more details.
>
> <details><summary>HEAD has 32 uploads less than BASE</summary>
>
>| Flag | BASE (34e9c7c) | HEAD (a63d034) |
>|------|------|------|
>|spark-scala-tests|12|0|
>|spark-java-tests|18|0|
>|common-and-other-modules|1|0|
>|utilities|1|0|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 67.92% 54.03% -13.89%
+ Complexity 29003 12455 -16548
=============================================
Files 2522 1434 -1088
Lines 141166 72133 -69033
Branches 17506 8238 -9268
=============================================
- Hits 95881 38977 -56904
+ Misses 37415 29660 -7755
+ Partials 7870 3496 -4374
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
[see 1868 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4483600982
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "a63d034124180364c70b37770bbc0f4a5590e46e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=13903",
"triggerID" : "a63d034124180364c70b37770bbc0f4a5590e46e",
"triggerType" : "PUSH"
}, {
"hash" : "807cd801412175073cea62b801a8955e7983b48f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=14081",
"triggerID" : "807cd801412175073cea62b801a8955e7983b48f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a63d034124180364c70b37770bbc0f4a5590e46e Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=13903)
* 807cd801412175073cea62b801a8955e7983b48f Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=14081)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412641236
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `91.96429%` with `9 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 67.20%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 87.09% | [2 Missing and 6 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 67.92% 67.20% -0.72%
+ Complexity 29003 28681 -322
============================================
Files 2522 2525 +3
Lines 141166 141289 +123
Branches 17506 17524 +18
============================================
- Hits 95881 94956 -925
- Misses 37415 38406 +991
- Partials 7870 7927 +57
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.38% <0.00%> (+0.21%)` | :arrow_up: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.52% <0.00%> (-4.47%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.89% <91.96%> (-0.02%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.59% <0.00%> (-0.04%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `87.09% <87.09%> (ø)` | |
... and [184 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412640436
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `91.96429%` with `9 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 67.20%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 87.09% | [2 Missing and 6 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 67.92% 67.20% -0.72%
+ Complexity 29003 28681 -322
============================================
Files 2522 2525 +3
Lines 141166 141289 +123
Branches 17506 17524 +18
============================================
- Hits 95881 94956 -925
- Misses 37415 38406 +991
- Partials 7870 7927 +57
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.38% <0.00%> (+0.21%)` | :arrow_up: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.52% <0.00%> (-4.47%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.89% <91.96%> (-0.02%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.59% <0.00%> (-0.04%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `87.09% <87.09%> (ø)` | |
... and [184 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412633727
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `89.28571%` with `12 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 65.36%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 82.25% | [3 Missing and 8 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 67.92% 65.36% -2.56%
+ Complexity 29003 27898 -1105
============================================
Files 2522 2525 +3
Lines 141166 141289 +123
Branches 17506 17524 +18
============================================
- Hits 95881 92348 -3533
- Misses 37415 40959 +3544
- Partials 7870 7982 +112
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.38% <0.00%> (+0.21%)` | :arrow_up: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.54% <0.00%> (-17.46%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.75% <89.28%> (-0.15%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.59% <0.00%> (-0.04%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `82.25% <82.25%> (ø)` | |
... and [382 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412615079
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.92857%` with `102 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 47.75%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 6.45% | [58 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (34e9c7c) and HEAD (a63d034). Click for more details.
>
> <details><summary>HEAD has 24 uploads less than BASE</summary>
>
>| Flag | BASE (34e9c7c) | HEAD (a63d034) |
>|------|------|------|
>|spark-scala-tests|12|6|
>|spark-java-tests|18|2|
>|common-and-other-modules|1|0|
>|utilities|1|0|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 67.92% 47.75% -20.17%
+ Complexity 29003 17091 -11912
=============================================
Files 2522 2052 -470
Lines 141166 117281 -23885
Branches 17506 15247 -2259
=============================================
- Hits 95881 56007 -39874
- Misses 37415 55087 +17672
+ Partials 7870 6187 -1683
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.66% <0.00%> (-16.34%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.70% <8.92%> (-12.20%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `6.45% <6.45%> (ø)` | |
... and [1566 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484437473
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:white_check_mark: All modified and coverable lines are covered by tests.
:white_check_mark: Project coverage is 45.00%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
> :exclamation: There is a different number of reports uploaded between BASE (9026c7d) and HEAD (807cd80). Click for more details.
>
> <details><summary>HEAD has 33 uploads less than BASE</summary>
>
>| Flag | BASE (9026c7d) | HEAD (807cd80) |
>|------|------|------|
>|spark-client-hadoop-common|1|0|
>|spark-scala-tests|12|0|
>|utilities|1|0|
>|common-and-other-modules|1|0|
>|spark-java-tests|18|0|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 68.16% 45.00% -23.17%
+ Complexity 29158 8575 -20583
=============================================
Files 2521 1202 -1319
Lines 141371 62835 -78536
Branches 17549 6814 -10735
=============================================
- Hits 96365 28278 -68087
+ Misses 37076 31441 -5635
+ Partials 7930 3116 -4814
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
[see 2119 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484612623
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.47458%` with `108 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 53.11%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 5.88% | [64 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (9026c7d) and HEAD (807cd80). Click for more details.
>
> <details><summary>HEAD has 22 uploads less than BASE</summary>
>
>| Flag | BASE (9026c7d) | HEAD (807cd80) |
>|------|------|------|
>|spark-scala-tests|12|4|
>|common-and-other-modules|1|0|
>|spark-java-tests|18|5|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 68.16% 53.11% -15.05%
+ Complexity 29158 18786 -10372
=============================================
Files 2521 2057 -464
Lines 141371 117686 -23685
Branches 17549 15316 -2233
=============================================
- Hits 96365 62513 -33852
- Misses 37076 48569 +11493
+ Partials 7930 6604 -1326
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.86% <0.00%> (-17.09%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.88% <8.47%> (-11.97%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.52% <0.00%> (-0.05%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `5.88% <5.88%> (ø)` | |
... and [1434 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484606259
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.47458%` with `108 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 47.12%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 5.88% | [64 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (9026c7d) and HEAD (807cd80). Click for more details.
>
> <details><summary>HEAD has 25 uploads less than BASE</summary>
>
>| Flag | BASE (9026c7d) | HEAD (807cd80) |
>|------|------|------|
>|spark-scala-tests|12|3|
>|utilities|1|0|
>|common-and-other-modules|1|0|
>|spark-java-tests|18|4|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 68.16% 47.12% -21.04%
+ Complexity 29158 16843 -12315
=============================================
Files 2521 2057 -464
Lines 141371 117686 -23685
Branches 17549 15308 -2241
=============================================
- Hits 96365 55460 -40905
- Misses 37076 56221 +19145
+ Partials 7930 6005 -1925
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.81% <0.00%> (-17.14%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.83% <8.47%> (-12.01%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `5.88% <5.88%> (ø)` | |
... and [1571 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484695942
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `88.98305%` with `13 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 68.03%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 82.35% | [5 Missing and 7 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 68.16% 68.03% -0.14%
+ Complexity 29158 29092 -66
============================================
Files 2521 2524 +3
Lines 141371 141489 +118
Branches 17549 17560 +11
============================================
- Hits 96365 96260 -105
- Misses 37076 37309 +233
+ Partials 7930 7920 -10
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.39% <0.00%> (-0.04%)` | :arrow_down: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.30% <0.00%> (-0.65%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.83% <88.98%> (-0.02%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.52% <0.00%> (-0.05%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `82.35% <82.35%> (ø)` | |
... and [43 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #18709:
URL: https://github.com/apache/hudi/pull/18709#discussion_r3214229741
##########
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/procedures/CleanupStaleInflightCommitsProcedure.scala:
##########
@@ -0,0 +1,209 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi.command.procedures
+
+import org.apache.hudi.{HoodieCLIUtils, HoodieTimelineCleanupUtil}
+import org.apache.hudi.client.SparkRDDWriteClient
+import org.apache.hudi.common.HoodiePendingRollbackInfo
+import org.apache.hudi.common.table.HoodieTableMetaClient
+import org.apache.hudi.common.table.timeline.HoodieTimeline
+import org.apache.hudi.common.util.{Option => HOption}
+import org.apache.hudi.config.HoodieWriteConfig
+import org.apache.hudi.hadoop.fs.HadoopFSUtils
+import org.apache.hudi.table.HoodieSparkTable
+
+import org.apache.spark.internal.Logging
+import org.apache.spark.sql.Row
+import org.apache.spark.sql.types.{DataTypes, Metadata, StructField, StructType}
+
+import java.util.function.Supplier
+
+import scala.collection.JavaConverters._
+
+/**
+ * Spark SQL stored procedure to roll back stale inflight write commits older than a configurable
+ * age threshold.
+ *
+ * SAFETY WARNING: Unlike rollback_to_instant_time which targets a single named instant, this
+ * procedure rolls back a SET of instants matched by age. A misconfigured threshold can erase
+ * recent in-progress writes when include_ingestion_commits=true. Operators should call
+ * show_inflight_commits first to preview the pending instants, and use dry_run => true (see
+ * below) when in doubt about which instants will be processed.
+ *
+ * This procedure targets the write timeline (COMMIT, DELTA_COMMIT, COMPACTION, LOG_COMPACTION,
+ * REPLACE_COMMIT, CLUSTERING actions). Stale rollback, clean, or restore inflights visible in
+ * show_inflight_commits are NOT covered by this procedure.
+ *
+ * Compaction, log-compaction, and clustering inflights are handled via the targeted table
+ * methods (table.rollbackInflightCompaction / rollbackInflightLogCompaction /
+ * rollbackInflightClustering) — the supporting state (HoodieSparkTable, table-service client,
+ * pending-rollback lookup) is constructed lazily on the first such instant and reused.
+ *
+ * Parameters:
+ * - table: Required. Catalog name of the Hudi table.
+ * - allowed_inflight_interval_minutes: Optional (default 180). Instants older than this many
+ * minutes are considered stale and eligible for rollback.
+ * - include_ingestion_commits: Optional (default false). DANGEROUS when true: enabling
+ * this allows the procedure to roll back COMMIT_ACTION and
+ * DELTA_COMMIT_ACTION inflights, which means it can drop
+ * in-progress ingestion data. The default false is the
+ * safe choice; true is for operators recovering from a
+ * known-stuck ingestion job.
+ * - dry_run: Optional (default false). When true, the matched-instant
+ * set is resolved exactly as in normal mode but no rollback
+ * calls are issued. Each returned row carries
+ * rollback_status = NULL meaning "matched but not acted
+ * upon". Re-run with dry_run => false to act.
+ *
+ * Output columns (one row per processed instant):
+ * - instant_time: The instant's requested timestamp.
+ * - action: The action type.
+ * - rollback_status: true if the rollback succeeded, false if the rollback failed,
+ * NULL if dry_run was true (matched but not actioned).
+ *
+ * Example usage:
+ * {{{
+ * -- Clean stale table-service inflights (default 180-min threshold)
+ * CALL cleanup_stale_inflight_commits(table => 'my_table');
+ *
+ * -- Preview what would be processed without acting
+ * CALL cleanup_stale_inflight_commits(table => 'my_table', dry_run => true);
+ *
+ * -- Clean stale inflights older than 1 hour, including ingestion commits (DANGEROUS)
+ * CALL cleanup_stale_inflight_commits(
+ * table => 'my_table',
+ * allowed_inflight_interval_minutes => 60,
+ * include_ingestion_commits => true
+ * );
+ * }}}
+ *
+ * For inflight commit types not covered by this procedure (clean, restore, rollback inflights),
+ * use hudi-cli's `repair rollback` command.
+ */
+class CleanupStaleInflightCommitsProcedure extends BaseProcedure with ProcedureBuilder with Logging {
+
+ private val PARAMETERS = Array[ProcedureParameter](
+ ProcedureParameter.required(0, "table", DataTypes.StringType),
+ ProcedureParameter.optional(1, "allowed_inflight_interval_minutes", DataTypes.IntegerType, 180),
+ ProcedureParameter.optional(2, "include_ingestion_commits", DataTypes.BooleanType, false),
+ ProcedureParameter.optional(3, "dry_run", DataTypes.BooleanType, false)
+ )
+
+ private val OUTPUT_TYPE = new StructType(Array[StructField](
+ StructField("instant_time", DataTypes.StringType, nullable = true, Metadata.empty),
+ StructField("action", DataTypes.StringType, nullable = true, Metadata.empty),
+ StructField("rollback_status", DataTypes.BooleanType, nullable = true, Metadata.empty)
+ ))
+
+ override def parameters: Array[ProcedureParameter] = PARAMETERS
+
+ override def outputType: StructType = OUTPUT_TYPE
+
+ override def build: Procedure = new CleanupStaleInflightCommitsProcedure()
+
+ override def call(args: ProcedureArgs): Seq[Row] = {
+ super.checkArgs(PARAMETERS, args)
+
+ val tableName = getArgValueOrDefault(args, PARAMETERS(0))
+ val allowedMinutes = getArgValueOrDefault(args, PARAMETERS(1)).get.asInstanceOf[Int]
+ val includeIngestionCommits = getArgValueOrDefault(args, PARAMETERS(2)).get.asInstanceOf[Boolean]
+ val dryRun = getArgValueOrDefault(args, PARAMETERS(3)).get.asInstanceOf[Boolean]
+
+ val basePath = getBasePath(tableName)
+ val metaClient = HoodieTableMetaClient.builder
+ .setConf(HadoopFSUtils.getStorageConfWithCopy(jsc.hadoopConfiguration))
+ .setBasePath(basePath)
+ .build
+
+ val staleInflights = HoodieTimelineCleanupUtil
+ .inflightWriteCommitsOlderThan(metaClient, allowedMinutes.toLong, includeIngestionCommits)
+
+ if (staleInflights.isEmpty) {
+ Seq.empty[Row]
+ } else if (dryRun) {
+ // Dry-run: do not open the table for write — emit preview rows with NULL rollback_status
+ // to mean "matched but not actioned". Re-run with dry_run => false to act.
+ staleInflights.asScala.map { instant =>
+ Row(instant.requestedTime, instant.getAction, null)
+ }.toSeq
+ } else {
+ // Pass ROLLBACK_USING_MARKERS_ENABLE=false via the createHoodieWriteClient confs Map.
+ // Inflight commits may not have marker files, so timeline-based rollback is required.
+ // The user-specified confs win over defaults / table config / session conf — see
+ // HoodieCLIUtils.scala "Priority: defaults < catalog props < table config < sparkSession conf < specified conf".
+ val confs = Map(HoodieWriteConfig.ROLLBACK_USING_MARKERS_ENABLE.key() -> "false")
+ var client: SparkRDDWriteClient[_] = null
+ try {
+ client = HoodieCLIUtils.createHoodieWriteClient(sparkSession, basePath, confs,
+ tableName.asInstanceOf[scala.Option[String]])
+
+ // Lazy state for compaction / log-compaction / clustering branches.
+ // For matched sets that contain no such instants, none of these are constructed.
+ lazy val tsClient = client.getTableServiceClient
+ lazy val table = HoodieSparkTable.create(client.getConfig, client.getEngineContext)
+ lazy val getPendingRollbackInstantFunc: java.util.function.Function[String, HOption[HoodiePendingRollbackInfo]] =
+ new java.util.function.Function[String, HOption[HoodiePendingRollbackInfo]] {
+ override def apply(commitToRollback: String): HOption[HoodiePendingRollbackInfo] = {
+ tsClient.getPendingRollbackInfo(table.getMetaClient, commitToRollback, false)
+ }
+ }
+
+ val rows = staleInflights.asScala.map { instant =>
+ val status: java.lang.Boolean = try {
+ val result: Boolean = instant.getAction match {
+ case HoodieTimeline.COMPACTION_ACTION =>
Review Comment:
sounds fair, can you take a look @mahsoodebrahim ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412621539
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.92857%` with `102 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 60.85%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 6.45% | [58 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (34e9c7c) and HEAD (a63d034). Click for more details.
>
> <details><summary>HEAD has 18 uploads less than BASE</summary>
>
>| Flag | BASE (34e9c7c) | HEAD (a63d034) |
>|------|------|------|
>|spark-scala-tests|12|6|
>|spark-java-tests|18|6|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 67.92% 60.85% -7.07%
+ Complexity 29003 25958 -3045
============================================
Files 2522 2525 +3
Lines 141166 141289 +123
Branches 17506 17524 +18
============================================
- Hits 95881 85977 -9904
- Misses 37415 47781 +10366
+ Partials 7870 7531 -339
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.38% <0.00%> (+0.21%)` | :arrow_up: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.54% <0.00%> (-17.46%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.70% <8.92%> (-12.20%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.59% <0.00%> (-0.04%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `6.45% <6.45%> (ø)` | |
... and [564 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412614006
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.92857%` with `102 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 47.71%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 6.45% | [58 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (34e9c7c) and HEAD (a63d034). Click for more details.
>
> <details><summary>HEAD has 25 uploads less than BASE</summary>
>
>| Flag | BASE (34e9c7c) | HEAD (a63d034) |
>|------|------|------|
>|spark-scala-tests|12|6|
>|spark-java-tests|18|1|
>|common-and-other-modules|1|0|
>|utilities|1|0|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 67.92% 47.71% -20.21%
+ Complexity 29003 17079 -11924
=============================================
Files 2522 2052 -470
Lines 141166 117281 -23885
Branches 17506 15247 -2259
=============================================
- Hits 95881 55957 -39924
- Misses 37415 55126 +17711
+ Partials 7870 6198 -1672
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.02% <0.00%> (-15.98%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.70% <8.92%> (-12.20%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `6.45% <6.45%> (ø)` | |
... and [1566 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412606930
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `7.27273%` with `102 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 46.77%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 4.91% | [58 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 10.00% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (34e9c7c) and HEAD (a63d034). Click for more details.
>
> <details><summary>HEAD has 31 uploads less than BASE</summary>
>
>| Flag | BASE (34e9c7c) | HEAD (a63d034) |
>|------|------|------|
>|spark-scala-tests|12|1|
>|spark-java-tests|18|0|
>|common-and-other-modules|1|0|
>|utilities|1|0|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 67.92% 46.77% -21.15%
+ Complexity 29003 15305 -13698
=============================================
Files 2522 1966 -556
Lines 141166 107203 -33963
Branches 17506 13059 -4447
=============================================
- Hits 95881 50147 -45734
- Misses 37415 51827 +14412
+ Partials 7870 5229 -2641
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.17% <7.27%> (-11.74%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.50% <100.00%> (-1.24%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `10.00% <10.00%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `4.91% <4.91%> (ø)` | |
... and [1686 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412609669
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.92857%` with `102 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 45.93%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 6.45% | [58 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (34e9c7c) and HEAD (a63d034). Click for more details.
>
> <details><summary>HEAD has 28 uploads less than BASE</summary>
>
>| Flag | BASE (34e9c7c) | HEAD (a63d034) |
>|------|------|------|
>|spark-scala-tests|12|4|
>|spark-java-tests|18|0|
>|common-and-other-modules|1|0|
>|utilities|1|0|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 67.92% 45.93% -21.99%
+ Complexity 29003 15720 -13283
=============================================
Files 2522 2001 -521
Lines 141166 112116 -29050
Branches 17506 14145 -3361
=============================================
- Hits 95881 51502 -44379
- Misses 37415 55042 +17627
+ Partials 7870 5572 -2298
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.94% <8.92%> (-11.97%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `6.45% <6.45%> (ø)` | |
... and [1642 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412627690
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `89.28571%` with `12 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 65.31%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 82.25% | [3 Missing and 8 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 67.92% 65.31% -2.61%
+ Complexity 29003 27867 -1136
============================================
Files 2522 2525 +3
Lines 141166 141289 +123
Branches 17506 17524 +18
============================================
- Hits 95881 92283 -3598
- Misses 37415 41037 +3622
- Partials 7870 7969 +99
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.38% <0.00%> (+0.21%)` | :arrow_up: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.54% <0.00%> (-17.46%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.67% <89.28%> (-0.24%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.59% <0.00%> (-0.04%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `82.25% <82.25%> (ø)` | |
... and [386 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484645870
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `88.98305%` with `13 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 66.28%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 82.35% | [5 Missing and 7 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 68.16% 66.28% -1.89%
+ Complexity 29158 28322 -836
============================================
Files 2521 2524 +3
Lines 141371 141489 +118
Branches 17549 17560 +11
============================================
- Hits 96365 93784 -2581
- Misses 37076 39771 +2695
- Partials 7930 7934 +4
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.39% <0.00%> (-0.04%)` | :arrow_down: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `39.48% <0.00%> (-9.46%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.53% <88.98%> (-0.32%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.52% <0.00%> (-0.05%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `82.35% <82.35%> (ø)` | |
... and [290 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484679657
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `88.98305%` with `13 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 67.74%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 82.35% | [5 Missing and 7 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 68.16% 67.74% -0.43%
+ Complexity 29158 28955 -203
============================================
Files 2521 2524 +3
Lines 141371 141489 +118
Branches 17549 17560 +11
============================================
- Hits 96365 95848 -517
- Misses 37076 37728 +652
+ Partials 7930 7913 -17
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.39% <0.00%> (-0.04%)` | :arrow_down: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.44% <0.00%> (-3.51%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.73% <88.98%> (-0.12%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.52% <0.00%> (-0.05%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `82.35% <82.35%> (ø)` | |
... and [109 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484622290
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.47458%` with `108 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 60.32%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 5.88% | [64 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (9026c7d) and HEAD (807cd80). Click for more details.
>
> <details><summary>HEAD has 20 uploads less than BASE</summary>
>
>| Flag | BASE (9026c7d) | HEAD (807cd80) |
>|------|------|------|
>|spark-scala-tests|12|4|
>|spark-java-tests|18|6|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 68.16% 60.32% -7.84%
+ Complexity 29158 25699 -3459
============================================
Files 2521 2524 +3
Lines 141371 141489 +118
Branches 17549 17560 +11
============================================
- Hits 96365 85357 -11008
- Misses 37076 48787 +11711
+ Partials 7930 7345 -585
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.39% <0.00%> (-0.04%)` | :arrow_down: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.48% <0.00%> (-17.46%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.88% <8.47%> (-11.97%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.52% <0.00%> (-0.05%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `5.88% <5.88%> (ø)` | |
... and [560 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484632746
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `88.98305%` with `13 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 65.04%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 82.35% | [5 Missing and 7 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 68.16% 65.04% -3.13%
+ Complexity 29158 27772 -1386
============================================
Files 2521 2524 +3
Lines 141371 141489 +118
Branches 17549 17560 +11
============================================
- Hits 96365 92028 -4337
- Misses 37076 41591 +4515
+ Partials 7930 7870 -60
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.39% <0.00%> (-0.04%)` | :arrow_down: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.48% <0.00%> (-17.46%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.96% <88.98%> (+0.12%)` | :arrow_up: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.52% <0.00%> (-0.05%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `82.35% <82.35%> (ø)` | |
... and [391 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412559231
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:white_check_mark: All modified and coverable lines are covered by tests.
:white_check_mark: Project coverage is 45.01%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
> :exclamation: There is a different number of reports uploaded between BASE (34e9c7c) and HEAD (a63d034). Click for more details.
>
> <details><summary>HEAD has 33 uploads less than BASE</summary>
>
>| Flag | BASE (34e9c7c) | HEAD (a63d034) |
>|------|------|------|
>|spark-client-hadoop-common|1|0|
>|spark-scala-tests|12|0|
>|spark-java-tests|18|0|
>|common-and-other-modules|1|0|
>|utilities|1|0|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 67.92% 45.01% -22.91%
+ Complexity 29003 8572 -20431
=============================================
Files 2522 1202 -1320
Lines 141166 62804 -78362
Branches 17506 6809 -10697
=============================================
- Hits 95881 28270 -67611
+ Misses 37415 31422 -5993
+ Partials 7870 3112 -4758
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
[see 2120 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412617469
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.92857%` with `102 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 47.87%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 6.45% | [58 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (34e9c7c) and HEAD (a63d034). Click for more details.
>
> <details><summary>HEAD has 21 uploads less than BASE</summary>
>
>| Flag | BASE (34e9c7c) | HEAD (a63d034) |
>|------|------|------|
>|spark-scala-tests|12|6|
>|spark-java-tests|18|5|
>|common-and-other-modules|1|0|
>|utilities|1|0|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 67.92% 47.87% -20.05%
+ Complexity 29003 17136 -11867
=============================================
Files 2522 2052 -470
Lines 141166 117281 -23885
Branches 17506 15247 -2259
=============================================
- Hits 95881 56153 -39728
- Misses 37415 54956 +17541
+ Partials 7870 6172 -1698
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.54% <0.00%> (-17.46%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.70% <8.92%> (-12.20%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `6.45% <6.45%> (ø)` | |
... and [1564 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412642724
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `91.96429%` with `9 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 67.24%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 87.09% | [2 Missing and 6 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 67.92% 67.24% -0.68%
+ Complexity 29003 28693 -310
============================================
Files 2522 2525 +3
Lines 141166 141289 +123
Branches 17506 17524 +18
============================================
- Hits 95881 95004 -877
- Misses 37415 38352 +937
- Partials 7870 7933 +63
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.38% <0.00%> (+0.21%)` | :arrow_up: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.77% <0.00%> (-4.23%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.89% <91.96%> (-0.02%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.59% <0.00%> (-0.04%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `87.09% <87.09%> (ø)` | |
... and [176 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412648395
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `91.96429%` with `9 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 68.16%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 87.09% | [2 Missing and 6 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
+ Coverage 67.92% 68.16% +0.24%
- Complexity 29003 29112 +109
============================================
Files 2522 2525 +3
Lines 141166 141289 +123
Branches 17506 17524 +18
============================================
+ Hits 95881 96315 +434
+ Misses 37415 37061 -354
- Partials 7870 7913 +43
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.38% <0.00%> (+0.21%)` | :arrow_up: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.85% <0.00%> (-0.15%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.96% <91.96%> (+0.06%)` | :arrow_up: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.59% <0.00%> (-0.04%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `87.09% <87.09%> (ø)` | |
... and [24 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412647868
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `91.96429%` with `9 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 68.16%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 87.09% | [2 Missing and 6 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
+ Coverage 67.92% 68.16% +0.24%
- Complexity 29003 29110 +107
============================================
Files 2522 2525 +3
Lines 141166 141289 +123
Branches 17506 17524 +18
============================================
+ Hits 95881 96313 +432
+ Misses 37415 37062 -353
- Partials 7870 7914 +44
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.38% <0.00%> (+0.21%)` | :arrow_up: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.82% <0.00%> (-0.18%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.96% <91.96%> (+0.06%)` | :arrow_up: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.59% <0.00%> (-0.04%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `87.09% <87.09%> (ø)` | |
... and [26 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4412682658
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `91.96429%` with `9 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 68.17%. Comparing base ([`34e9c7c`](https://app.codecov.io/gh/apache/hudi/commit/34e9c7c5bbdc30143a3f2dbb6931149f6350357f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a63d034`](https://app.codecov.io/gh/apache/hudi/commit/a63d034124180364c70b37770bbc0f4a5590e46e?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 87.09% | [2 Missing and 6 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
+ Coverage 67.92% 68.17% +0.25%
- Complexity 29003 29113 +110
============================================
Files 2522 2525 +3
Lines 141166 141289 +123
Branches 17506 17524 +18
============================================
+ Hits 95881 96321 +440
+ Misses 37415 37057 -358
- Partials 7870 7911 +41
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.38% <0.00%> (+0.21%)` | :arrow_up: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.01% <ø> (+0.01%)` | :arrow_up: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.35% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.96% <0.00%> (-0.04%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.96% <91.96%> (+0.06%)` | :arrow_up: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.59% <0.00%> (-0.04%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `87.09% <87.09%> (ø)` | |
... and [19 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484596582
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.47458%` with `108 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 47.77%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 5.88% | [64 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (9026c7d) and HEAD (807cd80). Click for more details.
>
> <details><summary>HEAD has 28 uploads less than BASE</summary>
>
>| Flag | BASE (9026c7d) | HEAD (807cd80) |
>|------|------|------|
>|spark-scala-tests|12|3|
>|utilities|1|0|
>|common-and-other-modules|1|0|
>|spark-java-tests|18|1|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
=============================================
- Coverage 68.16% 47.77% -20.39%
+ Complexity 29158 16730 -12428
=============================================
Files 2521 2035 -486
Lines 141371 115142 -26229
Branches 17549 14758 -2791
=============================================
- Hits 96365 55009 -41356
- Misses 37076 54201 +17125
+ Partials 7930 5932 -1998
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.98% <0.00%> (-15.97%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.83% <8.47%> (-12.01%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `5.88% <5.88%> (ø)` | |
... and [1580 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484623407
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `8.47458%` with `108 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 60.63%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 5.88% | [64 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | 12.90% | [27 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 0.00% | [17 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (9026c7d) and HEAD (807cd80). Click for more details.
>
> <details><summary>HEAD has 19 uploads less than BASE</summary>
>
>| Flag | BASE (9026c7d) | HEAD (807cd80) |
>|------|------|------|
>|spark-scala-tests|12|5|
>|spark-java-tests|18|6|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 68.16% 60.63% -7.54%
+ Complexity 29158 25876 -3282
============================================
Files 2521 2524 +3
Lines 141371 141489 +118
Branches 17549 17560 +11
============================================
- Hits 96365 85786 -10579
- Misses 37076 48247 +11171
+ Partials 7930 7456 -474
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.39% <0.00%> (-0.04%)` | :arrow_down: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `31.48% <0.00%> (-17.46%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `32.87% <8.47%> (-11.98%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.52% <0.00%> (-0.05%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `97.53% <100.00%> (-1.21%)` | :arrow_down: |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `0.00% <0.00%> (ø)` | |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `12.90% <12.90%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `5.88% <5.88%> (ø)` | |
... and [555 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(spark): add show_inflight_commits and cleanup_stale_inflight_com… [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18709:
URL: https://github.com/apache/hudi/pull/18709#issuecomment-4484674971
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `88.98305%` with `13 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 66.39%. Comparing base ([`9026c7d`](https://app.codecov.io/gh/apache/hudi/commit/9026c7defd5d012d825996ac6f1eebef23079467?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`807cd80`](https://app.codecov.io/gh/apache/hudi/commit/807cd801412175073cea62b801a8955e7983b48f?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 1 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | 82.35% | [5 Missing and 7 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | 94.11% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18709 +/- ##
============================================
- Coverage 68.16% 66.39% -1.78%
+ Complexity 29158 28384 -774
============================================
Files 2521 2524 +3
Lines 141371 141489 +118
Branches 17549 17560 +11
============================================
- Hits 96365 93938 -2427
- Misses 37076 39583 +2507
- Partials 7930 7968 +38
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [common-and-other-modules](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.39% <0.00%> (-0.04%)` | :arrow_down: |
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.00% <ø> (-0.01%)` | :arrow_down: |
| [spark-client-hadoop-common](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `48.31% <ø> (+<0.01%)` | :arrow_up: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `39.48% <0.00%> (-9.46%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `44.73% <88.98%> (-0.12%)` | :arrow_down: |
| [utilities](https://app.codecov.io/gh/apache/hudi/pull/18709/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `37.52% <0.00%> (-0.05%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18709?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...sql/hudi/command/procedures/HoodieProcedures.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FHoodieProcedures.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvSG9vZGllUHJvY2VkdXJlcy5zY2FsYQ==) | `98.76% <100.00%> (+0.03%)` | :arrow_up: |
| [...mand/procedures/ShowInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FShowInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvU2hvd0luZmxpZ2h0Q29tbWl0c1Byb2NlZHVyZS5zY2FsYQ==) | `100.00% <100.00%> (ø)` | |
| [...ava/org/apache/hudi/HoodieTimelineCleanupUtil.java](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2FHoodieTimelineCleanupUtil.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3BhcmstY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL0hvb2RpZVRpbWVsaW5lQ2xlYW51cFV0aWwuamF2YQ==) | `94.11% <94.11%> (ø)` | |
| [...cedures/CleanupStaleInflightCommitsProcedure.scala](https://app.codecov.io/gh/apache/hudi/pull/18709?src=pr&el=tree&filepath=hudi-spark-datasource%2Fhudi-spark%2Fsrc%2Fmain%2Fscala%2Forg%2Fapache%2Fspark%2Fsql%2Fhudi%2Fcommand%2Fprocedures%2FCleanupStaleInflightCommitsProcedure.scala&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1zcGFyay1kYXRhc291cmNlL2h1ZGktc3Bhcmsvc3JjL21haW4vc2NhbGEvb3JnL2FwYWNoZS9zcGFyay9zcWwvaHVkaS9jb21tYW5kL3Byb2NlZHVyZXMvQ2xlYW51cFN0YWxlSW5mbGlnaHRDb21taXRzUHJvY2VkdXJlLnNjYWxh) | `82.35% <82.35%> (ø)` | |
... and [269 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18709/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org