You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "prashantwason (via GitHub)" <gi...@apache.org> on 2026/01/28 23:51:01 UTC
[PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
prashantwason opened a new pull request, #18029:
URL: https://github.com/apache/hudi/pull/18029
### Describe the issue this Pull Request addresses
Closes #18028
When bootstrapping the record index, there is currently no validation to ensure that the expected number of records matches the actual number of records written to the metadata table. This can lead to silent data integrity issues.
### Summary and Changelog
This PR adds validation for record index bootstrap by comparing the expected record count with the actual record count stored in the metadata table.
**Changes:**
- Added `validateRecordIndex` method in `HoodieBackedTableMetadataWriter` to validate record counts after bootstrap completes
- Added `getTotalRecordIndexRecords` method in `HoodieBackedTableMetadata` to get total records from file slice base files
- Updated `initializeFilegroupsAndCommitToRecordIndexPartition` to call validation after commit when duplicates are not allowed (controlled by `hoodie.hfile.writes.allow.duplicates` config)
- Updated `initializeFilegroupsAndCommitToPartitionedRecordIndexPartition` to return file group count for validation
### Impact
- Improves data integrity for record index bootstrap
- Validation is enabled by default (when `hoodie.hfile.writes.allow.duplicates=false`)
- If validation fails, the bootstrap will throw an exception with details about the mismatch
### Risk Level
low - This adds validation logic that runs after the existing bootstrap completes. It does not change the bootstrap behavior itself, only adds a post-commit verification step.
### Documentation Update
none - No new configs are added. The validation uses the existing `hoodie.hfile.writes.allow.duplicates` config.
### Contributor's checklist
- [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [x] Enough context is provided in the sections above
- [ ] Adequate tests were added if applicable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3892746523
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
}, {
"hash" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611",
"triggerID" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112516",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"triggerType" : "PUSH"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "3887752133",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "3892716989",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 428aaf9c972e5fd52235721a70b6d9349a3125f7 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3950361520
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `51.78571%` with `27 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 57.26%. Comparing base ([`894b817`](https://app.codecov.io/gh/apache/hudi/commit/894b817f79af42fa61179ed9d0842d61e7d3c07c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`097309b`](https://app.codecov.io/gh/apache/hudi/commit/097309b1d8ee52ee96507e7f41085c29876a8e31?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | 44.89% | [25 Missing and 2 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18029 +/- ##
============================================
- Coverage 57.28% 57.26% -0.02%
+ Complexity 18535 18526 -9
============================================
Files 1944 1944
Lines 106137 106191 +54
Branches 13119 13124 +5
============================================
+ Hits 60798 60810 +12
- Misses 39617 39653 +36
- Partials 5722 5728 +6
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.38% <14.28%> (-0.04%)` | :arrow_down: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `47.34% <51.78%> (-0.08%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.48% <14.28%> (-0.02%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...pache/hudi/common/config/HoodieMetadataConfig.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fcommon%2Fconfig%2FHoodieMetadataConfig.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL2NvbmZpZy9Ib29kaWVNZXRhZGF0YUNvbmZpZy5qYXZh) | `83.35% <100.00%> (+0.18%)` | :arrow_up: |
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | `79.78% <44.89%> (-1.57%)` | :arrow_down: |
... and [9 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18029/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on code in PR #18029:
URL: https://github.com/apache/hudi/pull/18029#discussion_r2748124026
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java:
##########
@@ -738,18 +738,26 @@ private void initializeFilegroupsAndCommitToRecordIndexPartition(String commitTi
Lazy<List<Pair<String, FileSlice>>> lazyLatestMergedPartitionFileSliceList, boolean isPartitionedRLI) throws IOException {
createRecordIndexDefinition(dataMetaClient, Collections.singletonMap(HoodieRecordIndex.IS_PARTITIONED_OPTION, String.valueOf(isPartitionedRLI)));
HoodieData<HoodieRecord> recordIndexRecords;
+ int fileGroupCount;
if (isPartitionedRLI) {
- recordIndexRecords = initializeFilegroupsAndCommitToPartitionedRecordIndexPartition(commitTimeForPartition, lazyLatestMergedPartitionFileSliceList);
+ Pair<Integer, HoodieData<HoodieRecord>> fgCountAndRecords = initializeFilegroupsAndCommitToPartitionedRecordIndexPartition(commitTimeForPartition, lazyLatestMergedPartitionFileSliceList);
+ fileGroupCount = fgCountAndRecords.getKey();
+ recordIndexRecords = fgCountAndRecords.getValue();
} else {
Pair<Integer, HoodieData<HoodieRecord>> fgCountAndRecordIndexRecords = initializeRecordIndexPartition(lazyLatestMergedPartitionFileSliceList.get(),
dataWriteConfig.getMetadataConfig().getRecordIndexMaxParallelism());
+ fileGroupCount = fgCountAndRecordIndexRecords.getKey();
recordIndexRecords = fgCountAndRecordIndexRecords.getRight();
initializeFilegroupsAndCommit(RECORD_INDEX, RECORD_INDEX.getPartitionPath(), fgCountAndRecordIndexRecords, commitTimeForPartition);
}
+ // Validate record index after commit if duplicates are not allowed
+ if (!dataWriteConfig.allowDuplicatesWithHfileWrites()) {
+ validateRecordIndex(recordIndexRecords.count(), fileGroupCount);
Review Comment:
If you take a look at the dag, we are not persisting `recordIndexRecords` in some cases. so, this will trigger the dag again.
I would recommend to add a flag and do validation only if enabled.
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java:
##########
@@ -833,6 +842,29 @@ private int estimateFileGroupCount(HoodieData<HoodieRecord> records) {
);
}
+ /**
+ * Validates the record index after bootstrap by comparing the expected record count with the actual
+ * record count stored in the metadata table.
+ *
+ * @param recordCount the expected number of records
+ * @param fileGroupCount the expected number of file groups
+ */
+ private void validateRecordIndex(long recordCount, int fileGroupCount) {
+ String partitionName = MetadataPartitionType.RECORD_INDEX.getPartitionPath();
+ HoodieTableFileSystemView fsView = HoodieTableMetadataUtil.getFileSystemViewForMetadataTable(metadataMetaClient);
+ List<FileSlice> fileSlices = HoodieTableMetadataUtil.getPartitionLatestFileSlices(metadataMetaClient, Option.of(fsView), partitionName);
Review Comment:
we should ensure under the hood, this calls getLatestMergedFileSlicesBeforeOrOn() in fsv
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java:
##########
@@ -833,6 +842,29 @@ private int estimateFileGroupCount(HoodieData<HoodieRecord> records) {
);
}
+ /**
+ * Validates the record index after bootstrap by comparing the expected record count with the actual
+ * record count stored in the metadata table.
+ *
+ * @param recordCount the expected number of records
+ * @param fileGroupCount the expected number of file groups
+ */
+ private void validateRecordIndex(long recordCount, int fileGroupCount) {
+ String partitionName = MetadataPartitionType.RECORD_INDEX.getPartitionPath();
+ HoodieTableFileSystemView fsView = HoodieTableMetadataUtil.getFileSystemViewForMetadataTable(metadataMetaClient);
+ List<FileSlice> fileSlices = HoodieTableMetadataUtil.getPartitionLatestFileSlices(metadataMetaClient, Option.of(fsView), partitionName);
+ long totalRecords = 0L;
+ for (FileSlice fileSlice : fileSlices) {
Review Comment:
why can't we do spark distributed manner instead of doing it inline in driver?
for 10k file groups or more, this is going to lot of time in driver right
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3857113304
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
}, {
"hash" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611",
"triggerID" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3857112516",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "CANCELED",
"url" : "TBD",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "CANCELED",
"url" : "TBD",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 0000 Unknown: [CANCELED](TBD)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3950081466
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `14.28571%` with `48 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 45.38%. Comparing base ([`894b817`](https://app.codecov.io/gh/apache/hudi/commit/894b817f79af42fa61179ed9d0842d61e7d3c07c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`097309b`](https://app.codecov.io/gh/apache/hudi/commit/097309b1d8ee52ee96507e7f41085c29876a8e31?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | 2.04% | [47 Missing and 1 partial :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18029 +/- ##
============================================
- Coverage 45.41% 45.38% -0.04%
Complexity 8371 8371
============================================
Files 1177 1177
Lines 60239 60293 +54
Branches 6414 6417 +3
============================================
+ Hits 27359 27365 +6
- Misses 29906 29953 +47
- Partials 2974 2975 +1
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.38% <14.28%> (-0.04%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...pache/hudi/common/config/HoodieMetadataConfig.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fcommon%2Fconfig%2FHoodieMetadataConfig.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL2NvbmZpZy9Ib29kaWVNZXRhZGF0YUNvbmZpZy5qYXZh) | `78.12% <100.00%> (+0.23%)` | :arrow_up: |
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | `51.22% <2.04%> (-2.19%)` | :arrow_down: |
... and [3 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18029/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3950380792
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `51.78571%` with `27 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 57.27%. Comparing base ([`894b817`](https://app.codecov.io/gh/apache/hudi/commit/894b817f79af42fa61179ed9d0842d61e7d3c07c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`097309b`](https://app.codecov.io/gh/apache/hudi/commit/097309b1d8ee52ee96507e7f41085c29876a8e31?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | 44.89% | [25 Missing and 2 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18029 +/- ##
============================================
- Coverage 57.28% 57.27% -0.01%
+ Complexity 18535 18528 -7
============================================
Files 1944 1944
Lines 106137 106191 +54
Branches 13119 13124 +5
============================================
+ Hits 60798 60819 +21
- Misses 39617 39647 +30
- Partials 5722 5725 +3
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.38% <14.28%> (-0.04%)` | :arrow_down: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `47.42% <51.78%> (-0.01%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.48% <14.28%> (-0.02%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...pache/hudi/common/config/HoodieMetadataConfig.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fcommon%2Fconfig%2FHoodieMetadataConfig.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL2NvbmZpZy9Ib29kaWVNZXRhZGF0YUNvbmZpZy5qYXZh) | `83.35% <100.00%> (+0.18%)` | :arrow_up: |
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | `79.78% <44.89%> (-1.57%)` | :arrow_down: |
... and [6 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18029/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "prashantwason (via GitHub)" <gi...@apache.org>.
prashantwason commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3857112516
@hudi-bot run github
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3950206726
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `14.28571%` with `48 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 39.70%. Comparing base ([`894b817`](https://app.codecov.io/gh/apache/hudi/commit/894b817f79af42fa61179ed9d0842d61e7d3c07c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`097309b`](https://app.codecov.io/gh/apache/hudi/commit/097309b1d8ee52ee96507e7f41085c29876a8e31?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | 2.04% | [47 Missing and 1 partial :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (894b817) and HEAD (097309b). Click for more details.
>
> <details><summary>HEAD has 4 uploads less than BASE</summary>
>
>| Flag | BASE (894b817) | HEAD (097309b) |
>|------|------|------|
>|spark-scala-tests|4|3|
>|spark-java-tests|3|0|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18029 +/- ##
=============================================
- Coverage 51.73% 39.70% -12.04%
+ Complexity 16539 12572 -3967
=============================================
Files 1944 1944
Lines 106137 106191 +54
Branches 13119 13124 +5
=============================================
- Hits 54907 42160 -12747
- Misses 45310 58972 +13662
+ Partials 5920 5059 -861
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.38% <14.28%> (-0.04%)` | :arrow_down: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.15% <14.28%> (-12.15%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...pache/hudi/common/config/HoodieMetadataConfig.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fcommon%2Fconfig%2FHoodieMetadataConfig.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL2NvbmZpZy9Ib29kaWVNZXRhZGF0YUNvbmZpZy5qYXZh) | `78.73% <100.00%> (-1.80%)` | :arrow_down: |
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | `58.02% <2.04%> (-16.70%)` | :arrow_down: |
... and [594 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18029/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3947489551
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
}, {
"hash" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611",
"triggerID" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112516",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"triggerType" : "PUSH"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "3887752133",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "3892716989",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "3947467728",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 428aaf9c972e5fd52235721a70b6d9349a3125f7 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3950295124
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `14.28571%` with `48 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 55.29%. Comparing base ([`894b817`](https://app.codecov.io/gh/apache/hudi/commit/894b817f79af42fa61179ed9d0842d61e7d3c07c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`097309b`](https://app.codecov.io/gh/apache/hudi/commit/097309b1d8ee52ee96507e7f41085c29876a8e31?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | 2.04% | [47 Missing and 1 partial :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18029 +/- ##
============================================
- Coverage 57.28% 55.29% -1.99%
+ Complexity 18535 17845 -690
============================================
Files 1944 1944
Lines 106137 106191 +54
Branches 13119 13124 +5
============================================
- Hits 60798 58716 -2082
- Misses 39617 41690 +2073
- Partials 5722 5785 +63
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.38% <14.28%> (-0.04%)` | :arrow_down: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `43.19% <14.28%> (-4.24%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.48% <14.28%> (-0.02%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...pache/hudi/common/config/HoodieMetadataConfig.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fcommon%2Fconfig%2FHoodieMetadataConfig.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL2NvbmZpZy9Ib29kaWVNZXRhZGF0YUNvbmZpZy5qYXZh) | `82.43% <100.00%> (-0.75%)` | :arrow_down: |
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | `71.62% <2.04%> (-9.73%)` | :arrow_down: |
... and [267 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18029/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3950230682
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `14.28571%` with `48 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 43.48%. Comparing base ([`894b817`](https://app.codecov.io/gh/apache/hudi/commit/894b817f79af42fa61179ed9d0842d61e7d3c07c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`097309b`](https://app.codecov.io/gh/apache/hudi/commit/097309b1d8ee52ee96507e7f41085c29876a8e31?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | 2.04% | [47 Missing and 1 partial :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (894b817) and HEAD (097309b). Click for more details.
>
> <details><summary>HEAD has 7 uploads less than BASE</summary>
>
>| Flag | BASE (894b817) | HEAD (097309b) |
>|------|------|------|
>|spark-scala-tests|6|3|
>|spark-java-tests|6|2|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18029 +/- ##
=============================================
- Coverage 55.54% 43.48% -12.07%
+ Complexity 17918 13821 -4097
=============================================
Files 1944 1944
Lines 106137 106191 +54
Branches 13119 13124 +5
=============================================
- Hits 58955 46172 -12783
- Misses 41390 54712 +13322
+ Partials 5792 5307 -485
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.38% <14.28%> (-0.04%)` | :arrow_down: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.58% <14.28%> (-9.95%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.15% <14.28%> (-12.36%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...pache/hudi/common/config/HoodieMetadataConfig.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fcommon%2Fconfig%2FHoodieMetadataConfig.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL2NvbmZpZy9Ib29kaWVNZXRhZGF0YUNvbmZpZy5qYXZh) | `79.50% <100.00%> (-2.74%)` | :arrow_down: |
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | `67.72% <2.04%> (-7.00%)` | :arrow_down: |
... and [693 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18029/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3950207176
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `14.28571%` with `48 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 39.70%. Comparing base ([`894b817`](https://app.codecov.io/gh/apache/hudi/commit/894b817f79af42fa61179ed9d0842d61e7d3c07c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`097309b`](https://app.codecov.io/gh/apache/hudi/commit/097309b1d8ee52ee96507e7f41085c29876a8e31?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | 2.04% | [47 Missing and 1 partial :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (894b817) and HEAD (097309b). Click for more details.
>
> <details><summary>HEAD has 4 uploads less than BASE</summary>
>
>| Flag | BASE (894b817) | HEAD (097309b) |
>|------|------|------|
>|spark-scala-tests|4|3|
>|spark-java-tests|3|0|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18029 +/- ##
=============================================
- Coverage 51.73% 39.70% -12.04%
+ Complexity 16539 12572 -3967
=============================================
Files 1944 1944
Lines 106137 106191 +54
Branches 13119 13124 +5
=============================================
- Hits 54907 42160 -12747
- Misses 45310 58972 +13662
+ Partials 5920 5059 -861
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.38% <14.28%> (-0.04%)` | :arrow_down: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `?` | |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.15% <14.28%> (-12.15%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...pache/hudi/common/config/HoodieMetadataConfig.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fcommon%2Fconfig%2FHoodieMetadataConfig.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL2NvbmZpZy9Ib29kaWVNZXRhZGF0YUNvbmZpZy5qYXZh) | `78.73% <100.00%> (-1.80%)` | :arrow_down: |
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | `58.02% <2.04%> (-16.70%)` | :arrow_down: |
... and [594 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18029/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3950250268
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `14.28571%` with `48 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 43.52%. Comparing base ([`894b817`](https://app.codecov.io/gh/apache/hudi/commit/894b817f79af42fa61179ed9d0842d61e7d3c07c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`097309b`](https://app.codecov.io/gh/apache/hudi/commit/097309b1d8ee52ee96507e7f41085c29876a8e31?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | 2.04% | [47 Missing and 1 partial :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (894b817) and HEAD (097309b). Click for more details.
>
> <details><summary>HEAD has 6 uploads less than BASE</summary>
>
>| Flag | BASE (894b817) | HEAD (097309b) |
>|------|------|------|
>|spark-scala-tests|6|3|
>|spark-java-tests|6|3|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18029 +/- ##
=============================================
- Coverage 55.54% 43.52% -12.02%
+ Complexity 17918 13832 -4086
=============================================
Files 1944 1944
Lines 106137 106191 +54
Branches 13119 13124 +5
=============================================
- Hits 58955 46221 -12734
- Misses 41390 54674 +13284
+ Partials 5792 5296 -496
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.38% <14.28%> (-0.04%)` | :arrow_down: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.22% <14.28%> (-10.31%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.15% <14.28%> (-12.36%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...pache/hudi/common/config/HoodieMetadataConfig.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fcommon%2Fconfig%2FHoodieMetadataConfig.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL2NvbmZpZy9Ib29kaWVNZXRhZGF0YUNvbmZpZy5qYXZh) | `79.50% <100.00%> (-2.74%)` | :arrow_down: |
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | `67.72% <2.04%> (-7.00%)` | :arrow_down: |
... and [691 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18029/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "prashantwason (via GitHub)" <gi...@apache.org>.
prashantwason commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3857112457
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3950234861
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `14.28571%` with `48 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 43.48%. Comparing base ([`894b817`](https://app.codecov.io/gh/apache/hudi/commit/894b817f79af42fa61179ed9d0842d61e7d3c07c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`097309b`](https://app.codecov.io/gh/apache/hudi/commit/097309b1d8ee52ee96507e7f41085c29876a8e31?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | 2.04% | [47 Missing and 1 partial :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (894b817) and HEAD (097309b). Click for more details.
>
> <details><summary>HEAD has 7 uploads less than BASE</summary>
>
>| Flag | BASE (894b817) | HEAD (097309b) |
>|------|------|------|
>|spark-scala-tests|6|3|
>|spark-java-tests|6|2|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18029 +/- ##
=============================================
- Coverage 55.54% 43.48% -12.07%
+ Complexity 17918 13821 -4097
=============================================
Files 1944 1944
Lines 106137 106191 +54
Branches 13119 13124 +5
=============================================
- Hits 58955 46172 -12783
- Misses 41390 54712 +13322
+ Partials 5792 5307 -485
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.38% <14.28%> (-0.04%)` | :arrow_down: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.58% <14.28%> (-9.95%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.15% <14.28%> (-12.36%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...pache/hudi/common/config/HoodieMetadataConfig.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fcommon%2Fconfig%2FHoodieMetadataConfig.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL2NvbmZpZy9Ib29kaWVNZXRhZGF0YUNvbmZpZy5qYXZh) | `79.50% <100.00%> (-2.74%)` | :arrow_down: |
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | `67.72% <2.04%> (-7.00%)` | :arrow_down: |
... and [693 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18029/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3892728182
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
}, {
"hash" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611",
"triggerID" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112516",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"triggerType" : "PUSH"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "3887752133",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3892716989",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 428aaf9c972e5fd52235721a70b6d9349a3125f7 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3857121664
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
}, {
"hash" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611",
"triggerID" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112516",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"triggerType" : "PUSH"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 3698408061f1b4d9a8b221ad81c6b6ad372caced Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707)
* 428aaf9c972e5fd52235721a70b6d9349a3125f7 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3857787894
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
}, {
"hash" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611",
"triggerID" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112516",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 428aaf9c972e5fd52235721a70b6d9349a3125f7 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3814547460
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 73f816a5ea57cc3afde70f6371d109cdb856324e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3857129336
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
}, {
"hash" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611",
"triggerID" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112516",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3698408061f1b4d9a8b221ad81c6b6ad372caced Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707)
* 428aaf9c972e5fd52235721a70b6d9349a3125f7 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3856349703
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
}, {
"hash" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611",
"triggerID" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3698408061f1b4d9a8b221ad81c6b6ad372caced Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3887758138
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
}, {
"hash" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611",
"triggerID" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112516",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"triggerType" : "PUSH"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3887752133",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 428aaf9c972e5fd52235721a70b6d9349a3125f7 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-4301319643
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `51.78571%` with `27 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 57.27%. Comparing base ([`894b817`](https://app.codecov.io/gh/apache/hudi/commit/894b817f79af42fa61179ed9d0842d61e7d3c07c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`097309b`](https://app.codecov.io/gh/apache/hudi/commit/097309b1d8ee52ee96507e7f41085c29876a8e31?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 168 commits behind head on master.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | 44.89% | [25 Missing and 2 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18029 +/- ##
============================================
- Coverage 57.28% 57.27% -0.01%
+ Complexity 18535 18528 -7
============================================
Files 1944 1944
Lines 106137 106191 +54
Branches 13119 13124 +5
============================================
+ Hits 60798 60819 +21
- Misses 39617 39647 +30
- Partials 5722 5725 +3
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.38% <14.28%> (-0.04%)` | :arrow_down: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `47.42% <51.78%> (-0.01%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.48% <14.28%> (-0.02%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...pache/hudi/common/config/HoodieMetadataConfig.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fcommon%2Fconfig%2FHoodieMetadataConfig.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL2NvbmZpZy9Ib29kaWVNZXRhZGF0YUNvbmZpZy5qYXZh) | `83.35% <100.00%> (+0.18%)` | :arrow_up: |
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | `79.78% <44.89%> (-1.57%)` | :arrow_down: |
... and [6 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18029/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3950023710
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
}, {
"hash" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611",
"triggerID" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112516",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"triggerType" : "PUSH"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "3887752133",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "3892716989",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "3947467728",
"triggerType" : "MANUAL"
}, {
"hash" : "097309b1d8ee52ee96507e7f41085c29876a8e31",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3950016355",
"triggerType" : "MANUAL"
}, {
"hash" : "",
"status" : "CANCELED",
"url" : "TBD",
"triggerID" : "3950016355",
"triggerType" : "MANUAL"
}, {
"hash" : "097309b1d8ee52ee96507e7f41085c29876a8e31",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "097309b1d8ee52ee96507e7f41085c29876a8e31",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* Unknown: [CANCELED](TBD)
* 097309b1d8ee52ee96507e7f41085c29876a8e31 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3950276457
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `14.28571%` with `48 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 51.67%. Comparing base ([`894b817`](https://app.codecov.io/gh/apache/hudi/commit/894b817f79af42fa61179ed9d0842d61e7d3c07c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`097309b`](https://app.codecov.io/gh/apache/hudi/commit/097309b1d8ee52ee96507e7f41085c29876a8e31?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | 2.04% | [47 Missing and 1 partial :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (894b817) and HEAD (097309b). Click for more details.
>
> <details><summary>HEAD has 6 uploads less than BASE</summary>
>
>| Flag | BASE (894b817) | HEAD (097309b) |
>|------|------|------|
>|spark-scala-tests|6|4|
>|spark-java-tests|7|3|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18029 +/- ##
============================================
- Coverage 57.27% 51.67% -5.60%
+ Complexity 18533 16518 -2015
============================================
Files 1944 1944
Lines 106137 106191 +54
Branches 13119 13124 +5
============================================
- Hits 60787 54872 -5915
- Misses 39624 45408 +5784
- Partials 5726 5911 +185
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.38% <14.28%> (-0.04%)` | :arrow_down: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.22% <14.28%> (-14.13%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.23% <14.28%> (-0.28%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...pache/hudi/common/config/HoodieMetadataConfig.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fcommon%2Fconfig%2FHoodieMetadataConfig.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL2NvbmZpZy9Ib29kaWVNZXRhZGF0YUNvbmZpZy5qYXZh) | `80.73% <100.00%> (-2.44%)` | :arrow_down: |
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | `71.62% <2.04%> (-9.73%)` | :arrow_down: |
... and [536 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18029/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on code in PR #18029:
URL: https://github.com/apache/hudi/pull/18029#discussion_r2765810230
##########
hudi-common/src/main/java/org/apache/hudi/common/config/HoodieMetadataConfig.java:
##########
@@ -616,6 +616,15 @@ public final class HoodieMetadataConfig extends HoodieConfig {
+ "honor the set value for number of tasks. If not, number of write status's from data "
+ "table writes will be used for metadata table record preparation");
+ public static final ConfigProperty<Boolean> RECORD_INDEX_BOOTSTRAP_VALIDATION_ENABLE = ConfigProperty
+ .key(METADATA_PREFIX + ".record.index.bootstrap.validation.enable")
Review Comment:
we already have a feature for bootstrap. and hence, we avoid using "bootstrap" for mdt partitions.
we generally use, "initializing mdt partitions".
So, can we name the config
`hoodie.metadata.record.index.enable.validation.on.initailization`
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java:
##########
@@ -833,6 +845,79 @@ private int estimateFileGroupCount(HoodieData<HoodieRecord> records) {
);
}
+ /**
+ * Validates the record index after bootstrap by comparing the expected record count with the actual
+ * record count stored in the metadata table. The validation is performed in a distributed manner
+ * using the engine context to count records from HFiles in parallel.
+ *
+ * @param recordIndexRecords the HoodieData containing the expected records
+ * @param fileGroupCount the expected number of file groups
+ */
+ private void validateRecordIndex(HoodieData<HoodieRecord> recordIndexRecords, int fileGroupCount) {
+ String partitionName = MetadataPartitionType.RECORD_INDEX.getPartitionPath();
+ HoodieTableFileSystemView fsView = HoodieTableMetadataUtil.getFileSystemViewForMetadataTable(metadataMetaClient);
Review Comment:
we need to close the FSV at the end of this method
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3837711329
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
}, {
"hash" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 73f816a5ea57cc3afde70f6371d109cdb856324e Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468)
* deee71e5e6b41c0d021602d403e6d8ebec321425 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3838356043
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
}, {
"hash" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611",
"triggerID" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* deee71e5e6b41c0d021602d403e6d8ebec321425 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "prashantwason (via GitHub)" <gi...@apache.org>.
prashantwason commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3892716989
Previous CI failure was a Docker infrastructure issue (exit code 1). Restarting CI.
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3950366686
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `51.78571%` with `27 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 57.26%. Comparing base ([`894b817`](https://app.codecov.io/gh/apache/hudi/commit/894b817f79af42fa61179ed9d0842d61e7d3c07c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`097309b`](https://app.codecov.io/gh/apache/hudi/commit/097309b1d8ee52ee96507e7f41085c29876a8e31?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | 44.89% | [25 Missing and 2 partials :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18029 +/- ##
============================================
- Coverage 57.28% 57.26% -0.02%
+ Complexity 18535 18526 -9
============================================
Files 1944 1944
Lines 106137 106191 +54
Branches 13119 13124 +5
============================================
+ Hits 60798 60810 +12
- Misses 39617 39653 +36
- Partials 5722 5728 +6
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.38% <14.28%> (-0.04%)` | :arrow_down: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `47.38% <51.78%> (-0.05%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.48% <14.28%> (-0.02%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...pache/hudi/common/config/HoodieMetadataConfig.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fcommon%2Fconfig%2FHoodieMetadataConfig.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL2NvbmZpZy9Ib29kaWVNZXRhZGF0YUNvbmZpZy5qYXZh) | `83.35% <100.00%> (+0.18%)` | :arrow_up: |
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | `79.78% <44.89%> (-1.57%)` | :arrow_down: |
... and [9 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18029/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3855854914
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
}, {
"hash" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611",
"triggerID" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* deee71e5e6b41c0d021602d403e6d8ebec321425 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611)
* 3698408061f1b4d9a8b221ad81c6b6ad372caced Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3855836103
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
}, {
"hash" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611",
"triggerID" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* deee71e5e6b41c0d021602d403e6d8ebec321425 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611)
* 3698408061f1b4d9a8b221ad81c6b6ad372caced UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3868537690
hey @prashantwason : can you follow up on CI failure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "prashantwason (via GitHub)" <gi...@apache.org>.
prashantwason commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3887752133
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3950038078
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
}, {
"hash" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611",
"triggerID" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112516",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"triggerType" : "PUSH"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "3887752133",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "3892716989",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "3947467728",
"triggerType" : "MANUAL"
}, {
"hash" : "",
"status" : "CANCELED",
"url" : "TBD",
"triggerID" : "3950016355",
"triggerType" : "MANUAL"
}, {
"hash" : "097309b1d8ee52ee96507e7f41085c29876a8e31",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=12275",
"triggerID" : "3950016355",
"triggerType" : "MANUAL"
}, {
"hash" : "097309b1d8ee52ee96507e7f41085c29876a8e31",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=12275",
"triggerID" : "097309b1d8ee52ee96507e7f41085c29876a8e31",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* Unknown: [CANCELED](TBD)
* 097309b1d8ee52ee96507e7f41085c29876a8e31 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=12275)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3951163997
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
}, {
"hash" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611",
"triggerID" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112516",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"triggerType" : "PUSH"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "3887752133",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "3892716989",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "3947467728",
"triggerType" : "MANUAL"
}, {
"hash" : "097309b1d8ee52ee96507e7f41085c29876a8e31",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=12275",
"triggerID" : "3950016355",
"triggerType" : "MANUAL"
}, {
"hash" : "097309b1d8ee52ee96507e7f41085c29876a8e31",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=12275",
"triggerID" : "097309b1d8ee52ee96507e7f41085c29876a8e31",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3950016355",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 097309b1d8ee52ee96507e7f41085c29876a8e31 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=12275)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3950288052
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `14.28571%` with `48 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 55.19%. Comparing base ([`894b817`](https://app.codecov.io/gh/apache/hudi/commit/894b817f79af42fa61179ed9d0842d61e7d3c07c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`097309b`](https://app.codecov.io/gh/apache/hudi/commit/097309b1d8ee52ee96507e7f41085c29876a8e31?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | 2.04% | [47 Missing and 1 partial :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18029 +/- ##
============================================
- Coverage 57.27% 55.19% -2.08%
+ Complexity 18535 17816 -719
============================================
Files 1944 1944
Lines 106137 106191 +54
Branches 13119 13124 +5
============================================
- Hits 60790 58616 -2174
- Misses 39623 41784 +2161
- Partials 5724 5791 +67
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.38% <14.28%> (-0.04%)` | :arrow_down: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `43.19% <14.28%> (-4.20%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.35% <14.28%> (-0.16%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...pache/hudi/common/config/HoodieMetadataConfig.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fcommon%2Fconfig%2FHoodieMetadataConfig.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL2NvbmZpZy9Ib29kaWVNZXRhZGF0YUNvbmZpZy5qYXZh) | `82.43% <100.00%> (-0.75%)` | :arrow_down: |
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | `71.62% <2.04%> (-9.73%)` | :arrow_down: |
... and [284 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18029/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3814556095
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 73f816a5ea57cc3afde70f6371d109cdb856324e Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3814891179
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 73f816a5ea57cc3afde70f6371d109cdb856324e Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3950308343
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `14.28571%` with `48 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 55.52%. Comparing base ([`894b817`](https://app.codecov.io/gh/apache/hudi/commit/894b817f79af42fa61179ed9d0842d61e7d3c07c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`097309b`](https://app.codecov.io/gh/apache/hudi/commit/097309b1d8ee52ee96507e7f41085c29876a8e31?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | 2.04% | [47 Missing and 1 partial :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18029 +/- ##
============================================
- Coverage 57.28% 55.52% -1.77%
+ Complexity 18535 17907 -628
============================================
Files 1944 1944
Lines 106137 106191 +54
Branches 13119 13124 +5
============================================
- Hits 60798 58958 -1840
- Misses 39617 41439 +1822
- Partials 5722 5794 +72
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.38% <14.28%> (-0.04%)` | :arrow_down: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `43.50% <14.28%> (-3.93%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.48% <14.28%> (-0.02%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...pache/hudi/common/config/HoodieMetadataConfig.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fcommon%2Fconfig%2FHoodieMetadataConfig.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL2NvbmZpZy9Ib29kaWVNZXRhZGF0YUNvbmZpZy5qYXZh) | `82.43% <100.00%> (-0.75%)` | :arrow_down: |
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | `71.62% <2.04%> (-9.73%)` | :arrow_down: |
... and [233 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18029/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "prashantwason (via GitHub)" <gi...@apache.org>.
prashantwason commented on code in PR #18029:
URL: https://github.com/apache/hudi/pull/18029#discussion_r2770832919
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java:
##########
@@ -833,6 +845,79 @@ private int estimateFileGroupCount(HoodieData<HoodieRecord> records) {
);
}
+ /**
+ * Validates the record index after bootstrap by comparing the expected record count with the actual
+ * record count stored in the metadata table. The validation is performed in a distributed manner
+ * using the engine context to count records from HFiles in parallel.
+ *
+ * @param recordIndexRecords the HoodieData containing the expected records
+ * @param fileGroupCount the expected number of file groups
+ */
+ private void validateRecordIndex(HoodieData<HoodieRecord> recordIndexRecords, int fileGroupCount) {
+ String partitionName = MetadataPartitionType.RECORD_INDEX.getPartitionPath();
+ HoodieTableFileSystemView fsView = HoodieTableMetadataUtil.getFileSystemViewForMetadataTable(metadataMetaClient);
Review Comment:
Done. Added try-finally block to ensure the FSView is closed at the end of the method.
##########
hudi-common/src/main/java/org/apache/hudi/common/config/HoodieMetadataConfig.java:
##########
@@ -616,6 +616,15 @@ public final class HoodieMetadataConfig extends HoodieConfig {
+ "honor the set value for number of tasks. If not, number of write status's from data "
+ "table writes will be used for metadata table record preparation");
+ public static final ConfigProperty<Boolean> RECORD_INDEX_BOOTSTRAP_VALIDATION_ENABLE = ConfigProperty
+ .key(METADATA_PREFIX + ".record.index.bootstrap.validation.enable")
Review Comment:
Done. Renamed to `hoodie.metadata.record.index.enable.validation.on.initialization`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "prashantwason (via GitHub)" <gi...@apache.org>.
prashantwason commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3857106648
@hudi-bot run github
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3837721569
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
}, {
"hash" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611",
"triggerID" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 73f816a5ea57cc3afde70f6371d109cdb856324e Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468)
* deee71e5e6b41c0d021602d403e6d8ebec321425 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "prashantwason (via GitHub)" <gi...@apache.org>.
prashantwason commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3855818920
Enabled the validation in `testRollbackPendingCommitWithRecordIndex` test in TestHoodieBackedMetadata.java. This test initializes the record index and will now validate the record count after initialization.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3887767290
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
}, {
"hash" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611",
"triggerID" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112516",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"triggerType" : "PUSH"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "3887752133",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 428aaf9c972e5fd52235721a70b6d9349a3125f7 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "prashantwason (via GitHub)" <gi...@apache.org>.
prashantwason commented on code in PR #18029:
URL: https://github.com/apache/hudi/pull/18029#discussion_r2756385848
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java:
##########
@@ -833,6 +842,29 @@ private int estimateFileGroupCount(HoodieData<HoodieRecord> records) {
);
}
+ /**
+ * Validates the record index after bootstrap by comparing the expected record count with the actual
+ * record count stored in the metadata table.
+ *
+ * @param recordCount the expected number of records
+ * @param fileGroupCount the expected number of file groups
+ */
+ private void validateRecordIndex(long recordCount, int fileGroupCount) {
+ String partitionName = MetadataPartitionType.RECORD_INDEX.getPartitionPath();
+ HoodieTableFileSystemView fsView = HoodieTableMetadataUtil.getFileSystemViewForMetadataTable(metadataMetaClient);
+ List<FileSlice> fileSlices = HoodieTableMetadataUtil.getPartitionLatestFileSlices(metadataMetaClient, Option.of(fsView), partitionName);
Review Comment:
Thanks for catching this. Updated to use `getPartitionLatestMergedFileSlices()` which internally calls `getLatestMergedFileSlicesBeforeOrOn()` via `getPartitionFileSlices(metaClient, fsView, partition, true)`. This ensures we handle cases with pending compactions correctly.
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java:
##########
@@ -738,18 +738,26 @@ private void initializeFilegroupsAndCommitToRecordIndexPartition(String commitTi
Lazy<List<Pair<String, FileSlice>>> lazyLatestMergedPartitionFileSliceList, boolean isPartitionedRLI) throws IOException {
createRecordIndexDefinition(dataMetaClient, Collections.singletonMap(HoodieRecordIndex.IS_PARTITIONED_OPTION, String.valueOf(isPartitionedRLI)));
HoodieData<HoodieRecord> recordIndexRecords;
+ int fileGroupCount;
if (isPartitionedRLI) {
- recordIndexRecords = initializeFilegroupsAndCommitToPartitionedRecordIndexPartition(commitTimeForPartition, lazyLatestMergedPartitionFileSliceList);
+ Pair<Integer, HoodieData<HoodieRecord>> fgCountAndRecords = initializeFilegroupsAndCommitToPartitionedRecordIndexPartition(commitTimeForPartition, lazyLatestMergedPartitionFileSliceList);
+ fileGroupCount = fgCountAndRecords.getKey();
+ recordIndexRecords = fgCountAndRecords.getValue();
} else {
Pair<Integer, HoodieData<HoodieRecord>> fgCountAndRecordIndexRecords = initializeRecordIndexPartition(lazyLatestMergedPartitionFileSliceList.get(),
dataWriteConfig.getMetadataConfig().getRecordIndexMaxParallelism());
+ fileGroupCount = fgCountAndRecordIndexRecords.getKey();
recordIndexRecords = fgCountAndRecordIndexRecords.getRight();
initializeFilegroupsAndCommit(RECORD_INDEX, RECORD_INDEX.getPartitionPath(), fgCountAndRecordIndexRecords, commitTimeForPartition);
}
+ // Validate record index after commit if duplicates are not allowed
+ if (!dataWriteConfig.allowDuplicatesWithHfileWrites()) {
+ validateRecordIndex(recordIndexRecords.count(), fileGroupCount);
Review Comment:
Good point about the DAG re-triggering. I've added a new config `hoodie.metadata.record.index.bootstrap.validation.enable` (disabled by default) to explicitly control validation. Users who want this extra safety check can opt-in by enabling the config. This also avoids the overhead for the common case where validation isn't needed.
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java:
##########
@@ -833,6 +842,29 @@ private int estimateFileGroupCount(HoodieData<HoodieRecord> records) {
);
}
+ /**
+ * Validates the record index after bootstrap by comparing the expected record count with the actual
+ * record count stored in the metadata table.
+ *
+ * @param recordCount the expected number of records
+ * @param fileGroupCount the expected number of file groups
+ */
+ private void validateRecordIndex(long recordCount, int fileGroupCount) {
+ String partitionName = MetadataPartitionType.RECORD_INDEX.getPartitionPath();
+ HoodieTableFileSystemView fsView = HoodieTableMetadataUtil.getFileSystemViewForMetadataTable(metadataMetaClient);
+ List<FileSlice> fileSlices = HoodieTableMetadataUtil.getPartitionLatestFileSlices(metadataMetaClient, Option.of(fsView), partitionName);
+ long totalRecords = 0L;
+ for (FileSlice fileSlice : fileSlices) {
Review Comment:
Agreed. I've refactored the validation to run in a distributed manner using `engineContext.parallelize()`. The base file paths are now distributed across executors, and each partition reads the record count from HFiles in parallel. The counts are then aggregated. This should scale well even with 10k+ file groups.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "prashantwason (via GitHub)" <gi...@apache.org>.
prashantwason commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3950016355
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3950286508
## [Codecov](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `14.28571%` with `48 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 51.75%. Comparing base ([`894b817`](https://app.codecov.io/gh/apache/hudi/commit/894b817f79af42fa61179ed9d0842d61e7d3c07c?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`097309b`](https://app.codecov.io/gh/apache/hudi/commit/097309b1d8ee52ee96507e7f41085c29876a8e31?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | 2.04% | [47 Missing and 1 partial :warning: ](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
> :exclamation: There is a different number of reports uploaded between BASE (894b817) and HEAD (097309b). Click for more details.
>
> <details><summary>HEAD has 6 uploads less than BASE</summary>
>
>| Flag | BASE (894b817) | HEAD (097309b) |
>|------|------|------|
>|spark-scala-tests|6|5|
>|spark-java-tests|8|3|
></details>
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## master #18029 +/- ##
============================================
- Coverage 57.27% 51.75% -5.53%
+ Complexity 18535 16539 -1996
============================================
Files 1944 1944
Lines 106137 106191 +54
Branches 13119 13124 +5
============================================
- Hits 60790 54959 -5831
- Misses 39623 45320 +5697
- Partials 5724 5912 +188
```
| [Flag](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [hadoop-mr-java-client](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.38% <14.28%> (-0.04%)` | :arrow_down: |
| [spark-java-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.22% <14.28%> (-14.17%)` | :arrow_down: |
| [spark-scala-tests](https://app.codecov.io/gh/apache/hudi/pull/18029/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `45.35% <14.28%> (-0.16%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#carryforward-flags-in-the-pull-request-comment) to find out more.
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi/pull/18029?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | |
|---|---|---|
| [...pache/hudi/common/config/HoodieMetadataConfig.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fcommon%2Fconfig%2FHoodieMetadataConfig.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jb21tb24vc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY29tbW9uL2NvbmZpZy9Ib29kaWVNZXRhZGF0YUNvbmZpZy5qYXZh) | `80.73% <100.00%> (-2.44%)` | :arrow_down: |
| [...hudi/metadata/HoodieBackedTableMetadataWriter.java](https://app.codecov.io/gh/apache/hudi/pull/18029?src=pr&el=tree&filepath=hudi-client%2Fhudi-client-common%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhudi%2Fmetadata%2FHoodieBackedTableMetadataWriter.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldGFkYXRhL0hvb2RpZUJhY2tlZFRhYmxlTWV0YWRhdGFXcml0ZXIuamF2YQ==) | `71.62% <2.04%> (-9.73%)` | :arrow_down: |
... and [517 files with indirect coverage changes](https://app.codecov.io/gh/apache/hudi/pull/18029/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)
</details>
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3947477676
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11468",
"triggerID" : "73f816a5ea57cc3afde70f6371d109cdb856324e",
"triggerType" : "PUSH"
}, {
"hash" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11611",
"triggerID" : "deee71e5e6b41c0d021602d403e6d8ebec321425",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"triggerType" : "PUSH"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "3698408061f1b4d9a8b221ad81c6b6ad372caced",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11707",
"triggerID" : "3857112516",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857106648",
"triggerType" : "MANUAL"
}, {
"hash" : "0000",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "3857112457",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"triggerType" : "PUSH"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "3887752133",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733",
"triggerID" : "3892716989",
"triggerType" : "MANUAL"
}, {
"hash" : "428aaf9c972e5fd52235721a70b6d9349a3125f7",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3947467728",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 428aaf9c972e5fd52235721a70b6d9349a3125f7 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11733)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(metadata-table): Add count validation for record index bootstrap [hudi]
Posted by "prashantwason (via GitHub)" <gi...@apache.org>.
prashantwason commented on PR #18029:
URL: https://github.com/apache/hudi/pull/18029#issuecomment-3947467728
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org