You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "suryaprasanna (via GitHub)" <gi...@apache.org> on 2025/12/08 08:01:19 UTC
[PR] refactor!: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
suryaprasanna opened a new pull request, #17520:
URL: https://github.com/apache/hudi/pull/17520
### Describe the issue this Pull Request addresses
This PR removes the deprecated `ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN` configuration and migrates all log scanning operations to use the ScanV2Internal API as the default implementation. The change simplifies the codebase by eliminating the dual-path scanning logic that was maintained for backward compatibility.
### Summary and Changelog
Users will no longer need to configure `ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN` as the optimized log scanning is now the default behavior. This change streamlines the log reading path and removes approximately 436 lines of legacy code.
**Changes:**
- Removed `ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN` configuration from `HoodieReaderConfig` and `HoodieCompactionConfig`
- Removed conditional logic using `enableOptimizedLogBlocksScan` across log scanning components
- Simplified `AbstractHoodieLogRecordScanner` and `BaseHoodieLogRecordReader` by removing legacy scan path
- Updated `HoodieMergedLogRecordReader`, `HoodieMergedLogRecordScanner`, and `HoodieUnMergedLogRecordScanner` to use ScanV2Internal exclusively
- Cleaned up references in metadata writers, clustering strategies, and test utilities
- Updated Hive integration components to remove deprecated configuration checks
### Impact
**Breaking Change:** The `ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN` configuration option has been removed. Users who explicitly set this configuration will need to remove it from their configurations. The new
default behavior is equivalent to having this config enabled.
**Performance:** No performance impact expected as ScanV2Internal was already the recommended and optimized path. Users who had the config disabled will see performance improvements.
### Risk Level
**Low** - The ScanV2Internal API has been available and tested for several releases. This change only removes the legacy fallback path. All existing tests pass with the new default behavior.
### Documentation Update
- Configuration documentation needs to be updated to remove references to `ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN`
- Release notes should highlight this as a breaking change for users who explicitly disabled the optimization
### Contributor's checklist
- [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [x] Enough context is provided in the sections above
- [x] Adequate tests were added if applicable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor!: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "suryaprasanna (via GitHub)" <gi...@apache.org>.
suryaprasanna commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3628761582
@vinothchandar No breaking change as such, just want to it be careful when refactoring this codepath. Let me remove `!` as it can cause confusion.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "suryaprasanna (via GitHub)" <gi...@apache.org>.
suryaprasanna commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3793007485
> can you compare the state of V1 and V2 as of now and confirm V2 is b/w compatible.
Yes, I checked both of them and the recent changes like allowInflightInstants are the same.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "suryaprasanna (via GitHub)" <gi...@apache.org>.
suryaprasanna commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3836797135
@yihua can you please review the PR again?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3628809093
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10007",
"triggerID" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"triggerType" : "PUSH"
}, {
"hash" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10023",
"triggerID" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"triggerType" : "PUSH"
}, {
"hash" : "96186b5390f955eaabe52acae4d28059d9366ea1",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "96186b5390f955eaabe52acae4d28059d9366ea1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 62a86eabc73cf58f2fbcbf04bb7e640ce9126166 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10007)
* c9527457bfc8c182638e0f8dd1cd0e72c89f88d4 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10023)
* 96186b5390f955eaabe52acae4d28059d9366ea1 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3802295753
@yihua : I am ok w/ the fix. I don't see a necessity for perf benchmarking. let us know,
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on code in PR #17520:
URL: https://github.com/apache/hudi/pull/17520#discussion_r2600499683
##########
hudi-common/src/main/java/org/apache/hudi/common/config/HoodieReaderConfig.java:
##########
@@ -45,14 +45,6 @@ public class HoodieReaderConfig extends HoodieConfig {
.withDocumentation("HoodieLogFormatReader reads a logfile in the forward direction starting from pos=0 to pos=file_length. "
+ "If this config is set to true, the reader reads the logfile in reverse direction, from pos=file_length to pos=0");
- public static final ConfigProperty<String> ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN = ConfigProperty
- .key("hoodie" + HoodieMetadataConfig.OPTIMIZED_LOG_BLOCKS_SCAN)
- .defaultValue("false")
Review Comment:
This changes the behavior by using the optimized log block scan by default. I remember that the optimized log block scan has two passes which increase the number of FS calls, which can be noticeable on cloud storage. Is the overhead measured and negligible?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor!: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3628687925
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10007",
"triggerID" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"triggerType" : "PUSH"
}, {
"hash" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10023",
"triggerID" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 62a86eabc73cf58f2fbcbf04bb7e640ce9126166 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10007)
* c9527457bfc8c182638e0f8dd1cd0e72c89f88d4 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10023)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor!: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3625942372
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10007",
"triggerID" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 62a86eabc73cf58f2fbcbf04bb7e640ce9126166 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10007)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "suryaprasanna (via GitHub)" <gi...@apache.org>.
suryaprasanna commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3793032560
> for the perf ask from ethan, lets do below perf benchmarking.
>
> * create a MOR table w/ 1000 log files (do not compact for 1000 log files).
> * Lets do a snapshot read w/ v1 and v2 scan and showcase we do not find any perf difference.
I am not sure, if perf evaluation is needed, based on the code scanV1 and scanV2 have the same no. of file system calls. From the code do you see any extra file system calls.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor!: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3628679590
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10007",
"triggerID" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"triggerType" : "PUSH"
}, {
"hash" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 62a86eabc73cf58f2fbcbf04bb7e640ce9126166 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10007)
* c9527457bfc8c182638e0f8dd1cd0e72c89f88d4 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor!: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "vinothchandar (via GitHub)" <gi...@apache.org>.
vinothchandar commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3628694849
@suryaprasanna since you have a `!` in the title. whats the breaking change.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3629091895
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10007",
"triggerID" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"triggerType" : "PUSH"
}, {
"hash" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10023",
"triggerID" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"triggerType" : "PUSH"
}, {
"hash" : "96186b5390f955eaabe52acae4d28059d9366ea1",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10029",
"triggerID" : "96186b5390f955eaabe52acae4d28059d9366ea1",
"triggerType" : "PUSH"
}, {
"hash" : "4ca348bf8acd5f643e306d935c5a11101cd29a7d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10031",
"triggerID" : "4ca348bf8acd5f643e306d935c5a11101cd29a7d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c9527457bfc8c182638e0f8dd1cd0e72c89f88d4 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10023)
* 96186b5390f955eaabe52acae4d28059d9366ea1 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10029)
* 4ca348bf8acd5f643e306d935c5a11101cd29a7d Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10031)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "suryaprasanna (via GitHub)" <gi...@apache.org>.
suryaprasanna commented on code in PR #17520:
URL: https://github.com/apache/hudi/pull/17520#discussion_r2723171839
##########
hudi-common/src/main/java/org/apache/hudi/common/config/HoodieReaderConfig.java:
##########
@@ -45,14 +45,6 @@ public class HoodieReaderConfig extends HoodieConfig {
.withDocumentation("HoodieLogFormatReader reads a logfile in the forward direction starting from pos=0 to pos=file_length. "
+ "If this config is set to true, the reader reads the logfile in reverse direction, from pos=file_length to pos=0");
- public static final ConfigProperty<String> ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN = ConfigProperty
- .key("hoodie" + HoodieMetadataConfig.OPTIMIZED_LOG_BLOCKS_SCAN)
- .defaultValue("false")
Review Comment:
@yihua Originally, scanV1 method directly reads the blocks without checking if they are compacted or not. Optimized log block scan(scanV2) will first scan through the blocks and then determine which of these blocks are valid and then start reading them. But lately even scanV1 is doing lazy reading, similar to scanV2.
So, there wont be any much of an overhead between them. Inaddition scanV2 has logic to support actions like logcompaction.
Example, if user used logcompaction once then traditional scan will result is duplicate values. So, we need to default the optimzed log block scan as the default option and dont see any merit in using scanV1.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on code in PR #17520:
URL: https://github.com/apache/hudi/pull/17520#discussion_r2722160348
##########
hudi-hadoop-common/src/test/java/org/apache/hudi/common/functional/TestHoodieLogFormat.java:
##########
@@ -2952,8 +2943,7 @@ private void checkLogBlocksAndKeys(String latestInstantTime, Schema schema, Exte
.withBufferSize(BUFFER_SIZE)
.withSpillableMapBasePath(spillableBasePath)
.withDiskMapType(diskMapType)
- .withBitCaskDiskMapCompressionEnabled(isCompressionEnabled)
- .withOptimizedLogBlocksScan(enableOptimizedLogBlocksScan);
+ .withBitCaskDiskMapCompressionEnabled(isCompressionEnabled);
Review Comment:
We need to revisit tests in this class like `testBasicAppendAndScanMultipleFiles` and remove the parametrized test that tests `enableOptimizedLogBlocksScan`
can you do one pass and fix them
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3629469144
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10007",
"triggerID" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"triggerType" : "PUSH"
}, {
"hash" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10023",
"triggerID" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"triggerType" : "PUSH"
}, {
"hash" : "96186b5390f955eaabe52acae4d28059d9366ea1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10029",
"triggerID" : "96186b5390f955eaabe52acae4d28059d9366ea1",
"triggerType" : "PUSH"
}, {
"hash" : "4ca348bf8acd5f643e306d935c5a11101cd29a7d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10031",
"triggerID" : "4ca348bf8acd5f643e306d935c5a11101cd29a7d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4ca348bf8acd5f643e306d935c5a11101cd29a7d Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10031)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3629031651
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10007",
"triggerID" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"triggerType" : "PUSH"
}, {
"hash" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10023",
"triggerID" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"triggerType" : "PUSH"
}, {
"hash" : "96186b5390f955eaabe52acae4d28059d9366ea1",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10029",
"triggerID" : "96186b5390f955eaabe52acae4d28059d9366ea1",
"triggerType" : "PUSH"
}, {
"hash" : "4ca348bf8acd5f643e306d935c5a11101cd29a7d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4ca348bf8acd5f643e306d935c5a11101cd29a7d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c9527457bfc8c182638e0f8dd1cd0e72c89f88d4 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10023)
* 96186b5390f955eaabe52acae4d28059d9366ea1 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10029)
* 4ca348bf8acd5f643e306d935c5a11101cd29a7d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3629368039
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10007",
"triggerID" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"triggerType" : "PUSH"
}, {
"hash" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10023",
"triggerID" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"triggerType" : "PUSH"
}, {
"hash" : "96186b5390f955eaabe52acae4d28059d9366ea1",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10029",
"triggerID" : "96186b5390f955eaabe52acae4d28059d9366ea1",
"triggerType" : "PUSH"
}, {
"hash" : "4ca348bf8acd5f643e306d935c5a11101cd29a7d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10031",
"triggerID" : "4ca348bf8acd5f643e306d935c5a11101cd29a7d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 96186b5390f955eaabe52acae4d28059d9366ea1 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10029)
* 4ca348bf8acd5f643e306d935c5a11101cd29a7d Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10031)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3803458953
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10007",
"triggerID" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"triggerType" : "PUSH"
}, {
"hash" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10023",
"triggerID" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"triggerType" : "PUSH"
}, {
"hash" : "96186b5390f955eaabe52acae4d28059d9366ea1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10029",
"triggerID" : "96186b5390f955eaabe52acae4d28059d9366ea1",
"triggerType" : "PUSH"
}, {
"hash" : "4ca348bf8acd5f643e306d935c5a11101cd29a7d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10031",
"triggerID" : "4ca348bf8acd5f643e306d935c5a11101cd29a7d",
"triggerType" : "PUSH"
}, {
"hash" : "17c2544d9f6738e10e90ae6713eae7b5df1426f2",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11388",
"triggerID" : "17c2544d9f6738e10e90ae6713eae7b5df1426f2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4ca348bf8acd5f643e306d935c5a11101cd29a7d Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10031)
* 17c2544d9f6738e10e90ae6713eae7b5df1426f2 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11388)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3843450078
I will go ahead and merge the patch. if ethan has any follow up questions, you can take it in a follow up patch
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3791389261
for the perf ask from ethan, lets do below perf benchmarking.
- create a MOR table w/ 1000 log files (do not compact for 1000 log files).
- Lets do a snapshot read w/ v1 and v2 scan and showcase we do not find any perf difference.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan merged PR #17520:
URL: https://github.com/apache/hudi/pull/17520
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3807658752
I am good w/ the patch. But I will let ethan review and land it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3803446967
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10007",
"triggerID" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"triggerType" : "PUSH"
}, {
"hash" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10023",
"triggerID" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"triggerType" : "PUSH"
}, {
"hash" : "96186b5390f955eaabe52acae4d28059d9366ea1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10029",
"triggerID" : "96186b5390f955eaabe52acae4d28059d9366ea1",
"triggerType" : "PUSH"
}, {
"hash" : "4ca348bf8acd5f643e306d935c5a11101cd29a7d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10031",
"triggerID" : "4ca348bf8acd5f643e306d935c5a11101cd29a7d",
"triggerType" : "PUSH"
}, {
"hash" : "17c2544d9f6738e10e90ae6713eae7b5df1426f2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "17c2544d9f6738e10e90ae6713eae7b5df1426f2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4ca348bf8acd5f643e306d935c5a11101cd29a7d Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10031)
* 17c2544d9f6738e10e90ae6713eae7b5df1426f2 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3628840262
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10007",
"triggerID" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"triggerType" : "PUSH"
}, {
"hash" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10023",
"triggerID" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"triggerType" : "PUSH"
}, {
"hash" : "96186b5390f955eaabe52acae4d28059d9366ea1",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "96186b5390f955eaabe52acae4d28059d9366ea1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c9527457bfc8c182638e0f8dd1cd0e72c89f88d4 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10023)
* 96186b5390f955eaabe52acae4d28059d9366ea1 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "suryaprasanna (via GitHub)" <gi...@apache.org>.
suryaprasanna commented on code in PR #17520:
URL: https://github.com/apache/hudi/pull/17520#discussion_r2730545284
##########
hudi-hadoop-common/src/test/java/org/apache/hudi/common/functional/TestHoodieLogFormat.java:
##########
@@ -2952,8 +2943,7 @@ private void checkLogBlocksAndKeys(String latestInstantTime, Schema schema, Exte
.withBufferSize(BUFFER_SIZE)
.withSpillableMapBasePath(spillableBasePath)
.withDiskMapType(diskMapType)
- .withBitCaskDiskMapCompressionEnabled(isCompressionEnabled)
- .withOptimizedLogBlocksScan(enableOptimizedLogBlocksScan);
+ .withBitCaskDiskMapCompressionEnabled(isCompressionEnabled);
Review Comment:
Yes, fixed them.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3803989606
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10007",
"triggerID" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"triggerType" : "PUSH"
}, {
"hash" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10023",
"triggerID" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"triggerType" : "PUSH"
}, {
"hash" : "96186b5390f955eaabe52acae4d28059d9366ea1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10029",
"triggerID" : "96186b5390f955eaabe52acae4d28059d9366ea1",
"triggerType" : "PUSH"
}, {
"hash" : "4ca348bf8acd5f643e306d935c5a11101cd29a7d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10031",
"triggerID" : "4ca348bf8acd5f643e306d935c5a11101cd29a7d",
"triggerType" : "PUSH"
}, {
"hash" : "17c2544d9f6738e10e90ae6713eae7b5df1426f2",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11388",
"triggerID" : "17c2544d9f6738e10e90ae6713eae7b5df1426f2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 17c2544d9f6738e10e90ae6713eae7b5df1426f2 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=11388)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor!: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3625530754
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10007",
"triggerID" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 62a86eabc73cf58f2fbcbf04bb7e640ce9126166 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10007)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor!: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3625523001
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 62a86eabc73cf58f2fbcbf04bb7e640ce9126166 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: migrate to ScanV2Internal API and remove ENABLE_OPTIMIZED_LOG_BLOCKS_SCAN config [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17520:
URL: https://github.com/apache/hudi/pull/17520#issuecomment-3628885552
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10007",
"triggerID" : "62a86eabc73cf58f2fbcbf04bb7e640ce9126166",
"triggerType" : "PUSH"
}, {
"hash" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10023",
"triggerID" : "c9527457bfc8c182638e0f8dd1cd0e72c89f88d4",
"triggerType" : "PUSH"
}, {
"hash" : "96186b5390f955eaabe52acae4d28059d9366ea1",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10029",
"triggerID" : "96186b5390f955eaabe52acae4d28059d9366ea1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c9527457bfc8c182638e0f8dd1cd0e72c89f88d4 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10023)
* 96186b5390f955eaabe52acae4d28059d9366ea1 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10029)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org