You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "yihua (via GitHub)" <gi...@apache.org> on 2024/09/12 16:22:54 UTC
[PR] [HUDI-7928] Remove shared HFile reader in HoodieNativeAvroHFileReader [hudi]
yihua opened a new pull request, #11935:
URL: https://github.com/apache/hudi/pull/11935
### Change Logs
The shared HFile reader in `HoodieNativeAvroHFileReader` uses non-trivial amount of memory (see the screenshots below) and is kept open for reading meta info from the HFile. This PR adds the changes to avoid keeping the reference to the shared HFile reader by removing the shared HFile reader and caching the meta info by loading the information once, so the memory usage is reduced.
This PR also enables the native HFile reader (`_hoodie.hfile.use.native.reader`) by default again. It was turned off by default before in #11488 due to OOM in CI.
Screenshots of memory usage of `HoodieNativeAvroHFileReader`:
<img width="1868" alt="Screenshot 2024-06-21 at 17 53 07" src="https://github.com/user-attachments/assets/38f249c6-a467-471b-9bd9-5d3afa46d1bc">
<img width="1752" alt="Screenshot 2024-09-12 at 08 18 25" src="https://github.com/user-attachments/assets/8a9ad95f-5e5c-466f-8274-cca8f063ba75">
### Impact
Reduces memory usage.
### Risk level
low
### Documentation Update
N/A
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7928] Remove shared HFile reader in HoodieNativeAvroHFileReader [hudi]
Posted by "jonvex (via GitHub)" <gi...@apache.org>.
jonvex commented on code in PR #11935:
URL: https://github.com/apache/hudi/pull/11935#discussion_r1757257568
##########
hudi-common/src/main/java/org/apache/hudi/io/storage/HoodieNativeAvroHFileReader.java:
##########
@@ -190,18 +193,19 @@ public Schema getSchema() {
@Override
public void close() {
- try {
- if (sharedHFileReader.isPresent()) {
- sharedHFileReader.get().close();
- }
- } catch (IOException e) {
- throw new HoodieIOException("Error closing the HFile reader", e);
- }
+ metaInfoMap.clear();
Review Comment:
How many keys do we expect in the map. Clear nulls out all the entries but doesn't reduce size. That might be fine if it's only in the thousands. But if it's going to be a lot then maybe we make this not final and do metaInfoMap = null so it can be GCd
##########
hudi-common/src/main/java/org/apache/hudi/io/storage/HoodieNativeAvroHFileReader.java:
##########
@@ -190,18 +193,19 @@ public Schema getSchema() {
@Override
public void close() {
- try {
- if (sharedHFileReader.isPresent()) {
- sharedHFileReader.get().close();
- }
- } catch (IOException e) {
- throw new HoodieIOException("Error closing the HFile reader", e);
- }
+ metaInfoMap.clear();
Review Comment:
Oh nevermind PRELOADED_META_INFO_KEYS is the size of the map.
##########
hudi-common/src/main/java/org/apache/hudi/io/storage/HoodieNativeAvroHFileReader.java:
##########
@@ -244,14 +248,32 @@ private static GenericRecord getRecordFromKeyValue(KeyValue keyValue,
readerSchema);
}
- private synchronized HFileReader getSharedHFileReader() {
- try {
- if (!sharedHFileReader.isPresent()) {
- sharedHFileReader = Option.of(newHFileReader());
+ private byte[] getHFileMetaInfoFromCache(String key) throws IOException {
+ if (!PRELOADED_META_INFO_KEYS.contains(key)) {
+ throw new IllegalStateException("HoodieNativeAvroHFileReader#getHFileMetaInfoFromCache"
+ + " should only be called on supported meta info keys; this key is not supported: "
+ + key);
+ }
+ byte[] bytes = metaInfoMap.get(key);
Review Comment:
I think it would be better to check if the map exists at all or not. We might reread a bunch of times if
```
Option<byte[]> metaInfo = reader.getMetaInfo(new UTF8StringKey(metaInfoKey));
```
is ever option.empty
##########
hudi-common/src/main/java/org/apache/hudi/io/storage/HoodieNativeAvroHFileReader.java:
##########
@@ -244,14 +248,32 @@ private static GenericRecord getRecordFromKeyValue(KeyValue keyValue,
readerSchema);
}
- private synchronized HFileReader getSharedHFileReader() {
- try {
- if (!sharedHFileReader.isPresent()) {
- sharedHFileReader = Option.of(newHFileReader());
+ private byte[] getHFileMetaInfoFromCache(String key) throws IOException {
+ if (!PRELOADED_META_INFO_KEYS.contains(key)) {
+ throw new IllegalStateException("HoodieNativeAvroHFileReader#getHFileMetaInfoFromCache"
+ + " should only be called on supported meta info keys; this key is not supported: "
+ + key);
+ }
+ byte[] bytes = metaInfoMap.get(key);
Review Comment:
Can we do a compute if absent here?
##########
hudi-common/src/main/java/org/apache/hudi/io/storage/HoodieNativeAvroHFileReader.java:
##########
@@ -244,14 +248,32 @@ private static GenericRecord getRecordFromKeyValue(KeyValue keyValue,
readerSchema);
}
- private synchronized HFileReader getSharedHFileReader() {
- try {
- if (!sharedHFileReader.isPresent()) {
- sharedHFileReader = Option.of(newHFileReader());
+ private byte[] getHFileMetaInfoFromCache(String key) throws IOException {
Review Comment:
I think we also want to put synchronized on this method: https://docs.oracle.com/javase/tutorial/essential/concurrency/syncmeth.html.
##########
hudi-common/src/main/java/org/apache/hudi/io/storage/HoodieNativeAvroHFileReader.java:
##########
@@ -244,14 +248,32 @@ private static GenericRecord getRecordFromKeyValue(KeyValue keyValue,
readerSchema);
}
- private synchronized HFileReader getSharedHFileReader() {
- try {
- if (!sharedHFileReader.isPresent()) {
- sharedHFileReader = Option.of(newHFileReader());
+ private byte[] getHFileMetaInfoFromCache(String key) throws IOException {
+ if (!PRELOADED_META_INFO_KEYS.contains(key)) {
+ throw new IllegalStateException("HoodieNativeAvroHFileReader#getHFileMetaInfoFromCache"
+ + " should only be called on supported meta info keys; this key is not supported: "
+ + key);
+ }
+ byte[] bytes = metaInfoMap.get(key);
+ if (bytes != null) {
+ return bytes;
+ }
+ loadAllMetaInfoIntoCache();
+ return metaInfoMap.get(key);
+ }
+
+ private synchronized void loadAllMetaInfoIntoCache() throws IOException {
+ // Load all meta info that are small into cache
Review Comment:
I think there also might need to be a check here to see if the cache is loaded and to skip reloading
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7928] Remove shared HFile reader in HoodieNativeAvroHFileReader [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua merged PR #11935:
URL: https://github.com/apache/hudi/pull/11935
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7928] Remove shared HFile reader in HoodieNativeAvroHFileReader [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on code in PR #11935:
URL: https://github.com/apache/hudi/pull/11935#discussion_r1757580662
##########
hudi-common/src/main/java/org/apache/hudi/io/storage/HoodieNativeAvroHFileReader.java:
##########
@@ -244,14 +248,32 @@ private static GenericRecord getRecordFromKeyValue(KeyValue keyValue,
readerSchema);
}
- private synchronized HFileReader getSharedHFileReader() {
- try {
- if (!sharedHFileReader.isPresent()) {
- sharedHFileReader = Option.of(newHFileReader());
+ private byte[] getHFileMetaInfoFromCache(String key) throws IOException {
+ if (!PRELOADED_META_INFO_KEYS.contains(key)) {
+ throw new IllegalStateException("HoodieNativeAvroHFileReader#getHFileMetaInfoFromCache"
+ + " should only be called on supported meta info keys; this key is not supported: "
+ + key);
+ }
+ byte[] bytes = metaInfoMap.get(key);
Review Comment:
> Can we do a compute if absent here?
I'm updating the whole map so it is anti-pattern to use `computeIfAbsent`.
I revised the checks with a boolean to indicate if the cache is preloaded.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7928] Remove shared HFile reader in HoodieNativeAvroHFileReader [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #11935:
URL: https://github.com/apache/hudi/pull/11935#issuecomment-2347968576
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "dc9ad9c1587c6c100d61c88c1897965f870f52f1",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=439",
"triggerID" : "dc9ad9c1587c6c100d61c88c1897965f870f52f1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* dc9ad9c1587c6c100d61c88c1897965f870f52f1 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=439)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7928] Remove shared HFile reader in HoodieNativeAvroHFileReader [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #11935:
URL: https://github.com/apache/hudi/pull/11935#issuecomment-2347926896
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "dc9ad9c1587c6c100d61c88c1897965f870f52f1",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=439",
"triggerID" : "dc9ad9c1587c6c100d61c88c1897965f870f52f1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* dc9ad9c1587c6c100d61c88c1897965f870f52f1 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=439)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7928] Remove shared HFile reader in HoodieNativeAvroHFileReader [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #11935:
URL: https://github.com/apache/hudi/pull/11935#issuecomment-2347419461
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3eea96ebd6503f9723b3b56a8092a103ab0af40e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=423",
"triggerID" : "3eea96ebd6503f9723b3b56a8092a103ab0af40e",
"triggerType" : "PUSH"
}, {
"hash" : "d8b259eeb4d318270dbe3af3c9ce84c7fd243c4d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=433",
"triggerID" : "d8b259eeb4d318270dbe3af3c9ce84c7fd243c4d",
"triggerType" : "PUSH"
}, {
"hash" : "dc9ad9c1587c6c100d61c88c1897965f870f52f1",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=439",
"triggerID" : "dc9ad9c1587c6c100d61c88c1897965f870f52f1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d8b259eeb4d318270dbe3af3c9ce84c7fd243c4d Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=433)
* dc9ad9c1587c6c100d61c88c1897965f870f52f1 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=439)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7928] Remove shared HFile reader in HoodieNativeAvroHFileReader [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #11935:
URL: https://github.com/apache/hudi/pull/11935#issuecomment-2346879600
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3eea96ebd6503f9723b3b56a8092a103ab0af40e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=423",
"triggerID" : "3eea96ebd6503f9723b3b56a8092a103ab0af40e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3eea96ebd6503f9723b3b56a8092a103ab0af40e Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=423)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7928] Remove shared HFile reader in HoodieNativeAvroHFileReader [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #11935:
URL: https://github.com/apache/hudi/pull/11935#issuecomment-2347226704
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3eea96ebd6503f9723b3b56a8092a103ab0af40e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=423",
"triggerID" : "3eea96ebd6503f9723b3b56a8092a103ab0af40e",
"triggerType" : "PUSH"
}, {
"hash" : "d8b259eeb4d318270dbe3af3c9ce84c7fd243c4d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=433",
"triggerID" : "d8b259eeb4d318270dbe3af3c9ce84c7fd243c4d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3eea96ebd6503f9723b3b56a8092a103ab0af40e Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=423)
* d8b259eeb4d318270dbe3af3c9ce84c7fd243c4d Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=433)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7928] Remove shared HFile reader in HoodieNativeAvroHFileReader [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #11935:
URL: https://github.com/apache/hudi/pull/11935#issuecomment-2346741277
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3eea96ebd6503f9723b3b56a8092a103ab0af40e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3eea96ebd6503f9723b3b56a8092a103ab0af40e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3eea96ebd6503f9723b3b56a8092a103ab0af40e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7928] Remove shared HFile reader in HoodieNativeAvroHFileReader [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #11935:
URL: https://github.com/apache/hudi/pull/11935#issuecomment-2347418367
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3eea96ebd6503f9723b3b56a8092a103ab0af40e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=423",
"triggerID" : "3eea96ebd6503f9723b3b56a8092a103ab0af40e",
"triggerType" : "PUSH"
}, {
"hash" : "d8b259eeb4d318270dbe3af3c9ce84c7fd243c4d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=433",
"triggerID" : "d8b259eeb4d318270dbe3af3c9ce84c7fd243c4d",
"triggerType" : "PUSH"
}, {
"hash" : "dc9ad9c1587c6c100d61c88c1897965f870f52f1",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "dc9ad9c1587c6c100d61c88c1897965f870f52f1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d8b259eeb4d318270dbe3af3c9ce84c7fd243c4d Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=433)
* dc9ad9c1587c6c100d61c88c1897965f870f52f1 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7928] Remove shared HFile reader in HoodieNativeAvroHFileReader [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on code in PR #11935:
URL: https://github.com/apache/hudi/pull/11935#discussion_r1757581531
##########
hudi-common/src/main/java/org/apache/hudi/io/storage/HoodieNativeAvroHFileReader.java:
##########
@@ -244,14 +248,32 @@ private static GenericRecord getRecordFromKeyValue(KeyValue keyValue,
readerSchema);
}
- private synchronized HFileReader getSharedHFileReader() {
- try {
- if (!sharedHFileReader.isPresent()) {
- sharedHFileReader = Option.of(newHFileReader());
+ private byte[] getHFileMetaInfoFromCache(String key) throws IOException {
Review Comment:
The new logic always checks the `isMetaInfoLoaded` before getting the value.
##########
hudi-common/src/main/java/org/apache/hudi/io/storage/HoodieNativeAvroHFileReader.java:
##########
@@ -244,14 +248,32 @@ private static GenericRecord getRecordFromKeyValue(KeyValue keyValue,
readerSchema);
}
- private synchronized HFileReader getSharedHFileReader() {
- try {
- if (!sharedHFileReader.isPresent()) {
- sharedHFileReader = Option.of(newHFileReader());
+ private byte[] getHFileMetaInfoFromCache(String key) throws IOException {
+ if (!PRELOADED_META_INFO_KEYS.contains(key)) {
+ throw new IllegalStateException("HoodieNativeAvroHFileReader#getHFileMetaInfoFromCache"
+ + " should only be called on supported meta info keys; this key is not supported: "
+ + key);
+ }
+ byte[] bytes = metaInfoMap.get(key);
+ if (bytes != null) {
+ return bytes;
+ }
+ loadAllMetaInfoIntoCache();
+ return metaInfoMap.get(key);
+ }
+
+ private synchronized void loadAllMetaInfoIntoCache() throws IOException {
+ // Load all meta info that are small into cache
Review Comment:
Addressed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7928] Remove shared HFile reader in HoodieNativeAvroHFileReader [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #11935:
URL: https://github.com/apache/hudi/pull/11935#issuecomment-2347224598
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3eea96ebd6503f9723b3b56a8092a103ab0af40e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=423",
"triggerID" : "3eea96ebd6503f9723b3b56a8092a103ab0af40e",
"triggerType" : "PUSH"
}, {
"hash" : "d8b259eeb4d318270dbe3af3c9ce84c7fd243c4d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d8b259eeb4d318270dbe3af3c9ce84c7fd243c4d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3eea96ebd6503f9723b3b56a8092a103ab0af40e Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=423)
* d8b259eeb4d318270dbe3af3c9ce84c7fd243c4d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7928] Remove shared HFile reader in HoodieNativeAvroHFileReader [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #11935:
URL: https://github.com/apache/hudi/pull/11935#issuecomment-2346744254
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3eea96ebd6503f9723b3b56a8092a103ab0af40e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=423",
"triggerID" : "3eea96ebd6503f9723b3b56a8092a103ab0af40e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3eea96ebd6503f9723b3b56a8092a103ab0af40e Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=423)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7928] Remove shared HFile reader in HoodieNativeAvroHFileReader [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #11935:
URL: https://github.com/apache/hudi/pull/11935#issuecomment-2347925859
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "dc9ad9c1587c6c100d61c88c1897965f870f52f1",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "dc9ad9c1587c6c100d61c88c1897965f870f52f1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* dc9ad9c1587c6c100d61c88c1897965f870f52f1 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7928] Remove shared HFile reader in HoodieNativeAvroHFileReader [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #11935:
URL: https://github.com/apache/hudi/pull/11935#issuecomment-2347332682
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3eea96ebd6503f9723b3b56a8092a103ab0af40e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=423",
"triggerID" : "3eea96ebd6503f9723b3b56a8092a103ab0af40e",
"triggerType" : "PUSH"
}, {
"hash" : "d8b259eeb4d318270dbe3af3c9ce84c7fd243c4d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=433",
"triggerID" : "d8b259eeb4d318270dbe3af3c9ce84c7fd243c4d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d8b259eeb4d318270dbe3af3c9ce84c7fd243c4d Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=433)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-7928] Remove shared HFile reader in HoodieNativeAvroHFileReader [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #11935:
URL: https://github.com/apache/hudi/pull/11935#issuecomment-2347715308
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3eea96ebd6503f9723b3b56a8092a103ab0af40e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=423",
"triggerID" : "3eea96ebd6503f9723b3b56a8092a103ab0af40e",
"triggerType" : "PUSH"
}, {
"hash" : "d8b259eeb4d318270dbe3af3c9ce84c7fd243c4d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=433",
"triggerID" : "d8b259eeb4d318270dbe3af3c9ce84c7fd243c4d",
"triggerType" : "PUSH"
}, {
"hash" : "dc9ad9c1587c6c100d61c88c1897965f870f52f1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=439",
"triggerID" : "dc9ad9c1587c6c100d61c88c1897965f870f52f1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* dc9ad9c1587c6c100d61c88c1897965f870f52f1 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=439)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org