You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/09/26 06:09:04 UTC
[GitHub] [hudi] CodeCooker17 opened a new pull request, #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
CodeCooker17 opened a new pull request, #6793:
URL: https://github.com/apache/hudi/pull/6793
…sFromFiles of Bloom Index
### Change Logs
_Describe context and summary for this change. Highlight if any code was copied._
### Impact
_Describe any public API or user-facing feature change or any performance impact._
**Risk level: none | low | medium | high**
_Choose one. If medium or high, explain what verification was done to mitigate the risks._
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1257540590
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11730",
"triggerID" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* da04810eb0593e53bbce0e389930502cfbc217d4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11730)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1261354620
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11730",
"triggerID" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"triggerType" : "PUSH"
}, {
"hash" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11733",
"triggerID" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"triggerType" : "PUSH"
}, {
"hash" : "5a5beba06c61fd2233a7f6861923b86fa860213e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11834",
"triggerID" : "5a5beba06c61fd2233a7f6861923b86fa860213e",
"triggerType" : "PUSH"
}, {
"hash" : "32cc352122d276f5bb5943a0dd420920854fdb8e",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11837",
"triggerID" : "32cc352122d276f5bb5943a0dd420920854fdb8e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 32cc352122d276f5bb5943a0dd420920854fdb8e Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11837)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] CodeCooker17 commented on pull request #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
Posted by GitBox <gi...@apache.org>.
CodeCooker17 commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1260634902
>
> @CodeCooker17您能否请重新设置代码以解决片状问题？
finished, thx.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] CodeCooker17 commented on pull request #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
Posted by GitBox <gi...@apache.org>.
CodeCooker17 commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1260636163
> @CodeCooker17 Could you plz rebase the codes to fix the flaky issue?
finished, thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1257627970
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11730",
"triggerID" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"triggerType" : "PUSH"
}, {
"hash" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11733",
"triggerID" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* da04810eb0593e53bbce0e389930502cfbc217d4 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11730)
* a39a660ad1c53183d3cf6554f29bdd94b1d707ea Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11733)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1260714235
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11730",
"triggerID" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"triggerType" : "PUSH"
}, {
"hash" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11733",
"triggerID" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"triggerType" : "PUSH"
}, {
"hash" : "5a5beba06c61fd2233a7f6861923b86fa860213e",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11834",
"triggerID" : "5a5beba06c61fd2233a7f6861923b86fa860213e",
"triggerType" : "PUSH"
}, {
"hash" : "32cc352122d276f5bb5943a0dd420920854fdb8e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11837",
"triggerID" : "32cc352122d276f5bb5943a0dd420920854fdb8e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5a5beba06c61fd2233a7f6861923b86fa860213e Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11834)
* 32cc352122d276f5bb5943a0dd420920854fdb8e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11837)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] CodeCooker17 commented on pull request #6793: [HUDI-4917] Optimized the way to get HoodieBaseFile of loadColumnRangesFromFiles of Bloom Index
Posted by GitBox <gi...@apache.org>.
CodeCooker17 commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1334730506
> @CodeCooker17 can you plz help address the comment?
Let me try to fix it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1260640374
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11730",
"triggerID" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"triggerType" : "PUSH"
}, {
"hash" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11733",
"triggerID" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"triggerType" : "PUSH"
}, {
"hash" : "5a5beba06c61fd2233a7f6861923b86fa860213e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11834",
"triggerID" : "5a5beba06c61fd2233a7f6861923b86fa860213e",
"triggerType" : "PUSH"
}, {
"hash" : "32cc352122d276f5bb5943a0dd420920854fdb8e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "32cc352122d276f5bb5943a0dd420920854fdb8e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a39a660ad1c53183d3cf6554f29bdd94b1d707ea Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11733)
* 5a5beba06c61fd2233a7f6861923b86fa860213e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11834)
* 32cc352122d276f5bb5943a0dd420920854fdb8e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] haoxie-aws commented on pull request #6793: [HUDI-4917] Optimized the way to get HoodieBaseFile of loadColumnRangesFromFiles of Bloom Index
Posted by GitBox <gi...@apache.org>.
haoxie-aws commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1343479028
Hi can we prioritize this change and make sure it can be included in 0.12.2 release? Our production environment is suffering from the issue and has super high CPU usage. This change makes a huge difference in my local test.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan merged pull request #6793: [HUDI-4917] Optimized the way to get HoodieBaseFile of loadColumnRangesFromFiles of Bloom Index
Posted by GitBox <gi...@apache.org>.
nsivabalan merged PR #6793:
URL: https://github.com/apache/hudi/pull/6793
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] boneanxs commented on pull request #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
Posted by GitBox <gi...@apache.org>.
boneanxs commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1263026464
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1257535774
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* da04810eb0593e53bbce0e389930502cfbc217d4 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1260633731
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11730",
"triggerID" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"triggerType" : "PUSH"
}, {
"hash" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11733",
"triggerID" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"triggerType" : "PUSH"
}, {
"hash" : "5a5beba06c61fd2233a7f6861923b86fa860213e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11834",
"triggerID" : "5a5beba06c61fd2233a7f6861923b86fa860213e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a39a660ad1c53183d3cf6554f29bdd94b1d707ea Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11733)
* 5a5beba06c61fd2233a7f6861923b86fa860213e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11834)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1299514410
@boneanxs : once you are good, we can go ahead and land the patch.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] boneanxs commented on pull request #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
Posted by GitBox <gi...@apache.org>.
boneanxs commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1300246978
@CodeCooker17 can you plz help address the comment?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1260646832
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11730",
"triggerID" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"triggerType" : "PUSH"
}, {
"hash" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11733",
"triggerID" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"triggerType" : "PUSH"
}, {
"hash" : "5a5beba06c61fd2233a7f6861923b86fa860213e",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11834",
"triggerID" : "5a5beba06c61fd2233a7f6861923b86fa860213e",
"triggerType" : "PUSH"
}, {
"hash" : "32cc352122d276f5bb5943a0dd420920854fdb8e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "32cc352122d276f5bb5943a0dd420920854fdb8e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5a5beba06c61fd2233a7f6861923b86fa860213e Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11834)
* 32cc352122d276f5bb5943a0dd420920854fdb8e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1263026777
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11730",
"triggerID" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"triggerType" : "PUSH"
}, {
"hash" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11733",
"triggerID" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"triggerType" : "PUSH"
}, {
"hash" : "5a5beba06c61fd2233a7f6861923b86fa860213e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11834",
"triggerID" : "5a5beba06c61fd2233a7f6861923b86fa860213e",
"triggerType" : "PUSH"
}, {
"hash" : "32cc352122d276f5bb5943a0dd420920854fdb8e",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11837",
"triggerID" : "32cc352122d276f5bb5943a0dd420920854fdb8e",
"triggerType" : "PUSH"
}, {
"hash" : "32cc352122d276f5bb5943a0dd420920854fdb8e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11916",
"triggerID" : "1263026464",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 32cc352122d276f5bb5943a0dd420920854fdb8e Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11837) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11916)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1257618496
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11730",
"triggerID" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"triggerType" : "PUSH"
}, {
"hash" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* da04810eb0593e53bbce0e389930502cfbc217d4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11730)
* a39a660ad1c53183d3cf6554f29bdd94b1d707ea UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] namuny commented on pull request #6793: [HUDI-4917] Optimized the way to get HoodieBaseFile of loadColumnRangesFromFiles of Bloom Index
Posted by GitBox <gi...@apache.org>.
namuny commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1341677053
Hello, is there any updates for this one? We have the exact problem that'll be solved by this PR and would love to get it merged in.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] boneanxs commented on pull request #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
Posted by GitBox <gi...@apache.org>.
boneanxs commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1260315164
@CodeCooker17 Could you plz rebase the codes to fix the flaky issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] boneanxs commented on a diff in pull request #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
Posted by GitBox <gi...@apache.org>.
boneanxs commented on code in PR #6793:
URL: https://github.com/apache/hudi/pull/6793#discussion_r984153227
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/bloom/HoodieBloomIndex.java:
##########
@@ -161,19 +162,19 @@ private List<Pair<String, BloomIndexFileInfo>> getBloomIndexFileInfoForPartition
List<Pair<String, BloomIndexFileInfo>> loadColumnRangesFromFiles(
List<String> partitions, final HoodieEngineContext context, final HoodieTable hoodieTable) {
// Obtain the latest data files from all the partitions.
- List<Pair<String, String>> partitionPathFileIDList = getLatestBaseFilesForAllPartitions(partitions, context, hoodieTable).stream()
- .map(pair -> Pair.of(pair.getKey(), pair.getValue().getFileId()))
+ List<Pair<String, Pair<String, HoodieBaseFile>>> partitionPathFileIDList = getLatestBaseFilesForAllPartitions(partitions, context, hoodieTable).stream()
+ .map(pair -> Pair.of(pair.getKey(), Pair.of(pair.getValue().getFileId(), pair.getValue())))
.collect(toList());
context.setJobStatus(this.getClass().getName(), "Obtain key ranges for file slices (range pruning=on): " + config.getTableName());
return context.map(partitionPathFileIDList, pf -> {
try {
- HoodieRangeInfoHandle rangeInfoHandle = new HoodieRangeInfoHandle(config, hoodieTable, pf);
- String[] minMaxKeys = rangeInfoHandle.getMinMaxKeys();
- return Pair.of(pf.getKey(), new BloomIndexFileInfo(pf.getValue(), minMaxKeys[0], minMaxKeys[1]));
+ HoodieRangeInfoHandle rangeInfoHandle = new HoodieRangeInfoHandle(config, hoodieTable, Pair.of(pf.getKey(), pf.getValue().getKey()));
+ String[] minMaxKeys = rangeInfoHandle.getMinMaxKeys(pf.getValue().getValue());
Review Comment:
I think `HoodieRangeInfoHandle` is bind to a file slice, but here you break the class meaning to allow it handle different files. Maybe we can change the class construct to accept `BaseFile`, while keep the method as it is before.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1263105718
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11730",
"triggerID" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"triggerType" : "PUSH"
}, {
"hash" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11733",
"triggerID" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"triggerType" : "PUSH"
}, {
"hash" : "5a5beba06c61fd2233a7f6861923b86fa860213e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11834",
"triggerID" : "5a5beba06c61fd2233a7f6861923b86fa860213e",
"triggerType" : "PUSH"
}, {
"hash" : "32cc352122d276f5bb5943a0dd420920854fdb8e",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11837",
"triggerID" : "32cc352122d276f5bb5943a0dd420920854fdb8e",
"triggerType" : "PUSH"
}, {
"hash" : "32cc352122d276f5bb5943a0dd420920854fdb8e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11916",
"triggerID" : "1263026464",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 32cc352122d276f5bb5943a0dd420920854fdb8e Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11837) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11916)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1257977504
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11730",
"triggerID" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"triggerType" : "PUSH"
}, {
"hash" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11733",
"triggerID" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a39a660ad1c53183d3cf6554f29bdd94b1d707ea Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11733)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6793: 【HUDI-4917】Optimized the way to get HoodieBaseFile of loadColumnRange…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6793:
URL: https://github.com/apache/hudi/pull/6793#issuecomment-1260626730
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11730",
"triggerID" : "da04810eb0593e53bbce0e389930502cfbc217d4",
"triggerType" : "PUSH"
}, {
"hash" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11733",
"triggerID" : "a39a660ad1c53183d3cf6554f29bdd94b1d707ea",
"triggerType" : "PUSH"
}, {
"hash" : "5a5beba06c61fd2233a7f6861923b86fa860213e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5a5beba06c61fd2233a7f6861923b86fa860213e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a39a660ad1c53183d3cf6554f29bdd94b1d707ea Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11733)
* 5a5beba06c61fd2233a7f6861923b86fa860213e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org