You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "codope (via GitHub)" <gi...@apache.org> on 2024/10/12 07:48:07 UTC
[PR] [HUDI-8351] Fix and optimize secondary index update [hudi]
codope opened a new pull request, #12084:
URL: https://github.com/apache/hudi/pull/12084
### Change Logs
- Since RLI is required for secondary index, so do not create secondary index if RLI does not exist.
- Fix secondary index update by passing the right instant time in merged log record scanner.
- Return early when WriteOperationType is COMPACT or CLUSTER.
### Impact
A bug fix and minor optimization for secondary index update.
### Risk level (write none, low medium or high below)
low
### Documentation Update
_Describe any necessary documentation update if there is any new feature, config, or user-facing change. If not, put "none"._
- _The config description must be updated if new configs are added or the default value of the configs are changed_
- _Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
ticket number here and follow the [instruction](https://hudi.apache.org/contribute/developer-setup#website) to make
changes to the website._
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8351] Fix and optimize secondary index update [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12084:
URL: https://github.com/apache/hudi/pull/12084#issuecomment-2408509510
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c14cd1681072a77877b7d7fa26d9b4728780c5c2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1088",
"triggerID" : "c14cd1681072a77877b7d7fa26d9b4728780c5c2",
"triggerType" : "PUSH"
}, {
"hash" : "cf9db6f5ca7820199417f42a185ddc51cf18f84f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1089",
"triggerID" : "cf9db6f5ca7820199417f42a185ddc51cf18f84f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c14cd1681072a77877b7d7fa26d9b4728780c5c2 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1088)
* cf9db6f5ca7820199417f42a185ddc51cf18f84f Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1089)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8351] Fix and optimize secondary index update [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12084:
URL: https://github.com/apache/hudi/pull/12084#issuecomment-2408445493
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c14cd1681072a77877b7d7fa26d9b4728780c5c2",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1088",
"triggerID" : "c14cd1681072a77877b7d7fa26d9b4728780c5c2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c14cd1681072a77877b7d7fa26d9b4728780c5c2 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1088)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8351] Fix and optimize secondary index update [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan merged PR #12084:
URL: https://github.com/apache/hudi/pull/12084
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8351] Fix and optimize secondary index update [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12084:
URL: https://github.com/apache/hudi/pull/12084#issuecomment-2408532336
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c14cd1681072a77877b7d7fa26d9b4728780c5c2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1088",
"triggerID" : "c14cd1681072a77877b7d7fa26d9b4728780c5c2",
"triggerType" : "PUSH"
}, {
"hash" : "cf9db6f5ca7820199417f42a185ddc51cf18f84f",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1089",
"triggerID" : "cf9db6f5ca7820199417f42a185ddc51cf18f84f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cf9db6f5ca7820199417f42a185ddc51cf18f84f Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1089)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8351] Fix and optimize secondary index update [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12084:
URL: https://github.com/apache/hudi/pull/12084#issuecomment-2408509125
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c14cd1681072a77877b7d7fa26d9b4728780c5c2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1088",
"triggerID" : "c14cd1681072a77877b7d7fa26d9b4728780c5c2",
"triggerType" : "PUSH"
}, {
"hash" : "cf9db6f5ca7820199417f42a185ddc51cf18f84f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cf9db6f5ca7820199417f42a185ddc51cf18f84f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c14cd1681072a77877b7d7fa26d9b4728780c5c2 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1088)
* cf9db6f5ca7820199417f42a185ddc51cf18f84f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8351] Fix and optimize secondary index update [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12084:
URL: https://github.com/apache/hudi/pull/12084#issuecomment-2408445168
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c14cd1681072a77877b7d7fa26d9b4728780c5c2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c14cd1681072a77877b7d7fa26d9b4728780c5c2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c14cd1681072a77877b7d7fa26d9b4728780c5c2 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8351] Fix and optimize secondary index update [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12084:
URL: https://github.com/apache/hudi/pull/12084#issuecomment-2408469373
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c14cd1681072a77877b7d7fa26d9b4728780c5c2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1088",
"triggerID" : "c14cd1681072a77877b7d7fa26d9b4728780c5c2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c14cd1681072a77877b7d7fa26d9b4728780c5c2 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1088)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org