You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 07:46:24 UTC
[I] Unify the logic of intra-partition upsert and cross-partition upsert in flink state index. [hudi]
hudi-bot opened a new issue, #15944:
URL: https://github.com/apache/hudi/issues/15944
Now when partitioning upsert, according to {{precombine.field}} parameter, keep the record with the largest value after upserting.
This is widely used to solve the case of out-of-order data, by setting the {{precombine.field}} to the event time to keep records with the largest event time.
However, when using the FLINK_STATE index type, if cross-partition occurs, the precombine.field parameter will not fully take effect.
In the case of cross-partitioning, the current logic uses data that arrives later, even if the event time is smaller.
It may be necessary to unify the logic of intra-partition upsert and cross-partition upsert, which is convenient for users to understand and use.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-6188
- Type: Improvement
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Unify the logic of intra-partition upsert and cross-partition upsert in flink state index. [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on issue #15944:
URL: https://github.com/apache/hudi/issues/15944#issuecomment-3630162896
### Linked PR(s)
- https://github.com/apache/hudi/pull/8663
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Unify the logic of intra-partition upsert and cross-partition upsert in flink state index. [hudi]
Posted by "deepakpanda93 (via GitHub)" <gi...@apache.org>.
deepakpanda93 commented on issue #15944:
URL: https://github.com/apache/hudi/issues/15944#issuecomment-5424648935
This issue was reviewed as part of the JIRA-migrated backlog triage. It is being kept open.
Unify intra-partition and cross-partition upsert in the Flink state index. NOTE the linked PR #8663 is closed AND empty - the API reports +0/-0 across 0 files - so it would have changed nothing even if merged.
No commit or PR carries HUDI-6188.
Attached: CLOSED-UNMERGED PR #8663 (+0/-0, 0f).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org