You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 04:56:34 UTC

[I] Support compact according to precombinekey in the RealtimeCompactedRecordReader class [hudi]

hudi-bot opened a new issue, #15170:
URL: https://github.com/apache/hudi/issues/15170

   ## JIRA info
   
   - Link: https://issues.apache.org/jira/browse/HUDI-4041
   - Type: Improvement
   - Fix version(s):
     - 1.1.0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Support compact according to precombinekey in the RealtimeCompactedRecordReader class [hudi]

Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.

nsivabalan closed issue #15170: Support compact according to precombinekey in the RealtimeCompactedRecordReader class
URL: https://github.com/apache/hudi/issues/15170


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Support compact according to precombinekey in the RealtimeCompactedRecordReader class [hudi]

Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.

nsivabalan commented on issue #15170:
URL: https://github.com/apache/hudi/issues/15170#issuecomment-4795329717

   Triage note: this looks fixed on current `master`. `RealtimeCompactedRecordReader.mergeRecord()` now extracts `orderingFields` from `payloadProps` (via `ConfigUtils.getOrderingFields`) and builds `BufferedRecord`s with those ordering fields for both the base parquet record and the incoming log record, then merges via `HoodieAvroRecordMerger.merge()` — which delegates to `payload.combineAndGetUpdateValue()`. Default payloads (e.g. `DefaultHoodieRecordPayload`) honor the precombine/ordering field there, so the realtime compacted reader now compacts according to the precombine key. Related work landed via RFC-101 (#13742), HUDI-9125 (#12925), and HUDI-8682 (#12452). Closing candidate — please reopen with a concrete repro if a gap remains.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Support compact according to precombinekey in the RealtimeCompactedRecordReader class [hudi]

Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.

hudi-bot commented on issue #15170:
URL: https://github.com/apache/hudi/issues/15170#issuecomment-3630215726

   ### Linked PR(s)
   
   - https://github.com/apache/hudi/pull/5509


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org