You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 05:52:11 UTC

[I] Deprecate `hoodie.compaction.payload.class` and re-use hoodie.datasource.write.payload.class [hudi]

hudi-bot opened a new issue, #15438:
URL: https://github.com/apache/hudi/issues/15438

   We have two configs for payload which is causing confusion. 
   
    
   
   hoodie.datasource.write.payload.class
   
   and hoodie.compaction.payload.class
   
   2nd is a table config, which will be used by MOR snapshot query to merge base with log records. 
   
    
   
   From the code, looks like hoodie.compaction.payload.class is overwritten w/ whats set for hoodie.datasource.write.payload.class. So, hoodie.datasource.write.payload.class takes precedence. but lets see if we can deprecate one and use 1 config across the board. 
   
    
   
    
   
    
   
   ## JIRA info
   
   - Link: https://issues.apache.org/jira/browse/HUDI-4863
   - Type: Improvement
   
   
   ---
   
   
   ## Comments
   
   03/Nov/22 21:09;jonvex;remove the config from the guide and the configuration reference;;;


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Deprecate `hoodie.compaction.payload.class` and re-use hoodie.datasource.write.payload.class [hudi]

Posted by "rangareddy (via GitHub)" <gi...@apache.org>.
rangareddy commented on issue #15438:
URL: https://github.com/apache/hudi/issues/15438#issuecomment-4892894902

   This issue was reviewed as part of the JIRA-migrated backlog triage.
   
   **Findings:** this describes an incomplete improvement, not a bug. Currently supported: `hoodie.compaction.payload.class` is still a live config (HoodiePayloadConfig / HoodieTableConfig) and is overwritten by `hoodie.datasource.write.payload.class`, so the two coexist. 
   
   **Pending:** the requested consolidation into a single payload config. Note: RFC-97 (table version 9, EightToNineUpgradeHandler) has since moved toward deprecating payload classes entirely in favor of record-merge modes, which likely supersedes this ask.
   
   Keeping open. Will be scoped into a future feature-completion effort.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org