You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 10:38:19 UTC

[I] Support partial update in Spark Structured Streaming [hudi]

hudi-bot opened a new issue, #16610:
URL: https://github.com/apache/hudi/issues/16610

   The partial update feature (added in https://github.com/apache/hudi/pull/9876) with the partial schema as the write config ("hoodie.write.partial.update.schema") should already work in Spark. We need to make sure that Spark Structured Streaming job can work with the new partial update feature.
   
   ## JIRA info
   
   - Link: https://issues.apache.org/jira/browse/HUDI-8193
   - Type: New Feature
   - Fix version(s):
     - 1.1.0
   
   
   ---
   
   
   ## Comments
   
   15/Oct/24 03:33;yihua;Deferring this to Hudi 1.1.;;;


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Support partial update in Spark Structured Streaming [hudi]

Posted by "rangareddy (via GitHub)" <gi...@apache.org>.
rangareddy commented on issue #16610:
URL: https://github.com/apache/hudi/issues/16610#issuecomment-5434690522

   This issue was reviewed as part of the JIRA-migrated backlog triage (HUDI-8193).
   
   **Findings: still open. The linked PR is merged, but it is not a fix for this.**
   
   - #9876 - `[HUDI-6800] Support writing partial updates to the data blocks in MOR tables` (HUDI-6800), merged 2023-10-25
   
   Those carry a different JIRA key from this ticket - they are the change this issue was filed to follow up on. I compared each PR's content against what this ticket asks rather than relying on the key alone, and the asks are genuinely distinct, so this is a follow-up rather than a duplicate ticket.
   
   No commit on `master` references HUDI-8193, so nothing has landed under this key.
   
   Keeping this open.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org