You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 09:54:27 UTC
[I] Avoid reading log files for resolving schema for _hoodie_operation field [hudi]
hudi-bot opened a new issue, #16440:
URL: https://github.com/apache/hudi/issues/16440
The table schema resolver needs to read schema from the data files (base or log files) to see whether _hoodie_operation field is present for Flink CDC use cases. This can cause overhead of reading data file footers multiple times. We should see if we can store a table config to indicate if _hoodie_operation field is present in the table, or simplify the Flink CDC format in Hudi 1.0 (thus no need of _hoodie_operation field and schema resolver).
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-7585
- Type: Improvement
- Epic: https://issues.apache.org/jira/browse/HUDI-6242
- Fix version(s):
- 1.1.0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Avoid reading log files for resolving schema for _hoodie_operation field [hudi]
Posted by "rangareddy (via GitHub)" <gi...@apache.org>.
rangareddy commented on issue #16440:
URL: https://github.com/apache/hudi/issues/16440#issuecomment-5434669896
This issue was reviewed as part of the JIRA-migrated backlog triage (HUDI-7585).
**Findings: still open.**
No commit on `master` references HUDI-7585, so nothing has landed under this ticket's key.
The description is substantive and self-describing, so this is workable as written - what is missing is an owner rather than a specification.
Keeping this open.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org