You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@fluss.apache.org by "gyang94 (via GitHub)" <gi...@apache.org> on 2026/09/10 12:32:06 UTC
[I] [kafka] Transcode mapped raw and string records to Arrow [fluss]
gyang94 opened a new issue, #4282:
URL: https://github.com/apache/fluss/issues/4282
### Purpose
Part of #4185. PR06 of the Kafka compatibility sequence.
Use the DDL mapping contract to decode raw/string keys and values, assemble physical rows with optional timestamps and ordered headers, and encode owned native Arrow log bytes.
### Acceptance criteria
- [ ] Raw bytes and strict UTF-8 strings map to the configured physical columns.
- [ ] Nullable values, empty bytes, NOT NULL violations and duplicate/nullable headers are handled correctly.
- [ ] The native batch uses the table schema ID and remains readable after Arrow resources close.
- [ ] Arrow writers and allocators close on encoding failures.
### Dependencies
PR05 Produce protocol (#4281); reuses the PR03 DDL contract (#4277 / #4275).
### Scope boundary
No JSON decoding, gateway append, protocol registration or core module changes.
### Implementation
Draft PR link will be added after publication.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [kafka] Transcode mapped raw and string records to Arrow [fluss]
Posted by "wuchong (via GitHub)" <gi...@apache.org>.
wuchong closed issue #4282: [kafka] Transcode mapped raw and string records to Arrow
URL: https://github.com/apache/fluss/issues/4282
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org