You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@fluss.apache.org by "platinumhamburg (via GitHub)" <gi...@apache.org> on 2025/11/13 03:26:03 UTC
[I] Support Array type in log table (Arrow row format) [fluss]
platinumhamburg opened a new issue, #1972:
URL: https://github.com/apache/fluss/issues/1972
### Search before asking
- [x] I searched in the [issues](https://github.com/apache/fluss/issues) and found nothing similar.
### Motivation
Add Array type support for log table scenarios using Arrow row format. This enables clients to write and read array data in log tables.
### Solution
- Extend Arrow row format to support Array type serialization/deserialization
- Implement Array type encoding/decoding in client SDK
- Add validation for Array type in schema definitions
- Ensure end-to-end data flow works for Array type in log tables
### Anything else?
This is the foundation for complex type support in log tables.
### Willingness to contribute
- [ ] I'm willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support Array type in log table (Arrow row format) [fluss]
Posted by "platinumhamburg (via GitHub)" <gi...@apache.org>.
platinumhamburg commented on issue #1972:
URL: https://github.com/apache/fluss/issues/1972#issuecomment-3539628231
> [@platinumhamburg](https://github.com/platinumhamburg) Cool, then may I take [#1978](https://github.com/apache/fluss/issues/1978) ? Suppose I can start to implement it after [@XuQianJin-Stars](https://github.com/XuQianJin-Stars) 's great work merged. If I have some problems at that time I will reach [@XuQianJin-Stars](https://github.com/XuQianJin-Stars) for help.
Yes, of course!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support Array type in log table (Arrow row format) [fluss]
Posted by "wuchong (via GitHub)" <gi...@apache.org>.
wuchong closed issue #1972: Support Array type in log table (Arrow row format)
URL: https://github.com/apache/fluss/issues/1972
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support Array type in log table (Arrow row format) [fluss]
Posted by "platinumhamburg (via GitHub)" <gi...@apache.org>.
platinumhamburg commented on issue #1972:
URL: https://github.com/apache/fluss/issues/1972#issuecomment-3526683436
> Hi [@platinumhamburg](https://github.com/platinumhamburg) , I see there are many issues about complex data type support. Can I take one of them (maybe this one)?
Hi, @gyang94, @XuQianJin-Stars has already accomplished some candidate PRs several months ago. I've created such subtasks above to help him separate his huge PR into several reviewable PRs, but I think there are actually some issues he hasn't finished yet, such as:
- Support Array/Map/NestedRow types in Flink connector: https://github.com/apache/fluss/issues/1978
- Support column projection for Array/NestedRow/Map types in Flink connector: https://github.com/apache/fluss/issues/1979
- Support Array/NestedRow/Map types in tiering service: https://github.com/apache/fluss/issues/1980
- Support Array/NestedRow/Map types in union read: https://github.com/apache/fluss/issues/1981
If you are interested in any of the issues above, your contribution would be welcome. You might also disscuss and coordinate with @XuQianJin-Stars to explore potential collaboration points.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support Array type in log table (Arrow row format) [fluss]
Posted by "gyang94 (via GitHub)" <gi...@apache.org>.
gyang94 commented on issue #1972:
URL: https://github.com/apache/fluss/issues/1972#issuecomment-3526722879
@platinumhamburg Cool, then may I take #1978 ?
Suppose I can start to implement it after @XuQianJin-Stars 's great work merged. If I have some problems at that time I will reach @XuQianJin-Stars for help.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support Array type in log table (Arrow row format) [fluss]
Posted by "XuQianJin-Stars (via GitHub)" <gi...@apache.org>.
XuQianJin-Stars commented on issue #1972:
URL: https://github.com/apache/fluss/issues/1972#issuecomment-3568717698
hi @gyang94 Could I add you on WeChat? Let's discuss privately how to support Flink Connector.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support Array type in log table (Arrow row format) [fluss]
Posted by "gyang94 (via GitHub)" <gi...@apache.org>.
gyang94 commented on issue #1972:
URL: https://github.com/apache/fluss/issues/1972#issuecomment-3570918498
@XuQianJin-Stars Sure. My WeChat `shunqiziran_GY`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support Array type in log table (Arrow row format) [fluss]
Posted by "gyang94 (via GitHub)" <gi...@apache.org>.
gyang94 commented on issue #1972:
URL: https://github.com/apache/fluss/issues/1972#issuecomment-3526154157
Hi @platinumhamburg , I see there are many issues about complex data type support. Can I take one of them (maybe this one)?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support Array type in log table (Arrow row format) [fluss]
Posted by "XuQianJin-Stars (via GitHub)" <gi...@apache.org>.
XuQianJin-Stars commented on issue #1972:
URL: https://github.com/apache/fluss/issues/1972#issuecomment-3539755793
Thanks, I've submitted a PR! https://github.com/apache/fluss/pull/1987
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org