You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@fluss.apache.org by "zuston (via GitHub)" <gi...@apache.org> on 2026/01/20 06:19:50 UTC
[I] Add support of iceberg 1.4.3 as a independent module [fluss]
zuston opened a new issue, #2414:
URL: https://github.com/apache/fluss/issues/2414
### Search before asking
- [x] I searched in the [issues](https://github.com/apache/fluss/issues) and found nothing similar.
### Motivation
We are still using Iceberg 1.4.3. Would it be possible to introduce a dedicated Iceberg 1.4.3 compatibility module, similar to how Flink provides version-specific modules for Flink 1.18 and Flink 1.20?
### Solution
_No response_
### Anything else?
_No response_
### Willingness to contribute
- [x] I'm willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add support of iceberg 1.4.3 as a independent module [fluss]
Posted by "zuston (via GitHub)" <gi...@apache.org>.
zuston commented on issue #2414:
URL: https://github.com/apache/fluss/issues/2414#issuecomment-3771223721
cc @wuchong @luoyuxia
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add support of iceberg 1.4.3 as a independent module [fluss]
Posted by "MehulBatra (via GitHub)" <gi...@apache.org>.
MehulBatra commented on issue #2414:
URL: https://github.com/apache/fluss/issues/2414#issuecomment-3796461387
> Hi [@zuston](https://github.com/zuston),
>
> From the Fluss community’s perspective, maintaining a `fluss-iceberg-1.4.3` module would be quite hacky, as Iceberg 1.4.3 is an outdated version that is no longer maintained by the Iceberg community. Even when Fluss supports multiple Iceberg versions, it typically covers only the latest 3~4 releases (currently Iceberg 1.8 to 1.10), making it impractical to include version 1.4.
>
> Therefore, I recommend maintaining such a compatibility module in your private repository and prioritizing an upgrade to a more recent Iceberg version as soon as possible.
+1
Also, Fluss will be adopting deletion vectors (Iceberg v3, from 1.8.0+) to optimize our lakehouse integration for CDC and streaming workloads. Since 1.4.3 doesn't support v3, you'd miss out on the performance benefits specifically designed for Fluss + Iceberg together—faster deletes, reduced compaction overhead, and better union reads for pk tables.
Upgrading to 1.8+ ensures you can take full advantage of what we're building for the integrated experience.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add support of iceberg 1.4.3 as a independent module [fluss]
Posted by "wuchong (via GitHub)" <gi...@apache.org>.
wuchong commented on issue #2414:
URL: https://github.com/apache/fluss/issues/2414#issuecomment-3794031589
Hi @zuston,
From the Fluss community’s perspective, maintaining a `fluss-iceberg-1.4.3` module would be quite hacky, as Iceberg 1.4.3 is an outdated version that is no longer maintained by the Iceberg community. Even when Fluss supports multiple Iceberg versions, it typically covers only the latest 3~4 releases (currently Iceberg 1.8 to 1.10), making it impractical to include version 1.4.
Therefore, I recommend maintaining such a compatibility module in your private repository and prioritizing an upgrade to a more recent Iceberg version as soon as possible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add support of iceberg 1.4.3 as a independent module [fluss]
Posted by "zuston (via GitHub)" <gi...@apache.org>.
zuston commented on issue #2414:
URL: https://github.com/apache/fluss/issues/2414#issuecomment-3784342558
> [@zuston](https://github.com/zuston) Could you please share the exception message? Are you referring to an exception thrown by the tiering service? If so, note that the tiering service should always use the Iceberg version recommended by Fluss when writing Iceberg data.
I will share these exception messages later. I should also clarify that we are still using Hive 3.1.2 as the Iceberg metastore. As a result, upgrading to a newer Iceberg version that requires a higher Hive version is not compatible with our current backend metastore.
Although the Hive metastore JARs are admittedly quite messy, this constraint prevents us from adopting a higher Iceberg and Hive combination at this time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add support of iceberg 1.4.3 as a independent module [fluss]
Posted by "wuchong (via GitHub)" <gi...@apache.org>.
wuchong commented on issue #2414:
URL: https://github.com/apache/fluss/issues/2414#issuecomment-3784039383
@zuston Could you please share the exception message? Are you referring to an exception thrown by the tiering service? If so, note that the tiering service should always use the Iceberg version recommended by Fluss when writing Iceberg data.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add support of iceberg 1.4.3 as a independent module [fluss]
Posted by "zuston (via GitHub)" <gi...@apache.org>.
zuston commented on issue #2414:
URL: https://github.com/apache/fluss/issues/2414#issuecomment-3776283916
> [@zuston](https://github.com/zuston) Thanks for reporting. Do you find any compatibility issue with current fluss code? Fluss use a higher version iceberg to write, but it should still can be read via Iceberg 1.4.3, right?
Yes, the current code is not compatible with iceberg 1.4.3 with hive metastore, I test this on tiering service.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add support of iceberg 1.4.3 as a independent module [fluss]
Posted by "luoyuxia (via GitHub)" <gi...@apache.org>.
luoyuxia commented on issue #2414:
URL: https://github.com/apache/fluss/issues/2414#issuecomment-3776025039
@zuston Thanks for reporting. Do you find any compatibility issue with current fluss code? Fluss use a higher version iceberg to write, but it should still can be read via Iceberg 1.4.3, right?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org