You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@iceberg.apache.org by Manu Zhang <ow...@gmail.com> on 2026/09/18 16:19:48 UTC
[DISCUSS] iceberg-cpp 0.4.0 release
Hi folks,
Iceberg-cpp 0.3.0 was released in June. Since then, 174 commits have landed
on main, including several key features and enhancements:
- Iceberg v3: Support for new types (timestamp_ns, timestamptz_ns,
unknown, geometry, geography), column default values, binary deletion
vectors, and row lineage.
- Table updates: MergeAppend, DeleteFiles, RowDelta, OverwriteFiles,
RewriteFiles, and ReplacePartitions.
- Performance: Parallel manifest reads and writes, lazy scan planning, an
LRU cache, and metrics for commits and scans.
- Catalogs and IO: REST SigV4 and OAuth2 token exchange, vended
credentials, an initial Hive Metastore client, and ResolvingFileIO.
- Other updates: Pluggable logging (optional spdlog backend) and metadata
table scans (SnapshotsTable). Meson build support has been removed.
Given this progress, I would like to propose starting the 0.4.0 release.
Ongoing work, such as variant types, encryption, and Puffin statistics,
will be deferred to a later release.
Please let me know your thoughts. If there are no objections, I am happy to
act as the release manager, with Gang Wu kindly offering support.
Thanks,
Manu
Re: [DISCUSS] iceberg-cpp 0.4.0 release
Posted by zhuo wang <wn...@gmail.com>.
+1. There have been many commits since the 0.3.0 release, I agree that
it is a good time to release 0.4.0.
On Sun, Sep 20, 2026 at 4:40 PM Zehua Zou <ze...@gmail.com> wrote:
>
> +1. The implementation of `variant` in Arrow C++ is underway but still requires some time; there is no reason for it to hold up the release of other features in `iceberg-cpp`.
>
> On Sep 20, 2026, at 15:13, Gang Wu <us...@gmail.com> wrote:
>
> +1 for releasing 0.4.0.
>
> I don't see any blockers at this moment. It will still take a while for Arrow C++ to merge the variant PR so we can defer it to 0.5.0.
>
> Thanks Manu for volunteering!
>
> On Sat, Sep 19, 2026 at 12:20 AM Manu Zhang <ow...@gmail.com> wrote:
>>
>> Hi folks,
>>
>> Iceberg-cpp 0.3.0 was released in June. Since then, 174 commits have landed on main, including several key features and enhancements:
>>
>> - Iceberg v3: Support for new types (timestamp_ns, timestamptz_ns, unknown, geometry, geography), column default values, binary deletion vectors, and row lineage.
>> - Table updates: MergeAppend, DeleteFiles, RowDelta, OverwriteFiles, RewriteFiles, and ReplacePartitions.
>> - Performance: Parallel manifest reads and writes, lazy scan planning, an LRU cache, and metrics for commits and scans.
>> - Catalogs and IO: REST SigV4 and OAuth2 token exchange, vended credentials, an initial Hive Metastore client, and ResolvingFileIO.
>> - Other updates: Pluggable logging (optional spdlog backend) and metadata table scans (SnapshotsTable). Meson build support has been removed.
>>
>> Given this progress, I would like to propose starting the 0.4.0 release. Ongoing work, such as variant types, encryption, and Puffin statistics, will be deferred to a later release.
>>
>> Please let me know your thoughts. If there are no objections, I am happy to act as the release manager, with Gang Wu kindly offering support.
>>
>> Thanks,
>> Manu
>>
>
Re: [DISCUSS] iceberg-cpp 0.4.0 release
Posted by Zehua Zou <ze...@gmail.com>.
+1. The implementation of `variant` in Arrow C++ is underway but still requires some time; there is no reason for it to hold up the release of other features in `iceberg-cpp`.
> On Sep 20, 2026, at 15:13, Gang Wu <us...@gmail.com> wrote:
>
> +1 for releasing 0.4.0.
>
> I don't see any blockers at this moment. It will still take a while for Arrow C++ to merge the variant PR so we can defer it to 0.5.0.
>
> Thanks Manu for volunteering!
>
> On Sat, Sep 19, 2026 at 12:20 AM Manu Zhang <owenzhang1990@gmail.com <ma...@gmail.com>> wrote:
>> Hi folks,
>>
>> Iceberg-cpp 0.3.0 was released in June. Since then, 174 commits have landed on main, including several key features and enhancements:
>>
>> - Iceberg v3: Support for new types (timestamp_ns, timestamptz_ns, unknown, geometry, geography), column default values, binary deletion vectors, and row lineage.
>> - Table updates: MergeAppend, DeleteFiles, RowDelta, OverwriteFiles, RewriteFiles, and ReplacePartitions.
>> - Performance: Parallel manifest reads and writes, lazy scan planning, an LRU cache, and metrics for commits and scans.
>> - Catalogs and IO: REST SigV4 and OAuth2 token exchange, vended credentials, an initial Hive Metastore client, and ResolvingFileIO.
>> - Other updates: Pluggable logging (optional spdlog backend) and metadata table scans (SnapshotsTable). Meson build support has been removed.
>>
>> Given this progress, I would like to propose starting the 0.4.0 release. Ongoing work, such as variant types, encryption, and Puffin statistics, will be deferred to a later release.
>>
>> Please let me know your thoughts. If there are no objections, I am happy to act as the release manager, with Gang Wu kindly offering support.
>>
>> Thanks,
>> Manu
>>
Re: [DISCUSS] iceberg-cpp 0.4.0 release
Posted by Gang Wu <us...@gmail.com>.
+1 for releasing 0.4.0.
I don't see any blockers at this moment. It will still take a while for
Arrow C++ to merge the variant PR so we can defer it to 0.5.0.
Thanks Manu for volunteering!
On Sat, Sep 19, 2026 at 12:20 AM Manu Zhang <ow...@gmail.com> wrote:
> Hi folks,
>
> Iceberg-cpp 0.3.0 was released in June. Since then, 174 commits have
> landed on main, including several key features and enhancements:
>
> - Iceberg v3: Support for new types (timestamp_ns, timestamptz_ns,
> unknown, geometry, geography), column default values, binary deletion
> vectors, and row lineage.
> - Table updates: MergeAppend, DeleteFiles, RowDelta, OverwriteFiles,
> RewriteFiles, and ReplacePartitions.
> - Performance: Parallel manifest reads and writes, lazy scan planning,
> an LRU cache, and metrics for commits and scans.
> - Catalogs and IO: REST SigV4 and OAuth2 token exchange, vended
> credentials, an initial Hive Metastore client, and ResolvingFileIO.
> - Other updates: Pluggable logging (optional spdlog backend) and
> metadata table scans (SnapshotsTable). Meson build support has been removed.
>
> Given this progress, I would like to propose starting the 0.4.0 release.
> Ongoing work, such as variant types, encryption, and Puffin statistics,
> will be deferred to a later release.
>
> Please let me know your thoughts. If there are no objections, I am happy
> to act as the release manager, with Gang Wu kindly offering support.
>
> Thanks,
> Manu
>
>
Re: [DISCUSS] iceberg-cpp 0.4.0 release
Posted by Manu Zhang <ow...@gmail.com>.
Thanks Junwang for the reminder.
https://github.com/apache/iceberg-cpp/issues/955 has been created to track.
On Tue, Sep 22, 2026 at 9:59 AM Junwang Zhao <zh...@gmail.com> wrote:
> Hi Manu,
>
> We can create an issue to track the release progress, see [0] and [1].
>
> [0] https://github.com/apache/iceberg-cpp/issues/522
> [1] https://github.com/apache/iceberg-cpp/issues/696
>
> On Mon, Sep 21, 2026 at 7:57 AM Manu Zhang <ow...@gmail.com>
> wrote:
> >
> > Hi Junwang,
> >
> > Thanks for the update. I will wait one more day and then try creating a
> release candidate if there are no objections.
> >
> > On Sun, Sep 20, 2026 at 10:23 PM Junwang Zhao <zh...@gmail.com> wrote:
> >>
> >> Hi,
> >>
> >> I just updated the status of **Track Iceberg v3 Feature Support
> >> (Roadmap for 0.4.0)**[0], it seems most of the planned tasks have been
> >> completed.
> >>
> >> [0] https://github.com/apache/iceberg-cpp/issues/637
> >>
> >> On Sun, Sep 20, 2026 at 5:40 PM Junwang Zhao <zh...@gmail.com> wrote:
> >> >
> >> > On Sun, Sep 20, 2026 at 4:30 PM Manu Zhang <ow...@gmail.com>
> wrote:
> >> > >
> >> > > Hi Junwang,
> >> > >
> >> > >> It would be great to include CherryPickOperation(#926) and
> >> > >> RewriteManifests in this release to make metadata update support
> more
> >> > >> complete. I have a branch for RewriteManifests, but I'm not sure we
> >> > >> have enough review bandwidth for both due to the coming holiday
> days.
> >> > >>
> >> > >>
> >> > >>
> >> > >> Could we postpone the release until late October?
> >> > >
> >> > >
> >> > > I don't think we will reach "feature complete" or maturity soon, so
> I'd rather we make faster and smaller releases to get early feedback from
> users.
> >> > > We can make another release in late October when
> CherryPickOperation, RewriteManifests, and other new features land.
> >> >
> >> > Ok, let's make 0.4.0 happen!
> >> >
> >> > --
> >> > Regards
> >> > Junwang Zhao
> >>
> >>
> >>
> >> --
> >> Regards
> >> Junwang Zhao
>
>
>
> --
> Regards
> Junwang Zhao
>
Re: [DISCUSS] iceberg-cpp 0.4.0 release
Posted by Junwang Zhao <zh...@gmail.com>.
Hi Manu,
We can create an issue to track the release progress, see [0] and [1].
[0] https://github.com/apache/iceberg-cpp/issues/522
[1] https://github.com/apache/iceberg-cpp/issues/696
On Mon, Sep 21, 2026 at 7:57 AM Manu Zhang <ow...@gmail.com> wrote:
>
> Hi Junwang,
>
> Thanks for the update. I will wait one more day and then try creating a release candidate if there are no objections.
>
> On Sun, Sep 20, 2026 at 10:23 PM Junwang Zhao <zh...@gmail.com> wrote:
>>
>> Hi,
>>
>> I just updated the status of **Track Iceberg v3 Feature Support
>> (Roadmap for 0.4.0)**[0], it seems most of the planned tasks have been
>> completed.
>>
>> [0] https://github.com/apache/iceberg-cpp/issues/637
>>
>> On Sun, Sep 20, 2026 at 5:40 PM Junwang Zhao <zh...@gmail.com> wrote:
>> >
>> > On Sun, Sep 20, 2026 at 4:30 PM Manu Zhang <ow...@gmail.com> wrote:
>> > >
>> > > Hi Junwang,
>> > >
>> > >> It would be great to include CherryPickOperation(#926) and
>> > >> RewriteManifests in this release to make metadata update support more
>> > >> complete. I have a branch for RewriteManifests, but I'm not sure we
>> > >> have enough review bandwidth for both due to the coming holiday days.
>> > >>
>> > >>
>> > >>
>> > >> Could we postpone the release until late October?
>> > >
>> > >
>> > > I don't think we will reach "feature complete" or maturity soon, so I'd rather we make faster and smaller releases to get early feedback from users.
>> > > We can make another release in late October when CherryPickOperation, RewriteManifests, and other new features land.
>> >
>> > Ok, let's make 0.4.0 happen!
>> >
>> > --
>> > Regards
>> > Junwang Zhao
>>
>>
>>
>> --
>> Regards
>> Junwang Zhao
--
Regards
Junwang Zhao
Re: [DISCUSS] iceberg-cpp 0.4.0 release
Posted by Manu Zhang <ow...@gmail.com>.
Hi Junwang,
Thanks for the update. I will wait one more day and then try creating a
release candidate if there are no objections.
On Sun, Sep 20, 2026 at 10:23 PM Junwang Zhao <zh...@gmail.com> wrote:
> Hi,
>
> I just updated the status of **Track Iceberg v3 Feature Support
> (Roadmap for 0.4.0)**[0], it seems most of the planned tasks have been
> completed.
>
> [0] https://github.com/apache/iceberg-cpp/issues/637
>
> On Sun, Sep 20, 2026 at 5:40 PM Junwang Zhao <zh...@gmail.com> wrote:
> >
> > On Sun, Sep 20, 2026 at 4:30 PM Manu Zhang <ow...@gmail.com>
> wrote:
> > >
> > > Hi Junwang,
> > >
> > >> It would be great to include CherryPickOperation(#926) and
> > >> RewriteManifests in this release to make metadata update support more
> > >> complete. I have a branch for RewriteManifests, but I'm not sure we
> > >> have enough review bandwidth for both due to the coming holiday days.
> > >>
> > >>
> > >>
> > >> Could we postpone the release until late October?
> > >
> > >
> > > I don't think we will reach "feature complete" or maturity soon, so
> I'd rather we make faster and smaller releases to get early feedback from
> users.
> > > We can make another release in late October when CherryPickOperation,
> RewriteManifests, and other new features land.
> >
> > Ok, let's make 0.4.0 happen!
> >
> > --
> > Regards
> > Junwang Zhao
>
>
>
> --
> Regards
> Junwang Zhao
>
Re: [DISCUSS] iceberg-cpp 0.4.0 release
Posted by Junwang Zhao <zh...@gmail.com>.
Hi,
I just updated the status of **Track Iceberg v3 Feature Support
(Roadmap for 0.4.0)**[0], it seems most of the planned tasks have been
completed.
[0] https://github.com/apache/iceberg-cpp/issues/637
On Sun, Sep 20, 2026 at 5:40 PM Junwang Zhao <zh...@gmail.com> wrote:
>
> On Sun, Sep 20, 2026 at 4:30 PM Manu Zhang <ow...@gmail.com> wrote:
> >
> > Hi Junwang,
> >
> >> It would be great to include CherryPickOperation(#926) and
> >> RewriteManifests in this release to make metadata update support more
> >> complete. I have a branch for RewriteManifests, but I'm not sure we
> >> have enough review bandwidth for both due to the coming holiday days.
> >>
> >>
> >>
> >> Could we postpone the release until late October?
> >
> >
> > I don't think we will reach "feature complete" or maturity soon, so I'd rather we make faster and smaller releases to get early feedback from users.
> > We can make another release in late October when CherryPickOperation, RewriteManifests, and other new features land.
>
> Ok, let's make 0.4.0 happen!
>
> --
> Regards
> Junwang Zhao
--
Regards
Junwang Zhao
Re: [DISCUSS] iceberg-cpp 0.4.0 release
Posted by Junwang Zhao <zh...@gmail.com>.
On Sun, Sep 20, 2026 at 4:30 PM Manu Zhang <ow...@gmail.com> wrote:
>
> Hi Junwang,
>
>> It would be great to include CherryPickOperation(#926) and
>> RewriteManifests in this release to make metadata update support more
>> complete. I have a branch for RewriteManifests, but I'm not sure we
>> have enough review bandwidth for both due to the coming holiday days.
>>
>>
>>
>> Could we postpone the release until late October?
>
>
> I don't think we will reach "feature complete" or maturity soon, so I'd rather we make faster and smaller releases to get early feedback from users.
> We can make another release in late October when CherryPickOperation, RewriteManifests, and other new features land.
Ok, let's make 0.4.0 happen!
--
Regards
Junwang Zhao
Re: [DISCUSS] iceberg-cpp 0.4.0 release
Posted by Manu Zhang <ow...@gmail.com>.
Hi Junwang,
It would be great to include CherryPickOperation(#926) and
> RewriteManifests in this release to make metadata update support more
> complete. I have a branch for RewriteManifests, but I'm not sure we
> have enough review bandwidth for both due to the coming holiday days.
Could we postpone the release until late October?
I don't think we will reach "feature complete" or maturity soon, so I'd
rather we make faster and smaller releases to get early feedback from users.
We can make another release in late October when CherryPickOperation,
RewriteManifests, and other new features land.
Thanks,
Manu
On Sun, Sep 20, 2026 at 3:48 PM Junwang Zhao <zh...@gmail.com> wrote:
> Hi,
>
> On Sat, Sep 19, 2026 at 12:20 AM Manu Zhang <ow...@gmail.com>
> wrote:
> >
> > Hi folks,
> >
> > Iceberg-cpp 0.3.0 was released in June. Since then, 174 commits have
> landed on main, including several key features and enhancements:
> >
> > - Iceberg v3: Support for new types (timestamp_ns, timestamptz_ns,
> unknown, geometry, geography), column default values, binary deletion
> vectors, and row lineage.
> > - Table updates: MergeAppend, DeleteFiles, RowDelta, OverwriteFiles,
> RewriteFiles, and ReplacePartitions.
> > - Performance: Parallel manifest reads and writes, lazy scan planning,
> an LRU cache, and metrics for commits and scans.
> > - Catalogs and IO: REST SigV4 and OAuth2 token exchange, vended
> credentials, an initial Hive Metastore client, and ResolvingFileIO.
> > - Other updates: Pluggable logging (optional spdlog backend) and
> metadata table scans (SnapshotsTable). Meson build support has been removed.
> >
> > Given this progress, I would like to propose starting the 0.4.0 release.
> Ongoing work, such as variant types, encryption, and Puffin statistics,
> will be deferred to a later release.
> >
> > Please let me know your thoughts. If there are no objections, I am happy
> to act as the release manager, with Gang Wu kindly offering support.
>
> It would be great to include CherryPickOperation(#926) and
> RewriteManifests in this release to make metadata update support more
> complete. I have a branch for RewriteManifests, but I'm not sure we
> have enough review bandwidth for both due to the coming holiday days.
>
> Could we postpone the release until late October?
>
> >
> > Thanks,
> > Manu
> >
>
>
> --
> Regards
> Junwang Zhao
>
Re: [DISCUSS] iceberg-cpp 0.4.0 release
Posted by Junwang Zhao <zh...@gmail.com>.
Hi,
On Sat, Sep 19, 2026 at 12:20 AM Manu Zhang <ow...@gmail.com> wrote:
>
> Hi folks,
>
> Iceberg-cpp 0.3.0 was released in June. Since then, 174 commits have landed on main, including several key features and enhancements:
>
> - Iceberg v3: Support for new types (timestamp_ns, timestamptz_ns, unknown, geometry, geography), column default values, binary deletion vectors, and row lineage.
> - Table updates: MergeAppend, DeleteFiles, RowDelta, OverwriteFiles, RewriteFiles, and ReplacePartitions.
> - Performance: Parallel manifest reads and writes, lazy scan planning, an LRU cache, and metrics for commits and scans.
> - Catalogs and IO: REST SigV4 and OAuth2 token exchange, vended credentials, an initial Hive Metastore client, and ResolvingFileIO.
> - Other updates: Pluggable logging (optional spdlog backend) and metadata table scans (SnapshotsTable). Meson build support has been removed.
>
> Given this progress, I would like to propose starting the 0.4.0 release. Ongoing work, such as variant types, encryption, and Puffin statistics, will be deferred to a later release.
>
> Please let me know your thoughts. If there are no objections, I am happy to act as the release manager, with Gang Wu kindly offering support.
It would be great to include CherryPickOperation(#926) and
RewriteManifests in this release to make metadata update support more
complete. I have a branch for RewriteManifests, but I'm not sure we
have enough review bandwidth for both due to the coming holiday days.
Could we postpone the release until late October?
>
> Thanks,
> Manu
>
--
Regards
Junwang Zhao