You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@iceberg.apache.org by Ryan Blue <rd...@gmail.com> on 2025/12/10 22:55:19 UTC
[DISCUSS] December board report
Hi everyone,
Here’s the board report for December. If you have anything to add, please
reply. And congrats to our new committers and PMC members!
Description:
Apache Iceberg is a table format for huge analytic datasets that is designed
for high performance and ease of use.
Project Status:
Current project status: Ongoing
Issues for the board: None
Membership Data:
Apache Iceberg was founded 2020-05-19 (6 years ago)
There are currently 36 committers and 23 PMC members in this project.
The Committer-to-PMC ratio is roughly 3:2.
Community changes, past quarter:
- Kevin Liu was added to the PMC on 2025-11-16
- Matthew Topol was added to the PMC on 2025-11-23
- Gang Wu was added as committer on 2025-10-15
Project Activity:
Releases:
- Go 0.4.0 was released on 2025-10-13.
- Rust 0.7.0 was released on 2025-10-11.
Project:
- Separated CI emails to a new ci-jobs ML
- Removed blogs/ and talks/ pages from the site
- Added ASF-approved web analytics
- Added markdown and yaml lint checks
REST catalog spec:
- Added min-rows-requested to server-side planning
- Added storage credentials to server-side planning
- Added idempotency tokens to the spec
- Discussing adding etags to responses
UDF spec is nearing completion, added null handling and has settled on
structure
Java:
- File format API reviews are ongoing; close to completion
- Merged encryption integration and tests for Hive catalog
- Flink: Added write support for v3 DVs
- Added support for custom internal types with Parquet files
- Added BigQuery catalog support to to runtime Jars
PyIceberg:
- Removed Python 3.9 support
- Added support for v3 row lineage
- Added expression serialization
- Improvements to CI and build
Rust:
- Added support for v3 metadata
- Added update_table for MemoryCatalog and GlueCatalog
- Introduced catalog loader for multiple catalogs.
- Added PartitionSplitter, RollingFileWriter, and partition-aware
locations.
- DataFusion: Added write and commit execution plans enabling INSERT
INTO.
- Added support for loading equality deletes during scans.
- DataFusion v48 support.
Go:
- Improvements to unit tests and docker images for testing configurations
- Fixing a crash when writing a map column with multiple entries per row
- Several improvements to the release scripts
- Support for writing to a Partitioned Iceberg tables!
- Initial support for v3 metadata
- Implemented the views spec
- Added schema evolution support and timestamp(9)
C++:
- Can write Avro metadata files
- Added REST request/response models
- Implemented TableMetadataBuilder
- Added scaffolding for expressions
- Added binary literal serialization
Community Health:
We are happy to welcome Gang as a new committer and Matt Topol and Kevin
Liu as
new PMC members!
The Iceberg PMC has encouraged community-driven meetups by providing
guidelines
for meetup organizers. This has been very successful and there have been
meetups
in many different locations: Amsterdam, Bangalore, Paris, Warsaw, Budapest,
Pittsburgh, Hamburg, Goteborg, Munich, Atlanta, Seattle, London, North
Carolina,
and Menlo Park. The community has also worked to improve these guidelines
and
ensure that they are small events that do not conflict with ASF events,
since
there was an event almost too large near Community over Code.
Re: [DISCUSS] December board report
Posted by Renjie Liu <li...@gmail.com>.
Thanks Ryan,
The Rust part looks good to me.
On Mon, Dec 15, 2025 at 4:08 AM Fokko Driesprong <fo...@apache.org> wrote:
> Thanks Ryan,
>
> The report looks good. Two potential things to add:
>
> - The creation of the new Terraform repository
> - We're gearing up for the Iceberg Rust 0.8 release
>
> Kind regards,
> Fokko
>
> Op do 11 dec 2025 om 20:38 schreef Kevin Liu <ke...@apache.org>:
>
>> Thanks Ryan, this looks great. Thanks for including the paragraph about
>> meetups in the community health section.
>>
>> A few things that might be good to include (in no particular order):
>> - Iceberg Summit 2026
>> - Great progress on the scan planning implementation, file format api, v4
>> adaptive metadata tree
>> - cpp has a new website, https://cpp.iceberg.apache.org/
>>
>> Feel free to add as you see fit.
>>
>> Best,
>> Kevin Liu
>>
>> On Wed, Dec 10, 2025 at 2:57 PM Ryan Blue <rd...@gmail.com> wrote:
>>
>>> Hi everyone,
>>>
>>> Here’s the board report for December. If you have anything to add,
>>> please reply. And congrats to our new committers and PMC members!
>>> Description:
>>>
>>> Apache Iceberg is a table format for huge analytic datasets that is
>>> designed
>>> for high performance and ease of use.
>>> Project Status:
>>>
>>> Current project status: Ongoing
>>> Issues for the board: None
>>> Membership Data:
>>>
>>> Apache Iceberg was founded 2020-05-19 (6 years ago)
>>> There are currently 36 committers and 23 PMC members in this project.
>>> The Committer-to-PMC ratio is roughly 3:2.
>>>
>>> Community changes, past quarter:
>>>
>>> - Kevin Liu was added to the PMC on 2025-11-16
>>> - Matthew Topol was added to the PMC on 2025-11-23
>>> - Gang Wu was added as committer on 2025-10-15
>>>
>>> Project Activity:
>>>
>>> Releases:
>>>
>>> - Go 0.4.0 was released on 2025-10-13.
>>> - Rust 0.7.0 was released on 2025-10-11.
>>>
>>> Project:
>>>
>>> - Separated CI emails to a new ci-jobs ML
>>> - Removed blogs/ and talks/ pages from the site
>>> - Added ASF-approved web analytics
>>> - Added markdown and yaml lint checks
>>>
>>> REST catalog spec:
>>>
>>> - Added min-rows-requested to server-side planning
>>> - Added storage credentials to server-side planning
>>> - Added idempotency tokens to the spec
>>> - Discussing adding etags to responses
>>>
>>> UDF spec is nearing completion, added null handling and has settled on
>>> structure
>>>
>>> Java:
>>>
>>> - File format API reviews are ongoing; close to completion
>>> - Merged encryption integration and tests for Hive catalog
>>> - Flink: Added write support for v3 DVs
>>> - Added support for custom internal types with Parquet files
>>> - Added BigQuery catalog support to to runtime Jars
>>>
>>> PyIceberg:
>>>
>>> - Removed Python 3.9 support
>>> - Added support for v3 row lineage
>>> - Added expression serialization
>>> - Improvements to CI and build
>>>
>>> Rust:
>>>
>>> - Added support for v3 metadata
>>> - Added update_table for MemoryCatalog and GlueCatalog
>>> - Introduced catalog loader for multiple catalogs.
>>> - Added PartitionSplitter, RollingFileWriter, and partition-aware
>>> locations.
>>> - DataFusion: Added write and commit execution plans enabling INSERT
>>> INTO.
>>> - Added support for loading equality deletes during scans.
>>> - DataFusion v48 support.
>>>
>>> Go:
>>>
>>> - Improvements to unit tests and docker images for testing
>>> configurations
>>> - Fixing a crash when writing a map column with multiple entries per
>>> row
>>> - Several improvements to the release scripts
>>> - Support for writing to a Partitioned Iceberg tables!
>>> - Initial support for v3 metadata
>>> - Implemented the views spec
>>> - Added schema evolution support and timestamp(9)
>>>
>>> C++:
>>>
>>> - Can write Avro metadata files
>>> - Added REST request/response models
>>> - Implemented TableMetadataBuilder
>>> - Added scaffolding for expressions
>>> - Added binary literal serialization
>>>
>>> Community Health:
>>>
>>> We are happy to welcome Gang as a new committer and Matt Topol and Kevin
>>> Liu as
>>> new PMC members!
>>>
>>> The Iceberg PMC has encouraged community-driven meetups by providing
>>> guidelines
>>> for meetup organizers. This has been very successful and there have been
>>> meetups
>>> in many different locations: Amsterdam, Bangalore, Paris, Warsaw,
>>> Budapest,
>>> Pittsburgh, Hamburg, Goteborg, Munich, Atlanta, Seattle, London, North
>>> Carolina,
>>> and Menlo Park. The community has also worked to improve these
>>> guidelines and
>>> ensure that they are small events that do not conflict with ASF events,
>>> since
>>> there was an event almost too large near Community over Code.
>>>
>>
Re: [DISCUSS] December board report
Posted by Fokko Driesprong <fo...@apache.org>.
Thanks Ryan,
The report looks good. Two potential things to add:
- The creation of the new Terraform repository
- We're gearing up for the Iceberg Rust 0.8 release
Kind regards,
Fokko
Op do 11 dec 2025 om 20:38 schreef Kevin Liu <ke...@apache.org>:
> Thanks Ryan, this looks great. Thanks for including the paragraph about
> meetups in the community health section.
>
> A few things that might be good to include (in no particular order):
> - Iceberg Summit 2026
> - Great progress on the scan planning implementation, file format api, v4
> adaptive metadata tree
> - cpp has a new website, https://cpp.iceberg.apache.org/
>
> Feel free to add as you see fit.
>
> Best,
> Kevin Liu
>
> On Wed, Dec 10, 2025 at 2:57 PM Ryan Blue <rd...@gmail.com> wrote:
>
>> Hi everyone,
>>
>> Here’s the board report for December. If you have anything to add, please
>> reply. And congrats to our new committers and PMC members!
>> Description:
>>
>> Apache Iceberg is a table format for huge analytic datasets that is
>> designed
>> for high performance and ease of use.
>> Project Status:
>>
>> Current project status: Ongoing
>> Issues for the board: None
>> Membership Data:
>>
>> Apache Iceberg was founded 2020-05-19 (6 years ago)
>> There are currently 36 committers and 23 PMC members in this project.
>> The Committer-to-PMC ratio is roughly 3:2.
>>
>> Community changes, past quarter:
>>
>> - Kevin Liu was added to the PMC on 2025-11-16
>> - Matthew Topol was added to the PMC on 2025-11-23
>> - Gang Wu was added as committer on 2025-10-15
>>
>> Project Activity:
>>
>> Releases:
>>
>> - Go 0.4.0 was released on 2025-10-13.
>> - Rust 0.7.0 was released on 2025-10-11.
>>
>> Project:
>>
>> - Separated CI emails to a new ci-jobs ML
>> - Removed blogs/ and talks/ pages from the site
>> - Added ASF-approved web analytics
>> - Added markdown and yaml lint checks
>>
>> REST catalog spec:
>>
>> - Added min-rows-requested to server-side planning
>> - Added storage credentials to server-side planning
>> - Added idempotency tokens to the spec
>> - Discussing adding etags to responses
>>
>> UDF spec is nearing completion, added null handling and has settled on
>> structure
>>
>> Java:
>>
>> - File format API reviews are ongoing; close to completion
>> - Merged encryption integration and tests for Hive catalog
>> - Flink: Added write support for v3 DVs
>> - Added support for custom internal types with Parquet files
>> - Added BigQuery catalog support to to runtime Jars
>>
>> PyIceberg:
>>
>> - Removed Python 3.9 support
>> - Added support for v3 row lineage
>> - Added expression serialization
>> - Improvements to CI and build
>>
>> Rust:
>>
>> - Added support for v3 metadata
>> - Added update_table for MemoryCatalog and GlueCatalog
>> - Introduced catalog loader for multiple catalogs.
>> - Added PartitionSplitter, RollingFileWriter, and partition-aware
>> locations.
>> - DataFusion: Added write and commit execution plans enabling INSERT
>> INTO.
>> - Added support for loading equality deletes during scans.
>> - DataFusion v48 support.
>>
>> Go:
>>
>> - Improvements to unit tests and docker images for testing
>> configurations
>> - Fixing a crash when writing a map column with multiple entries per
>> row
>> - Several improvements to the release scripts
>> - Support for writing to a Partitioned Iceberg tables!
>> - Initial support for v3 metadata
>> - Implemented the views spec
>> - Added schema evolution support and timestamp(9)
>>
>> C++:
>>
>> - Can write Avro metadata files
>> - Added REST request/response models
>> - Implemented TableMetadataBuilder
>> - Added scaffolding for expressions
>> - Added binary literal serialization
>>
>> Community Health:
>>
>> We are happy to welcome Gang as a new committer and Matt Topol and Kevin
>> Liu as
>> new PMC members!
>>
>> The Iceberg PMC has encouraged community-driven meetups by providing
>> guidelines
>> for meetup organizers. This has been very successful and there have been
>> meetups
>> in many different locations: Amsterdam, Bangalore, Paris, Warsaw,
>> Budapest,
>> Pittsburgh, Hamburg, Goteborg, Munich, Atlanta, Seattle, London, North
>> Carolina,
>> and Menlo Park. The community has also worked to improve these guidelines
>> and
>> ensure that they are small events that do not conflict with ASF events,
>> since
>> there was an event almost too large near Community over Code.
>>
>
Re: [DISCUSS] December board report
Posted by Kevin Liu <ke...@apache.org>.
Thanks Ryan, this looks great. Thanks for including the paragraph about
meetups in the community health section.
A few things that might be good to include (in no particular order):
- Iceberg Summit 2026
- Great progress on the scan planning implementation, file format api, v4
adaptive metadata tree
- cpp has a new website, https://cpp.iceberg.apache.org/
Feel free to add as you see fit.
Best,
Kevin Liu
On Wed, Dec 10, 2025 at 2:57 PM Ryan Blue <rd...@gmail.com> wrote:
> Hi everyone,
>
> Here’s the board report for December. If you have anything to add, please
> reply. And congrats to our new committers and PMC members!
> Description:
>
> Apache Iceberg is a table format for huge analytic datasets that is
> designed
> for high performance and ease of use.
> Project Status:
>
> Current project status: Ongoing
> Issues for the board: None
> Membership Data:
>
> Apache Iceberg was founded 2020-05-19 (6 years ago)
> There are currently 36 committers and 23 PMC members in this project.
> The Committer-to-PMC ratio is roughly 3:2.
>
> Community changes, past quarter:
>
> - Kevin Liu was added to the PMC on 2025-11-16
> - Matthew Topol was added to the PMC on 2025-11-23
> - Gang Wu was added as committer on 2025-10-15
>
> Project Activity:
>
> Releases:
>
> - Go 0.4.0 was released on 2025-10-13.
> - Rust 0.7.0 was released on 2025-10-11.
>
> Project:
>
> - Separated CI emails to a new ci-jobs ML
> - Removed blogs/ and talks/ pages from the site
> - Added ASF-approved web analytics
> - Added markdown and yaml lint checks
>
> REST catalog spec:
>
> - Added min-rows-requested to server-side planning
> - Added storage credentials to server-side planning
> - Added idempotency tokens to the spec
> - Discussing adding etags to responses
>
> UDF spec is nearing completion, added null handling and has settled on
> structure
>
> Java:
>
> - File format API reviews are ongoing; close to completion
> - Merged encryption integration and tests for Hive catalog
> - Flink: Added write support for v3 DVs
> - Added support for custom internal types with Parquet files
> - Added BigQuery catalog support to to runtime Jars
>
> PyIceberg:
>
> - Removed Python 3.9 support
> - Added support for v3 row lineage
> - Added expression serialization
> - Improvements to CI and build
>
> Rust:
>
> - Added support for v3 metadata
> - Added update_table for MemoryCatalog and GlueCatalog
> - Introduced catalog loader for multiple catalogs.
> - Added PartitionSplitter, RollingFileWriter, and partition-aware
> locations.
> - DataFusion: Added write and commit execution plans enabling INSERT
> INTO.
> - Added support for loading equality deletes during scans.
> - DataFusion v48 support.
>
> Go:
>
> - Improvements to unit tests and docker images for testing
> configurations
> - Fixing a crash when writing a map column with multiple entries per
> row
> - Several improvements to the release scripts
> - Support for writing to a Partitioned Iceberg tables!
> - Initial support for v3 metadata
> - Implemented the views spec
> - Added schema evolution support and timestamp(9)
>
> C++:
>
> - Can write Avro metadata files
> - Added REST request/response models
> - Implemented TableMetadataBuilder
> - Added scaffolding for expressions
> - Added binary literal serialization
>
> Community Health:
>
> We are happy to welcome Gang as a new committer and Matt Topol and Kevin
> Liu as
> new PMC members!
>
> The Iceberg PMC has encouraged community-driven meetups by providing
> guidelines
> for meetup organizers. This has been very successful and there have been
> meetups
> in many different locations: Amsterdam, Bangalore, Paris, Warsaw, Budapest,
> Pittsburgh, Hamburg, Goteborg, Munich, Atlanta, Seattle, London, North
> Carolina,
> and Menlo Park. The community has also worked to improve these guidelines
> and
> ensure that they are small events that do not conflict with ASF events,
> since
> there was an event almost too large near Community over Code.
>