Meeting Minutes from 2022-11-09 Iceberg Sync

[Eduard Tudenhoefner <ed...@tabular.io>]

Hi Iceberg Community,

Here are the minutes and recording from our Iceberg Sync that took
place on *November
9th*.

Always remember, anyone can join the discussion so feel free to share the
Iceberg-Sync <https://groups.google.com/g/iceberg-sync> google group with
anyone seeking an invite.
The notes and the agenda are posted in the Iceberg Sync doc
<https://docs.google.com/document/d/1YuGhUdukLP5gGiqCbk0A5_Wifqe2CZWgOd3TbhY3UQg/edit?usp=drive_web>
that's
also attached to the meeting invitation and it's an excellent place to add
items as you see fit so we can discuss them in the following community sync.

Meeting Recording
<https://drive.google.com/file/d/1KhTR4nc6Q1ZC4BSC3cCvdzjzCutBjfaK/view?usp=sharing>
⭕

   -

   *Highlights*
   -

      Python: Added manifest evaluator and column selection (Thanks, Fokko!)
      -

      Python: Added SSL support to REST client (Thanks, Dhruv!)
      -

      Spark: Aggregate expressions were added (Thanks, Huaxin!)
      -

      Flink: 1.16 support was added, 1.13 removed (Thanks, Hililiwei!)
      -

      Core: Added changelog table and new scan class (Thanks, Anton!)
      -

      Core: Added support for append/delete to branches (Thanks, Amogh!)
      -

      Core: Improved snapshot expiration (Thanks Szehon and Amogh!)
      -

      Format: Added file sequence number (Thanks, Anton!)
      -

   *Releases*
   -

      Iceberg 1.1.0 release
      -

         https://github.com/apache/iceberg/issues/6162
         -

   *Bugs/Issues* <https://github.com/apache/iceberg/issues> (anything
   noteworthy that should be addressed/looked at?)
   -

      https://github.com/apache/iceberg/pull/5860
      -

      Release version issue if we create a release tag from side branch
      instead of master.
      -

         https://github.com/apache/iceberg/pull/6102
         -

      Statistics file spec change (computed snapshot id to used snapshot
      id)? Do we need to integrate it to spark engine to have clear idea?
      -

         https://github.com/apache/iceberg/pull/6090
         -

      Add delete file information to partitions table?
      -

         https://github.com/apache/iceberg/issues/6042
         -

      Bulk table migration. Can I introduce a flag in catalog to block
      commits when it is enabled?
      -

         https://github.com/apache/iceberg/pull/5492
         -

   *Discussion*
   -

      Good to see Iceberg View implementation is making progress. Any
      tentative timeline for the view release?
      -

   *Other topics*
   -

      Changelog scan updates?
      -

         Support for changelog table in v1 is in
         -

         V2 tables are not supported yet – can’t plan yet but API exists
         -

      Branch writes/reads
      -

         https://github.com/apache/iceberg/pull/5150
         -

      How often do we expect next 1.x releases to go out? -> GOAL: every
      4-6 weeks


Thanks everyone!