You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@iceberg.apache.org by Carl Steinbach <cw...@apache.org> on 2021/08/02 22:07:54 UTC
Re: Iceberg 0.12.0 Release Plan
I want to provide everyone with a quick update on the 0.12.0 release
process. At this point, #2906 Fix Partition field IDs in table replacement
<https://github.com/apache/iceberg/pull/2906> is the only remaining
blocker. Ryan is working on a fix and predicts that we'll be ready to cut
the first release candidate by the end of this week.
- Carl
On Mon, Jul 19, 2021 at 2:58 PM Szehon Ho <sz...@gmail.com> wrote:
> Hi Carl,
>
> For the Issue: https://github.com/apache/iceberg/issues/2783
>
> The status is: I gave a bit of a try but couldn’t find an easy fix, so
> hoping someone more knowledgable about this code has cycle to take a look
> at it.
>
> It would be great to fix it for 0.12 as it seems to block more metadata
> queries than before, but for timing purpose I’m not sure if its feasible.
>
> Thanks
> Szehon
>
> On Mon, Jul 19, 2021 at 2:19 PM Carl Steinbach <cw...@apache.org> wrote:
>
>> Hi Everyone,
>>
>> Currently, there are three issues blocking the release of 0.12.0:
>>
>>
>> 1. #2308 Handle the case that RewriteFiles and RowDelta commit the
>> transaction at the same time
>> <https://github.com/apache/iceberg/issues/2308>
>> 2. #2783 Metadata Table Empty Projection - Unknown type for int
>> field. Type name: java.lang.string
>> <https://github.com/apache/iceberg/issues/2783>
>> 3. #2284 Core: reassign the partition field IDs and reuse any
>> existing ID <https://github.com/apache/iceberg/pull/2284>s
>>
>> #2284 is in review.
>>
>> Ryan said he would take a look at #2308.
>>
>> @Szehon Ho <sz...@cloudera.com>, can you please confirm whether or not
>> you're working on #2783?
>>
>> Thanks.
>>
>> - Carl
>>
>>
>>
>> On Mon, Jul 19, 2021 at 12:31 PM Jack Ye <ye...@gmail.com> wrote:
>>
>>> I haven't heard any news for the 0.12.0 release since then, are we still
>>> planning for the release?
>>>
>>> Please let me know if there is anything we can do to help speed up the
>>> process. (I just saw the release board, will try to at least review those
>>> PRs)
>>>
>>> Best,
>>> Jack Ye
>>>
>>> On Mon, Jul 12, 2021 at 5:41 PM Sreeram Garlapati <
>>> gsreeramkumar@gmail.com> wrote:
>>>
>>>> Great, thanks Ryan.
>>>>
>>>> On Mon, Jul 12, 2021 at 5:17 PM Ryan Blue <bl...@tabular.io> wrote:
>>>>
>>>>> Sreeram, I was just waiting for tests to pass on that PR. I just
>>>>> merged it.
>>>>>
>>>>> On Mon, Jul 12, 2021 at 4:41 PM Sreeram Garlapati <
>>>>> gsreeramkumar@gmail.com> wrote:
>>>>>
>>>>>> Hi Carl,
>>>>>>
>>>>>> Thanks a lot for managing 0.12.0 release.
>>>>>>
>>>>>> Can you also pl. add this PR:
>>>>>> https://github.com/apache/iceberg/pull/2752 - which adds the option "
>>>>>> streaming-skip-delete-snapshots" - to Spark3 micro_batch reader.
>>>>>> Without this, streaming reads will fail if a snapshot of type delete or
>>>>>> replace is encountered, & is pretty much unusable. This PR is already
>>>>>> approved by multiple Committers - Ryan and Russell.
>>>>>>
>>>>>> PS: I am unsure if new PRs will be merged apart from the list
>>>>>> proposed on the project board - into the *0.12.0* release, and
>>>>>> hence, proposing this. If this PR will be merged - no action is needed. pl.
>>>>>> pardon my ignorance.
>>>>>>
>>>>>> Best regards,
>>>>>> Sreeram
>>>>>>
>>>>>> On Mon, Jul 12, 2021 at 4:14 PM Carl Steinbach <cw...@tabular.io>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi Grant,
>>>>>>>
>>>>>>> Good catch! I added PR-1648
>>>>>>> <https://github.com/apache/iceberg/pull/1648> to the 0.12.0 project
>>>>>>> board.
>>>>>>>
>>>>>>> - Carl
>>>>>>>
>>>>>>> On Mon, Jul 12, 2021 at 1:16 PM Grant Nicholas <gr...@spothero.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Howdy! Any updates on PR-1648
>>>>>>>> <https://github.com/apache/iceberg/pull/1648> which upgrades the
>>>>>>>> avro version used in iceberg? I do not see it in the "To-Do" section linked
>>>>>>>> above, but the older avro version has caused major problems described in
>>>>>>>> this issue and it would be nice to get in 0.12.0.
>>>>>>>> https://github.com/apache/iceberg/issues/1654
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Mon, Jul 12, 2021 at 2:39 PM Carl Steinbach <cw...@apache.org>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi Everyone,
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> I volunteered to be the release manager for the 0.12.0 release. My
>>>>>>>>> goal is to start cutting release candidates this Friday, 7/17 at 24:00 PST.
>>>>>>>>> I am tracking progress on this release on the Release 0.12.0
>>>>>>>>> Project Board <https://github.com/apache/iceberg/projects/1>.
>>>>>>>>> Note that this board only tracks issues that BLOCK the release.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> There are currently 7 PRs listed in the To-Do
>>>>>>>>> <https://github.com/apache/iceberg/projects/1#column-14786627>
>>>>>>>>> column. I am going to remove these PRs from the 0.12.0 release tomorrow,
>>>>>>>>> 7/13 at 24:00 PST, unless they are updated with the following information:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> 1) Why does the PR need to be included in the 0.12.0 release?
>>>>>>>>>
>>>>>>>>> 2) When will the PR will be ready for review?
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> If you have any questions or concerns, please get in touch with me
>>>>>>>>> over email or slack.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Thanks.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> - Carl
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>>
>>>>>>>> [image: SpotHero] <http://spothero.com/>
>>>>>>>>
>>>>>>>> Grant Nicholas / Senior Data Engineer II
>>>>>>>> Pronouns <https://lgbt.ucsf.edu/pronounsmatter>: he/his
>>>>>>>> grant@spothero.com
>>>>>>>> spothero.com <http://www.spothero.com/> | LinkedIn
>>>>>>>> <https://www.linkedin.com/in/grantanicholas>
>>>>>>>> *Your perfect spot is waiting for you! Learn more
>>>>>>>> at spothero.com/careers <http://spothero.com/careers>*
>>>>>>>>
>>>>>>>
>>>>>
>>>>> --
>>>>> Ryan Blue
>>>>> Tabular
>>>>>
>>>>
Re: Iceberg 0.12.0 Release Plan
Posted by Carl Steinbach <cw...@gmail.com>.
Hi Dan,
By the time I saw your email I had already gotten approval from Jack and
committed the patch. I created a new PR to track any additional changes we
want to make before announcing the release:
https://github.com/apache/iceberg/pull/2986
Thanks.
- Carl
On Mon, Aug 16, 2021 at 8:56 PM Daniel Weeks <dw...@apache.org> wrote:
> I think there might be a couple more bug fixes that we want to call out.
> I'm still reviewing, but will try to add any additions tomorrow.
>
> Thanks,
> Dan
>
>
>
> On Mon, Aug 16, 2021, 8:23 PM Carl Steinbach <cw...@apache.org> wrote:
>
>> Update: still waiting for a +1 on the release notes
>> https://github.com/apache/iceberg/pull/2973
>>
>> - Carl
>>
>> On Sat, Aug 14, 2021 at 6:25 PM Carl Steinbach <cw...@apache.org> wrote:
>>
>>> The 0.12.0 release has been approved, but before we can announce it we
>>> need to add the release notes.
>>>
>>> Please help us get over this hurdle by reviewing the release notes draft
>>> here: https://github.com/apache/iceberg/pull/2973
>>>
>>> Thanks!
>>>
>>> - Carl
>>>
>>> On Tue, Aug 3, 2021 at 4:46 PM Carl Steinbach <cw...@tabular.io> wrote:
>>>
>>>> Thanks, Jack and Ryan, for closing out these issues. Since there are no
>>>> more blockers, I will start preparing a release candidate.
>>>>
>>>> - Carl
>>>>
>>>> On Tue, Aug 3, 2021 at 3:29 PM Ryan Blue <bl...@tabular.io> wrote:
>>>>
>>>>> I just merged the PR. Thanks for making it possible to create v2
>>>>> tables easily, Jack!
>>>>>
>>>>> On Tue, Aug 3, 2021 at 1:02 PM Jack Ye <ye...@gmail.com> wrote:
>>>>>
>>>>>> Thanks! The PR is mostly ready and just got approved by Anton. As
>>>>>> soon as it is merged we can start the branch cut.
>>>>>> -Jack
>>>>>>
>>>>>> On Mon, Aug 2, 2021 at 11:39 PM Carl Steinbach <cw...@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi Jack,
>>>>>>>
>>>>>>> I added #2887 to the 0.12.0 release project board
>>>>>>> <https://github.com/apache/iceberg/projects/1>. When do you think
>>>>>>> this patch will be committed?
>>>>>>>
>>>>>>> - Carl
>>>>>>>
>>>>>>> On Mon, Aug 2, 2021 at 4:28 PM Ryan Blue <bl...@tabular.io> wrote:
>>>>>>>
>>>>>>>> Jack, I've been reviewing that one so that we can get it in. Thanks
>>>>>>>> for fixing it!
>>>>>>>>
>>>>>>>> On Mon, Aug 2, 2021 at 3:12 PM Jack Ye <ye...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Thanks for the update Carl!
>>>>>>>>>
>>>>>>>>> Given that we have voted for the adoption of format v2, can we
>>>>>>>>> also get this change in, so that people can start to use v2 tables?
>>>>>>>>> https://github.com/apache/iceberg/pull/2887
>>>>>>>>>
>>>>>>>>> -Jack
>>>>>>>>>
>>>>>>>>> On Mon, Aug 2, 2021 at 3:08 PM Carl Steinbach <cw...@apache.org>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> I want to provide everyone with a quick update on the 0.12.0
>>>>>>>>>> release process. At this point, #2906 Fix Partition field IDs in
>>>>>>>>>> table replacement <https://github.com/apache/iceberg/pull/2906>
>>>>>>>>>> is the only remaining blocker. Ryan is working on a fix and predicts that
>>>>>>>>>> we'll be ready to cut the first release candidate by the end of this week.
>>>>>>>>>>
>>>>>>>>>> - Carl
>>>>>>>>>>
>>>>>>>>>> On Mon, Jul 19, 2021 at 2:58 PM Szehon Ho <
>>>>>>>>>> szehon.apache@gmail.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi Carl,
>>>>>>>>>>>
>>>>>>>>>>> For the Issue: https://github.com/apache/iceberg/issues/2783
>>>>>>>>>>>
>>>>>>>>>>> The status is: I gave a bit of a try but couldn’t find an easy
>>>>>>>>>>> fix, so hoping someone more knowledgable about this code has cycle to take
>>>>>>>>>>> a look at it.
>>>>>>>>>>>
>>>>>>>>>>> It would be great to fix it for 0.12 as it seems to block more
>>>>>>>>>>> metadata queries than before, but for timing purpose I’m not sure if its
>>>>>>>>>>> feasible.
>>>>>>>>>>>
>>>>>>>>>>> Thanks
>>>>>>>>>>> Szehon
>>>>>>>>>>>
>>>>>>>>>>> On Mon, Jul 19, 2021 at 2:19 PM Carl Steinbach <cw...@apache.org>
>>>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Hi Everyone,
>>>>>>>>>>>>
>>>>>>>>>>>> Currently, there are three issues blocking the release of
>>>>>>>>>>>> 0.12.0:
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> 1. #2308 Handle the case that RewriteFiles and RowDelta
>>>>>>>>>>>> commit the transaction at the same time
>>>>>>>>>>>> <https://github.com/apache/iceberg/issues/2308>
>>>>>>>>>>>> 2. #2783 Metadata Table Empty Projection - Unknown type for
>>>>>>>>>>>> int field. Type name: java.lang.string
>>>>>>>>>>>> <https://github.com/apache/iceberg/issues/2783>
>>>>>>>>>>>> 3. #2284 Core: reassign the partition field IDs and reuse
>>>>>>>>>>>> any existing ID
>>>>>>>>>>>> <https://github.com/apache/iceberg/pull/2284>s
>>>>>>>>>>>>
>>>>>>>>>>>> #2284 is in review.
>>>>>>>>>>>>
>>>>>>>>>>>> Ryan said he would take a look at #2308.
>>>>>>>>>>>>
>>>>>>>>>>>> @Szehon Ho <sz...@cloudera.com>, can you
>>>>>>>>>>>> please confirm whether or not you're working on #2783?
>>>>>>>>>>>>
>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>
>>>>>>>>>>>> - Carl
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> On Mon, Jul 19, 2021 at 12:31 PM Jack Ye <ye...@gmail.com>
>>>>>>>>>>>> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> I haven't heard any news for the 0.12.0 release since then,
>>>>>>>>>>>>> are we still planning for the release?
>>>>>>>>>>>>>
>>>>>>>>>>>>> Please let me know if there is anything we can do to help
>>>>>>>>>>>>> speed up the process. (I just saw the release board, will try to at least
>>>>>>>>>>>>> review those PRs)
>>>>>>>>>>>>>
>>>>>>>>>>>>> Best,
>>>>>>>>>>>>> Jack Ye
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 5:41 PM Sreeram Garlapati <
>>>>>>>>>>>>> gsreeramkumar@gmail.com> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Great, thanks Ryan.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 5:17 PM Ryan Blue <bl...@tabular.io>
>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Sreeram, I was just waiting for tests to pass on that PR. I
>>>>>>>>>>>>>>> just merged it.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 4:41 PM Sreeram Garlapati <
>>>>>>>>>>>>>>> gsreeramkumar@gmail.com> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Hi Carl,
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Thanks a lot for managing 0.12.0 release.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Can you also pl. add this PR:
>>>>>>>>>>>>>>>> https://github.com/apache/iceberg/pull/2752 - which adds
>>>>>>>>>>>>>>>> the option "streaming-skip-delete-snapshots" - to Spark3
>>>>>>>>>>>>>>>> micro_batch reader. Without this, streaming reads will fail if a snapshot
>>>>>>>>>>>>>>>> of type delete or replace is encountered, & is pretty much unusable. This
>>>>>>>>>>>>>>>> PR is already approved by multiple Committers - Ryan and Russell.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> PS: I am unsure if new PRs will be merged apart from the
>>>>>>>>>>>>>>>> list proposed on the project board - into the *0.12.0* release,
>>>>>>>>>>>>>>>> and hence, proposing this. If this PR will be merged - no action is needed.
>>>>>>>>>>>>>>>> pl. pardon my ignorance.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Best regards,
>>>>>>>>>>>>>>>> Sreeram
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 4:14 PM Carl Steinbach <
>>>>>>>>>>>>>>>> cws@tabular.io> wrote:
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Hi Grant,
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Good catch! I added PR-1648
>>>>>>>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> to the
>>>>>>>>>>>>>>>>> 0.12.0 project board.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> - Carl
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 1:16 PM Grant Nicholas <
>>>>>>>>>>>>>>>>> grant@spothero.com> wrote:
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> Howdy! Any updates on PR-1648
>>>>>>>>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> which
>>>>>>>>>>>>>>>>>> upgrades the avro version used in iceberg? I do not see it in the "To-Do"
>>>>>>>>>>>>>>>>>> section linked above, but the older avro version has caused major problems
>>>>>>>>>>>>>>>>>> described in this issue and it would be nice to get in 0.12.0.
>>>>>>>>>>>>>>>>>> https://github.com/apache/iceberg/issues/1654
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 2:39 PM Carl Steinbach <
>>>>>>>>>>>>>>>>>> cws@apache.org> wrote:
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> Hi Everyone,
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> I volunteered to be the release manager for the 0.12.0
>>>>>>>>>>>>>>>>>>> release. My goal is to start cutting release candidates this Friday, 7/17
>>>>>>>>>>>>>>>>>>> at 24:00 PST. I am tracking progress on this release on the Release
>>>>>>>>>>>>>>>>>>> 0.12.0 Project Board
>>>>>>>>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1>. Note
>>>>>>>>>>>>>>>>>>> that this board only tracks issues that BLOCK the release.
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> There are currently 7 PRs listed in the To-Do
>>>>>>>>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1#column-14786627>
>>>>>>>>>>>>>>>>>>> column. I am going to remove these PRs from the 0.12.0 release tomorrow,
>>>>>>>>>>>>>>>>>>> 7/13 at 24:00 PST, unless they are updated with the following information:
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> 1) Why does the PR need to be included in the 0.12.0
>>>>>>>>>>>>>>>>>>> release?
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> 2) When will the PR will be ready for review?
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> If you have any questions or concerns, please get in
>>>>>>>>>>>>>>>>>>> touch with me over email or slack.
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> - Carl
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> [image: SpotHero] <http://spothero.com/>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> Grant Nicholas / Senior Data Engineer II
>>>>>>>>>>>>>>>>>> Pronouns <https://lgbt.ucsf.edu/pronounsmatter>: he/his
>>>>>>>>>>>>>>>>>> grant@spothero.com
>>>>>>>>>>>>>>>>>> spothero.com <http://www.spothero.com/> | LinkedIn
>>>>>>>>>>>>>>>>>> <https://www.linkedin.com/in/grantanicholas>
>>>>>>>>>>>>>>>>>> *Your perfect spot is waiting for you! Learn more
>>>>>>>>>>>>>>>>>> at spothero.com/careers <http://spothero.com/careers>*
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>> Ryan Blue
>>>>>>>>>>>>>>> Tabular
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Ryan Blue
>>>>>>>> Tabular
>>>>>>>>
>>>>>>>
>>>>>
>>>>> --
>>>>> Ryan Blue
>>>>> Tabular
>>>>>
>>>>
Re: Iceberg 0.12.0 Release Plan
Posted by Daniel Weeks <dw...@apache.org>.
I think there might be a couple more bug fixes that we want to call out.
I'm still reviewing, but will try to add any additions tomorrow.
Thanks,
Dan
On Mon, Aug 16, 2021, 8:23 PM Carl Steinbach <cw...@apache.org> wrote:
> Update: still waiting for a +1 on the release notes
> https://github.com/apache/iceberg/pull/2973
>
> - Carl
>
> On Sat, Aug 14, 2021 at 6:25 PM Carl Steinbach <cw...@apache.org> wrote:
>
>> The 0.12.0 release has been approved, but before we can announce it we
>> need to add the release notes.
>>
>> Please help us get over this hurdle by reviewing the release notes draft
>> here: https://github.com/apache/iceberg/pull/2973
>>
>> Thanks!
>>
>> - Carl
>>
>> On Tue, Aug 3, 2021 at 4:46 PM Carl Steinbach <cw...@tabular.io> wrote:
>>
>>> Thanks, Jack and Ryan, for closing out these issues. Since there are no
>>> more blockers, I will start preparing a release candidate.
>>>
>>> - Carl
>>>
>>> On Tue, Aug 3, 2021 at 3:29 PM Ryan Blue <bl...@tabular.io> wrote:
>>>
>>>> I just merged the PR. Thanks for making it possible to create v2 tables
>>>> easily, Jack!
>>>>
>>>> On Tue, Aug 3, 2021 at 1:02 PM Jack Ye <ye...@gmail.com> wrote:
>>>>
>>>>> Thanks! The PR is mostly ready and just got approved by Anton. As soon
>>>>> as it is merged we can start the branch cut.
>>>>> -Jack
>>>>>
>>>>> On Mon, Aug 2, 2021 at 11:39 PM Carl Steinbach <cw...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Hi Jack,
>>>>>>
>>>>>> I added #2887 to the 0.12.0 release project board
>>>>>> <https://github.com/apache/iceberg/projects/1>. When do you think
>>>>>> this patch will be committed?
>>>>>>
>>>>>> - Carl
>>>>>>
>>>>>> On Mon, Aug 2, 2021 at 4:28 PM Ryan Blue <bl...@tabular.io> wrote:
>>>>>>
>>>>>>> Jack, I've been reviewing that one so that we can get it in. Thanks
>>>>>>> for fixing it!
>>>>>>>
>>>>>>> On Mon, Aug 2, 2021 at 3:12 PM Jack Ye <ye...@gmail.com> wrote:
>>>>>>>
>>>>>>>> Thanks for the update Carl!
>>>>>>>>
>>>>>>>> Given that we have voted for the adoption of format v2, can we also
>>>>>>>> get this change in, so that people can start to use v2 tables?
>>>>>>>> https://github.com/apache/iceberg/pull/2887
>>>>>>>>
>>>>>>>> -Jack
>>>>>>>>
>>>>>>>> On Mon, Aug 2, 2021 at 3:08 PM Carl Steinbach <cw...@apache.org>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> I want to provide everyone with a quick update on the 0.12.0
>>>>>>>>> release process. At this point, #2906 Fix Partition field IDs in
>>>>>>>>> table replacement <https://github.com/apache/iceberg/pull/2906>
>>>>>>>>> is the only remaining blocker. Ryan is working on a fix and predicts that
>>>>>>>>> we'll be ready to cut the first release candidate by the end of this week.
>>>>>>>>>
>>>>>>>>> - Carl
>>>>>>>>>
>>>>>>>>> On Mon, Jul 19, 2021 at 2:58 PM Szehon Ho <sz...@gmail.com>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Carl,
>>>>>>>>>>
>>>>>>>>>> For the Issue: https://github.com/apache/iceberg/issues/2783
>>>>>>>>>>
>>>>>>>>>> The status is: I gave a bit of a try but couldn’t find an easy
>>>>>>>>>> fix, so hoping someone more knowledgable about this code has cycle to take
>>>>>>>>>> a look at it.
>>>>>>>>>>
>>>>>>>>>> It would be great to fix it for 0.12 as it seems to block more
>>>>>>>>>> metadata queries than before, but for timing purpose I’m not sure if its
>>>>>>>>>> feasible.
>>>>>>>>>>
>>>>>>>>>> Thanks
>>>>>>>>>> Szehon
>>>>>>>>>>
>>>>>>>>>> On Mon, Jul 19, 2021 at 2:19 PM Carl Steinbach <cw...@apache.org>
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi Everyone,
>>>>>>>>>>>
>>>>>>>>>>> Currently, there are three issues blocking the release of 0.12.0:
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> 1. #2308 Handle the case that RewriteFiles and RowDelta
>>>>>>>>>>> commit the transaction at the same time
>>>>>>>>>>> <https://github.com/apache/iceberg/issues/2308>
>>>>>>>>>>> 2. #2783 Metadata Table Empty Projection - Unknown type for
>>>>>>>>>>> int field. Type name: java.lang.string
>>>>>>>>>>> <https://github.com/apache/iceberg/issues/2783>
>>>>>>>>>>> 3. #2284 Core: reassign the partition field IDs and reuse
>>>>>>>>>>> any existing ID <https://github.com/apache/iceberg/pull/2284>
>>>>>>>>>>> s
>>>>>>>>>>>
>>>>>>>>>>> #2284 is in review.
>>>>>>>>>>>
>>>>>>>>>>> Ryan said he would take a look at #2308.
>>>>>>>>>>>
>>>>>>>>>>> @Szehon Ho <sz...@cloudera.com>, can you
>>>>>>>>>>> please confirm whether or not you're working on #2783?
>>>>>>>>>>>
>>>>>>>>>>> Thanks.
>>>>>>>>>>>
>>>>>>>>>>> - Carl
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On Mon, Jul 19, 2021 at 12:31 PM Jack Ye <ye...@gmail.com>
>>>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> I haven't heard any news for the 0.12.0 release since then, are
>>>>>>>>>>>> we still planning for the release?
>>>>>>>>>>>>
>>>>>>>>>>>> Please let me know if there is anything we can do to help speed
>>>>>>>>>>>> up the process. (I just saw the release board, will try to at least review
>>>>>>>>>>>> those PRs)
>>>>>>>>>>>>
>>>>>>>>>>>> Best,
>>>>>>>>>>>> Jack Ye
>>>>>>>>>>>>
>>>>>>>>>>>> On Mon, Jul 12, 2021 at 5:41 PM Sreeram Garlapati <
>>>>>>>>>>>> gsreeramkumar@gmail.com> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Great, thanks Ryan.
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 5:17 PM Ryan Blue <bl...@tabular.io>
>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Sreeram, I was just waiting for tests to pass on that PR. I
>>>>>>>>>>>>>> just merged it.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 4:41 PM Sreeram Garlapati <
>>>>>>>>>>>>>> gsreeramkumar@gmail.com> wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Hi Carl,
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thanks a lot for managing 0.12.0 release.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Can you also pl. add this PR:
>>>>>>>>>>>>>>> https://github.com/apache/iceberg/pull/2752 - which adds
>>>>>>>>>>>>>>> the option "streaming-skip-delete-snapshots" - to Spark3
>>>>>>>>>>>>>>> micro_batch reader. Without this, streaming reads will fail if a snapshot
>>>>>>>>>>>>>>> of type delete or replace is encountered, & is pretty much unusable. This
>>>>>>>>>>>>>>> PR is already approved by multiple Committers - Ryan and Russell.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> PS: I am unsure if new PRs will be merged apart from the
>>>>>>>>>>>>>>> list proposed on the project board - into the *0.12.0* release,
>>>>>>>>>>>>>>> and hence, proposing this. If this PR will be merged - no action is needed.
>>>>>>>>>>>>>>> pl. pardon my ignorance.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Best regards,
>>>>>>>>>>>>>>> Sreeram
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 4:14 PM Carl Steinbach <
>>>>>>>>>>>>>>> cws@tabular.io> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Hi Grant,
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Good catch! I added PR-1648
>>>>>>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> to the
>>>>>>>>>>>>>>>> 0.12.0 project board.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> - Carl
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 1:16 PM Grant Nicholas <
>>>>>>>>>>>>>>>> grant@spothero.com> wrote:
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Howdy! Any updates on PR-1648
>>>>>>>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> which
>>>>>>>>>>>>>>>>> upgrades the avro version used in iceberg? I do not see it in the "To-Do"
>>>>>>>>>>>>>>>>> section linked above, but the older avro version has caused major problems
>>>>>>>>>>>>>>>>> described in this issue and it would be nice to get in 0.12.0.
>>>>>>>>>>>>>>>>> https://github.com/apache/iceberg/issues/1654
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 2:39 PM Carl Steinbach <
>>>>>>>>>>>>>>>>> cws@apache.org> wrote:
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> Hi Everyone,
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> I volunteered to be the release manager for the 0.12.0
>>>>>>>>>>>>>>>>>> release. My goal is to start cutting release candidates this Friday, 7/17
>>>>>>>>>>>>>>>>>> at 24:00 PST. I am tracking progress on this release on the Release
>>>>>>>>>>>>>>>>>> 0.12.0 Project Board
>>>>>>>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1>. Note
>>>>>>>>>>>>>>>>>> that this board only tracks issues that BLOCK the release.
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> There are currently 7 PRs listed in the To-Do
>>>>>>>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1#column-14786627>
>>>>>>>>>>>>>>>>>> column. I am going to remove these PRs from the 0.12.0 release tomorrow,
>>>>>>>>>>>>>>>>>> 7/13 at 24:00 PST, unless they are updated with the following information:
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> 1) Why does the PR need to be included in the 0.12.0
>>>>>>>>>>>>>>>>>> release?
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> 2) When will the PR will be ready for review?
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> If you have any questions or concerns, please get in
>>>>>>>>>>>>>>>>>> touch with me over email or slack.
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> - Carl
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> [image: SpotHero] <http://spothero.com/>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Grant Nicholas / Senior Data Engineer II
>>>>>>>>>>>>>>>>> Pronouns <https://lgbt.ucsf.edu/pronounsmatter>: he/his
>>>>>>>>>>>>>>>>> grant@spothero.com
>>>>>>>>>>>>>>>>> spothero.com <http://www.spothero.com/> | LinkedIn
>>>>>>>>>>>>>>>>> <https://www.linkedin.com/in/grantanicholas>
>>>>>>>>>>>>>>>>> *Your perfect spot is waiting for you! Learn more
>>>>>>>>>>>>>>>>> at spothero.com/careers <http://spothero.com/careers>*
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> --
>>>>>>>>>>>>>> Ryan Blue
>>>>>>>>>>>>>> Tabular
>>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Ryan Blue
>>>>>>> Tabular
>>>>>>>
>>>>>>
>>>>
>>>> --
>>>> Ryan Blue
>>>> Tabular
>>>>
>>>
Re: Iceberg 0.12.0 Release Plan
Posted by Carl Steinbach <cw...@apache.org>.
Update: still waiting for a +1 on the release notes
https://github.com/apache/iceberg/pull/2973
- Carl
On Sat, Aug 14, 2021 at 6:25 PM Carl Steinbach <cw...@apache.org> wrote:
> The 0.12.0 release has been approved, but before we can announce it we
> need to add the release notes.
>
> Please help us get over this hurdle by reviewing the release notes draft
> here: https://github.com/apache/iceberg/pull/2973
>
> Thanks!
>
> - Carl
>
> On Tue, Aug 3, 2021 at 4:46 PM Carl Steinbach <cw...@tabular.io> wrote:
>
>> Thanks, Jack and Ryan, for closing out these issues. Since there are no
>> more blockers, I will start preparing a release candidate.
>>
>> - Carl
>>
>> On Tue, Aug 3, 2021 at 3:29 PM Ryan Blue <bl...@tabular.io> wrote:
>>
>>> I just merged the PR. Thanks for making it possible to create v2 tables
>>> easily, Jack!
>>>
>>> On Tue, Aug 3, 2021 at 1:02 PM Jack Ye <ye...@gmail.com> wrote:
>>>
>>>> Thanks! The PR is mostly ready and just got approved by Anton. As soon
>>>> as it is merged we can start the branch cut.
>>>> -Jack
>>>>
>>>> On Mon, Aug 2, 2021 at 11:39 PM Carl Steinbach <cw...@gmail.com>
>>>> wrote:
>>>>
>>>>> Hi Jack,
>>>>>
>>>>> I added #2887 to the 0.12.0 release project board
>>>>> <https://github.com/apache/iceberg/projects/1>. When do you think
>>>>> this patch will be committed?
>>>>>
>>>>> - Carl
>>>>>
>>>>> On Mon, Aug 2, 2021 at 4:28 PM Ryan Blue <bl...@tabular.io> wrote:
>>>>>
>>>>>> Jack, I've been reviewing that one so that we can get it in. Thanks
>>>>>> for fixing it!
>>>>>>
>>>>>> On Mon, Aug 2, 2021 at 3:12 PM Jack Ye <ye...@gmail.com> wrote:
>>>>>>
>>>>>>> Thanks for the update Carl!
>>>>>>>
>>>>>>> Given that we have voted for the adoption of format v2, can we also
>>>>>>> get this change in, so that people can start to use v2 tables?
>>>>>>> https://github.com/apache/iceberg/pull/2887
>>>>>>>
>>>>>>> -Jack
>>>>>>>
>>>>>>> On Mon, Aug 2, 2021 at 3:08 PM Carl Steinbach <cw...@apache.org>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> I want to provide everyone with a quick update on the 0.12.0
>>>>>>>> release process. At this point, #2906 Fix Partition field IDs in
>>>>>>>> table replacement <https://github.com/apache/iceberg/pull/2906> is
>>>>>>>> the only remaining blocker. Ryan is working on a fix and predicts that
>>>>>>>> we'll be ready to cut the first release candidate by the end of this week.
>>>>>>>>
>>>>>>>> - Carl
>>>>>>>>
>>>>>>>> On Mon, Jul 19, 2021 at 2:58 PM Szehon Ho <sz...@gmail.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi Carl,
>>>>>>>>>
>>>>>>>>> For the Issue: https://github.com/apache/iceberg/issues/2783
>>>>>>>>>
>>>>>>>>> The status is: I gave a bit of a try but couldn’t find an easy
>>>>>>>>> fix, so hoping someone more knowledgable about this code has cycle to take
>>>>>>>>> a look at it.
>>>>>>>>>
>>>>>>>>> It would be great to fix it for 0.12 as it seems to block more
>>>>>>>>> metadata queries than before, but for timing purpose I’m not sure if its
>>>>>>>>> feasible.
>>>>>>>>>
>>>>>>>>> Thanks
>>>>>>>>> Szehon
>>>>>>>>>
>>>>>>>>> On Mon, Jul 19, 2021 at 2:19 PM Carl Steinbach <cw...@apache.org>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Everyone,
>>>>>>>>>>
>>>>>>>>>> Currently, there are three issues blocking the release of 0.12.0:
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> 1. #2308 Handle the case that RewriteFiles and RowDelta
>>>>>>>>>> commit the transaction at the same time
>>>>>>>>>> <https://github.com/apache/iceberg/issues/2308>
>>>>>>>>>> 2. #2783 Metadata Table Empty Projection - Unknown type for
>>>>>>>>>> int field. Type name: java.lang.string
>>>>>>>>>> <https://github.com/apache/iceberg/issues/2783>
>>>>>>>>>> 3. #2284 Core: reassign the partition field IDs and reuse any
>>>>>>>>>> existing ID <https://github.com/apache/iceberg/pull/2284>s
>>>>>>>>>>
>>>>>>>>>> #2284 is in review.
>>>>>>>>>>
>>>>>>>>>> Ryan said he would take a look at #2308.
>>>>>>>>>>
>>>>>>>>>> @Szehon Ho <sz...@cloudera.com>, can you please confirm whether
>>>>>>>>>> or not you're working on #2783?
>>>>>>>>>>
>>>>>>>>>> Thanks.
>>>>>>>>>>
>>>>>>>>>> - Carl
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On Mon, Jul 19, 2021 at 12:31 PM Jack Ye <ye...@gmail.com>
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> I haven't heard any news for the 0.12.0 release since then, are
>>>>>>>>>>> we still planning for the release?
>>>>>>>>>>>
>>>>>>>>>>> Please let me know if there is anything we can do to help speed
>>>>>>>>>>> up the process. (I just saw the release board, will try to at least review
>>>>>>>>>>> those PRs)
>>>>>>>>>>>
>>>>>>>>>>> Best,
>>>>>>>>>>> Jack Ye
>>>>>>>>>>>
>>>>>>>>>>> On Mon, Jul 12, 2021 at 5:41 PM Sreeram Garlapati <
>>>>>>>>>>> gsreeramkumar@gmail.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Great, thanks Ryan.
>>>>>>>>>>>>
>>>>>>>>>>>> On Mon, Jul 12, 2021 at 5:17 PM Ryan Blue <bl...@tabular.io>
>>>>>>>>>>>> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Sreeram, I was just waiting for tests to pass on that PR. I
>>>>>>>>>>>>> just merged it.
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 4:41 PM Sreeram Garlapati <
>>>>>>>>>>>>> gsreeramkumar@gmail.com> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Hi Carl,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Thanks a lot for managing 0.12.0 release.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Can you also pl. add this PR:
>>>>>>>>>>>>>> https://github.com/apache/iceberg/pull/2752 - which adds the
>>>>>>>>>>>>>> option "streaming-skip-delete-snapshots" - to Spark3
>>>>>>>>>>>>>> micro_batch reader. Without this, streaming reads will fail if a snapshot
>>>>>>>>>>>>>> of type delete or replace is encountered, & is pretty much unusable. This
>>>>>>>>>>>>>> PR is already approved by multiple Committers - Ryan and Russell.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> PS: I am unsure if new PRs will be merged apart from the list
>>>>>>>>>>>>>> proposed on the project board - into the *0.12.0* release,
>>>>>>>>>>>>>> and hence, proposing this. If this PR will be merged - no action is needed.
>>>>>>>>>>>>>> pl. pardon my ignorance.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Best regards,
>>>>>>>>>>>>>> Sreeram
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 4:14 PM Carl Steinbach <
>>>>>>>>>>>>>> cws@tabular.io> wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Hi Grant,
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Good catch! I added PR-1648
>>>>>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> to the 0.12.0
>>>>>>>>>>>>>>> project board.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> - Carl
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 1:16 PM Grant Nicholas <
>>>>>>>>>>>>>>> grant@spothero.com> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Howdy! Any updates on PR-1648
>>>>>>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> which
>>>>>>>>>>>>>>>> upgrades the avro version used in iceberg? I do not see it in the "To-Do"
>>>>>>>>>>>>>>>> section linked above, but the older avro version has caused major problems
>>>>>>>>>>>>>>>> described in this issue and it would be nice to get in 0.12.0.
>>>>>>>>>>>>>>>> https://github.com/apache/iceberg/issues/1654
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 2:39 PM Carl Steinbach <
>>>>>>>>>>>>>>>> cws@apache.org> wrote:
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Hi Everyone,
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> I volunteered to be the release manager for the 0.12.0
>>>>>>>>>>>>>>>>> release. My goal is to start cutting release candidates this Friday, 7/17
>>>>>>>>>>>>>>>>> at 24:00 PST. I am tracking progress on this release on the Release
>>>>>>>>>>>>>>>>> 0.12.0 Project Board
>>>>>>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1>. Note that
>>>>>>>>>>>>>>>>> this board only tracks issues that BLOCK the release.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> There are currently 7 PRs listed in the To-Do
>>>>>>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1#column-14786627>
>>>>>>>>>>>>>>>>> column. I am going to remove these PRs from the 0.12.0 release tomorrow,
>>>>>>>>>>>>>>>>> 7/13 at 24:00 PST, unless they are updated with the following information:
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> 1) Why does the PR need to be included in the 0.12.0
>>>>>>>>>>>>>>>>> release?
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> 2) When will the PR will be ready for review?
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> If you have any questions or concerns, please get in touch
>>>>>>>>>>>>>>>>> with me over email or slack.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> - Carl
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> [image: SpotHero] <http://spothero.com/>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Grant Nicholas / Senior Data Engineer II
>>>>>>>>>>>>>>>> Pronouns <https://lgbt.ucsf.edu/pronounsmatter>: he/his
>>>>>>>>>>>>>>>> grant@spothero.com
>>>>>>>>>>>>>>>> spothero.com <http://www.spothero.com/> | LinkedIn
>>>>>>>>>>>>>>>> <https://www.linkedin.com/in/grantanicholas>
>>>>>>>>>>>>>>>> *Your perfect spot is waiting for you! Learn more
>>>>>>>>>>>>>>>> at spothero.com/careers <http://spothero.com/careers>*
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>> Ryan Blue
>>>>>>>>>>>>> Tabular
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>
>>>>>> --
>>>>>> Ryan Blue
>>>>>> Tabular
>>>>>>
>>>>>
>>>
>>> --
>>> Ryan Blue
>>> Tabular
>>>
>>
Re: Iceberg 0.12.0 Release Plan
Posted by Carl Steinbach <cw...@apache.org>.
The 0.12.0 release has been approved, but before we can announce it we need
to add the release notes.
Please help us get over this hurdle by reviewing the release notes draft
here: https://github.com/apache/iceberg/pull/2973
Thanks!
- Carl
On Tue, Aug 3, 2021 at 4:46 PM Carl Steinbach <cw...@tabular.io> wrote:
> Thanks, Jack and Ryan, for closing out these issues. Since there are no
> more blockers, I will start preparing a release candidate.
>
> - Carl
>
> On Tue, Aug 3, 2021 at 3:29 PM Ryan Blue <bl...@tabular.io> wrote:
>
>> I just merged the PR. Thanks for making it possible to create v2 tables
>> easily, Jack!
>>
>> On Tue, Aug 3, 2021 at 1:02 PM Jack Ye <ye...@gmail.com> wrote:
>>
>>> Thanks! The PR is mostly ready and just got approved by Anton. As soon
>>> as it is merged we can start the branch cut.
>>> -Jack
>>>
>>> On Mon, Aug 2, 2021 at 11:39 PM Carl Steinbach <cw...@gmail.com>
>>> wrote:
>>>
>>>> Hi Jack,
>>>>
>>>> I added #2887 to the 0.12.0 release project board
>>>> <https://github.com/apache/iceberg/projects/1>. When do you think this
>>>> patch will be committed?
>>>>
>>>> - Carl
>>>>
>>>> On Mon, Aug 2, 2021 at 4:28 PM Ryan Blue <bl...@tabular.io> wrote:
>>>>
>>>>> Jack, I've been reviewing that one so that we can get it in. Thanks
>>>>> for fixing it!
>>>>>
>>>>> On Mon, Aug 2, 2021 at 3:12 PM Jack Ye <ye...@gmail.com> wrote:
>>>>>
>>>>>> Thanks for the update Carl!
>>>>>>
>>>>>> Given that we have voted for the adoption of format v2, can we also
>>>>>> get this change in, so that people can start to use v2 tables?
>>>>>> https://github.com/apache/iceberg/pull/2887
>>>>>>
>>>>>> -Jack
>>>>>>
>>>>>> On Mon, Aug 2, 2021 at 3:08 PM Carl Steinbach <cw...@apache.org> wrote:
>>>>>>
>>>>>>> I want to provide everyone with a quick update on the 0.12.0 release
>>>>>>> process. At this point, #2906 Fix Partition field IDs in table
>>>>>>> replacement <https://github.com/apache/iceberg/pull/2906> is the
>>>>>>> only remaining blocker. Ryan is working on a fix and predicts that we'll be
>>>>>>> ready to cut the first release candidate by the end of this week.
>>>>>>>
>>>>>>> - Carl
>>>>>>>
>>>>>>> On Mon, Jul 19, 2021 at 2:58 PM Szehon Ho <sz...@gmail.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi Carl,
>>>>>>>>
>>>>>>>> For the Issue: https://github.com/apache/iceberg/issues/2783
>>>>>>>>
>>>>>>>> The status is: I gave a bit of a try but couldn’t find an easy fix,
>>>>>>>> so hoping someone more knowledgable about this code has cycle to take a
>>>>>>>> look at it.
>>>>>>>>
>>>>>>>> It would be great to fix it for 0.12 as it seems to block more
>>>>>>>> metadata queries than before, but for timing purpose I’m not sure if its
>>>>>>>> feasible.
>>>>>>>>
>>>>>>>> Thanks
>>>>>>>> Szehon
>>>>>>>>
>>>>>>>> On Mon, Jul 19, 2021 at 2:19 PM Carl Steinbach <cw...@apache.org>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi Everyone,
>>>>>>>>>
>>>>>>>>> Currently, there are three issues blocking the release of 0.12.0:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> 1. #2308 Handle the case that RewriteFiles and RowDelta commit
>>>>>>>>> the transaction at the same time
>>>>>>>>> <https://github.com/apache/iceberg/issues/2308>
>>>>>>>>> 2. #2783 Metadata Table Empty Projection - Unknown type for
>>>>>>>>> int field. Type name: java.lang.string
>>>>>>>>> <https://github.com/apache/iceberg/issues/2783>
>>>>>>>>> 3. #2284 Core: reassign the partition field IDs and reuse any
>>>>>>>>> existing ID <https://github.com/apache/iceberg/pull/2284>s
>>>>>>>>>
>>>>>>>>> #2284 is in review.
>>>>>>>>>
>>>>>>>>> Ryan said he would take a look at #2308.
>>>>>>>>>
>>>>>>>>> @Szehon Ho <sz...@cloudera.com>, can you please confirm whether
>>>>>>>>> or not you're working on #2783?
>>>>>>>>>
>>>>>>>>> Thanks.
>>>>>>>>>
>>>>>>>>> - Carl
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Mon, Jul 19, 2021 at 12:31 PM Jack Ye <ye...@gmail.com>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> I haven't heard any news for the 0.12.0 release since then, are
>>>>>>>>>> we still planning for the release?
>>>>>>>>>>
>>>>>>>>>> Please let me know if there is anything we can do to help speed
>>>>>>>>>> up the process. (I just saw the release board, will try to at least review
>>>>>>>>>> those PRs)
>>>>>>>>>>
>>>>>>>>>> Best,
>>>>>>>>>> Jack Ye
>>>>>>>>>>
>>>>>>>>>> On Mon, Jul 12, 2021 at 5:41 PM Sreeram Garlapati <
>>>>>>>>>> gsreeramkumar@gmail.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> Great, thanks Ryan.
>>>>>>>>>>>
>>>>>>>>>>> On Mon, Jul 12, 2021 at 5:17 PM Ryan Blue <bl...@tabular.io>
>>>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Sreeram, I was just waiting for tests to pass on that PR. I
>>>>>>>>>>>> just merged it.
>>>>>>>>>>>>
>>>>>>>>>>>> On Mon, Jul 12, 2021 at 4:41 PM Sreeram Garlapati <
>>>>>>>>>>>> gsreeramkumar@gmail.com> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Hi Carl,
>>>>>>>>>>>>>
>>>>>>>>>>>>> Thanks a lot for managing 0.12.0 release.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Can you also pl. add this PR:
>>>>>>>>>>>>> https://github.com/apache/iceberg/pull/2752 - which adds the
>>>>>>>>>>>>> option "streaming-skip-delete-snapshots" - to Spark3
>>>>>>>>>>>>> micro_batch reader. Without this, streaming reads will fail if a snapshot
>>>>>>>>>>>>> of type delete or replace is encountered, & is pretty much unusable. This
>>>>>>>>>>>>> PR is already approved by multiple Committers - Ryan and Russell.
>>>>>>>>>>>>>
>>>>>>>>>>>>> PS: I am unsure if new PRs will be merged apart from the list
>>>>>>>>>>>>> proposed on the project board - into the *0.12.0* release,
>>>>>>>>>>>>> and hence, proposing this. If this PR will be merged - no action is needed.
>>>>>>>>>>>>> pl. pardon my ignorance.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Best regards,
>>>>>>>>>>>>> Sreeram
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 4:14 PM Carl Steinbach <cw...@tabular.io>
>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Hi Grant,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Good catch! I added PR-1648
>>>>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> to the 0.12.0
>>>>>>>>>>>>>> project board.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> - Carl
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 1:16 PM Grant Nicholas <
>>>>>>>>>>>>>> grant@spothero.com> wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Howdy! Any updates on PR-1648
>>>>>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> which
>>>>>>>>>>>>>>> upgrades the avro version used in iceberg? I do not see it in the "To-Do"
>>>>>>>>>>>>>>> section linked above, but the older avro version has caused major problems
>>>>>>>>>>>>>>> described in this issue and it would be nice to get in 0.12.0.
>>>>>>>>>>>>>>> https://github.com/apache/iceberg/issues/1654
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 2:39 PM Carl Steinbach <
>>>>>>>>>>>>>>> cws@apache.org> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Hi Everyone,
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> I volunteered to be the release manager for the 0.12.0
>>>>>>>>>>>>>>>> release. My goal is to start cutting release candidates this Friday, 7/17
>>>>>>>>>>>>>>>> at 24:00 PST. I am tracking progress on this release on the Release
>>>>>>>>>>>>>>>> 0.12.0 Project Board
>>>>>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1>. Note that
>>>>>>>>>>>>>>>> this board only tracks issues that BLOCK the release.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> There are currently 7 PRs listed in the To-Do
>>>>>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1#column-14786627>
>>>>>>>>>>>>>>>> column. I am going to remove these PRs from the 0.12.0 release tomorrow,
>>>>>>>>>>>>>>>> 7/13 at 24:00 PST, unless they are updated with the following information:
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> 1) Why does the PR need to be included in the 0.12.0
>>>>>>>>>>>>>>>> release?
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> 2) When will the PR will be ready for review?
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> If you have any questions or concerns, please get in touch
>>>>>>>>>>>>>>>> with me over email or slack.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> - Carl
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> [image: SpotHero] <http://spothero.com/>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Grant Nicholas / Senior Data Engineer II
>>>>>>>>>>>>>>> Pronouns <https://lgbt.ucsf.edu/pronounsmatter>: he/his
>>>>>>>>>>>>>>> grant@spothero.com
>>>>>>>>>>>>>>> spothero.com <http://www.spothero.com/> | LinkedIn
>>>>>>>>>>>>>>> <https://www.linkedin.com/in/grantanicholas>
>>>>>>>>>>>>>>> *Your perfect spot is waiting for you! Learn more
>>>>>>>>>>>>>>> at spothero.com/careers <http://spothero.com/careers>*
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Ryan Blue
>>>>>>>>>>>> Tabular
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>
>>>>> --
>>>>> Ryan Blue
>>>>> Tabular
>>>>>
>>>>
>>
>> --
>> Ryan Blue
>> Tabular
>>
>
Re: Iceberg 0.12.0 Release Plan
Posted by Carl Steinbach <cw...@tabular.io>.
Thanks, Jack and Ryan, for closing out these issues. Since there are no
more blockers, I will start preparing a release candidate.
- Carl
On Tue, Aug 3, 2021 at 3:29 PM Ryan Blue <bl...@tabular.io> wrote:
> I just merged the PR. Thanks for making it possible to create v2 tables
> easily, Jack!
>
> On Tue, Aug 3, 2021 at 1:02 PM Jack Ye <ye...@gmail.com> wrote:
>
>> Thanks! The PR is mostly ready and just got approved by Anton. As soon as
>> it is merged we can start the branch cut.
>> -Jack
>>
>> On Mon, Aug 2, 2021 at 11:39 PM Carl Steinbach <cw...@gmail.com>
>> wrote:
>>
>>> Hi Jack,
>>>
>>> I added #2887 to the 0.12.0 release project board
>>> <https://github.com/apache/iceberg/projects/1>. When do you think this
>>> patch will be committed?
>>>
>>> - Carl
>>>
>>> On Mon, Aug 2, 2021 at 4:28 PM Ryan Blue <bl...@tabular.io> wrote:
>>>
>>>> Jack, I've been reviewing that one so that we can get it in. Thanks for
>>>> fixing it!
>>>>
>>>> On Mon, Aug 2, 2021 at 3:12 PM Jack Ye <ye...@gmail.com> wrote:
>>>>
>>>>> Thanks for the update Carl!
>>>>>
>>>>> Given that we have voted for the adoption of format v2, can we also
>>>>> get this change in, so that people can start to use v2 tables?
>>>>> https://github.com/apache/iceberg/pull/2887
>>>>>
>>>>> -Jack
>>>>>
>>>>> On Mon, Aug 2, 2021 at 3:08 PM Carl Steinbach <cw...@apache.org> wrote:
>>>>>
>>>>>> I want to provide everyone with a quick update on the 0.12.0 release
>>>>>> process. At this point, #2906 Fix Partition field IDs in table
>>>>>> replacement <https://github.com/apache/iceberg/pull/2906> is the
>>>>>> only remaining blocker. Ryan is working on a fix and predicts that we'll be
>>>>>> ready to cut the first release candidate by the end of this week.
>>>>>>
>>>>>> - Carl
>>>>>>
>>>>>> On Mon, Jul 19, 2021 at 2:58 PM Szehon Ho <sz...@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi Carl,
>>>>>>>
>>>>>>> For the Issue: https://github.com/apache/iceberg/issues/2783
>>>>>>>
>>>>>>> The status is: I gave a bit of a try but couldn’t find an easy fix,
>>>>>>> so hoping someone more knowledgable about this code has cycle to take a
>>>>>>> look at it.
>>>>>>>
>>>>>>> It would be great to fix it for 0.12 as it seems to block more
>>>>>>> metadata queries than before, but for timing purpose I’m not sure if its
>>>>>>> feasible.
>>>>>>>
>>>>>>> Thanks
>>>>>>> Szehon
>>>>>>>
>>>>>>> On Mon, Jul 19, 2021 at 2:19 PM Carl Steinbach <cw...@apache.org>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi Everyone,
>>>>>>>>
>>>>>>>> Currently, there are three issues blocking the release of 0.12.0:
>>>>>>>>
>>>>>>>>
>>>>>>>> 1. #2308 Handle the case that RewriteFiles and RowDelta commit
>>>>>>>> the transaction at the same time
>>>>>>>> <https://github.com/apache/iceberg/issues/2308>
>>>>>>>> 2. #2783 Metadata Table Empty Projection - Unknown type for int
>>>>>>>> field. Type name: java.lang.string
>>>>>>>> <https://github.com/apache/iceberg/issues/2783>
>>>>>>>> 3. #2284 Core: reassign the partition field IDs and reuse any
>>>>>>>> existing ID <https://github.com/apache/iceberg/pull/2284>s
>>>>>>>>
>>>>>>>> #2284 is in review.
>>>>>>>>
>>>>>>>> Ryan said he would take a look at #2308.
>>>>>>>>
>>>>>>>> @Szehon Ho <sz...@cloudera.com>, can you please confirm whether
>>>>>>>> or not you're working on #2783?
>>>>>>>>
>>>>>>>> Thanks.
>>>>>>>>
>>>>>>>> - Carl
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Mon, Jul 19, 2021 at 12:31 PM Jack Ye <ye...@gmail.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> I haven't heard any news for the 0.12.0 release since then, are we
>>>>>>>>> still planning for the release?
>>>>>>>>>
>>>>>>>>> Please let me know if there is anything we can do to help speed up
>>>>>>>>> the process. (I just saw the release board, will try to at least review
>>>>>>>>> those PRs)
>>>>>>>>>
>>>>>>>>> Best,
>>>>>>>>> Jack Ye
>>>>>>>>>
>>>>>>>>> On Mon, Jul 12, 2021 at 5:41 PM Sreeram Garlapati <
>>>>>>>>> gsreeramkumar@gmail.com> wrote:
>>>>>>>>>
>>>>>>>>>> Great, thanks Ryan.
>>>>>>>>>>
>>>>>>>>>> On Mon, Jul 12, 2021 at 5:17 PM Ryan Blue <bl...@tabular.io>
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> Sreeram, I was just waiting for tests to pass on that PR. I just
>>>>>>>>>>> merged it.
>>>>>>>>>>>
>>>>>>>>>>> On Mon, Jul 12, 2021 at 4:41 PM Sreeram Garlapati <
>>>>>>>>>>> gsreeramkumar@gmail.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Hi Carl,
>>>>>>>>>>>>
>>>>>>>>>>>> Thanks a lot for managing 0.12.0 release.
>>>>>>>>>>>>
>>>>>>>>>>>> Can you also pl. add this PR:
>>>>>>>>>>>> https://github.com/apache/iceberg/pull/2752 - which adds the
>>>>>>>>>>>> option "streaming-skip-delete-snapshots" - to Spark3
>>>>>>>>>>>> micro_batch reader. Without this, streaming reads will fail if a snapshot
>>>>>>>>>>>> of type delete or replace is encountered, & is pretty much unusable. This
>>>>>>>>>>>> PR is already approved by multiple Committers - Ryan and Russell.
>>>>>>>>>>>>
>>>>>>>>>>>> PS: I am unsure if new PRs will be merged apart from the list
>>>>>>>>>>>> proposed on the project board - into the *0.12.0* release, and
>>>>>>>>>>>> hence, proposing this. If this PR will be merged - no action is needed. pl.
>>>>>>>>>>>> pardon my ignorance.
>>>>>>>>>>>>
>>>>>>>>>>>> Best regards,
>>>>>>>>>>>> Sreeram
>>>>>>>>>>>>
>>>>>>>>>>>> On Mon, Jul 12, 2021 at 4:14 PM Carl Steinbach <cw...@tabular.io>
>>>>>>>>>>>> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Hi Grant,
>>>>>>>>>>>>>
>>>>>>>>>>>>> Good catch! I added PR-1648
>>>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> to the 0.12.0
>>>>>>>>>>>>> project board.
>>>>>>>>>>>>>
>>>>>>>>>>>>> - Carl
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 1:16 PM Grant Nicholas <
>>>>>>>>>>>>> grant@spothero.com> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Howdy! Any updates on PR-1648
>>>>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> which upgrades
>>>>>>>>>>>>>> the avro version used in iceberg? I do not see it in the "To-Do" section
>>>>>>>>>>>>>> linked above, but the older avro version has caused major problems
>>>>>>>>>>>>>> described in this issue and it would be nice to get in 0.12.0.
>>>>>>>>>>>>>> https://github.com/apache/iceberg/issues/1654
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 2:39 PM Carl Steinbach <
>>>>>>>>>>>>>> cws@apache.org> wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Hi Everyone,
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> I volunteered to be the release manager for the 0.12.0
>>>>>>>>>>>>>>> release. My goal is to start cutting release candidates this Friday, 7/17
>>>>>>>>>>>>>>> at 24:00 PST. I am tracking progress on this release on the Release
>>>>>>>>>>>>>>> 0.12.0 Project Board
>>>>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1>. Note that
>>>>>>>>>>>>>>> this board only tracks issues that BLOCK the release.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> There are currently 7 PRs listed in the To-Do
>>>>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1#column-14786627>
>>>>>>>>>>>>>>> column. I am going to remove these PRs from the 0.12.0 release tomorrow,
>>>>>>>>>>>>>>> 7/13 at 24:00 PST, unless they are updated with the following information:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> 1) Why does the PR need to be included in the 0.12.0 release?
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> 2) When will the PR will be ready for review?
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> If you have any questions or concerns, please get in touch
>>>>>>>>>>>>>>> with me over email or slack.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> - Carl
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> [image: SpotHero] <http://spothero.com/>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Grant Nicholas / Senior Data Engineer II
>>>>>>>>>>>>>> Pronouns <https://lgbt.ucsf.edu/pronounsmatter>: he/his
>>>>>>>>>>>>>> grant@spothero.com
>>>>>>>>>>>>>> spothero.com <http://www.spothero.com/> | LinkedIn
>>>>>>>>>>>>>> <https://www.linkedin.com/in/grantanicholas>
>>>>>>>>>>>>>> *Your perfect spot is waiting for you! Learn more
>>>>>>>>>>>>>> at spothero.com/careers <http://spothero.com/careers>*
>>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Ryan Blue
>>>>>>>>>>> Tabular
>>>>>>>>>>>
>>>>>>>>>>
>>>>
>>>> --
>>>> Ryan Blue
>>>> Tabular
>>>>
>>>
>
> --
> Ryan Blue
> Tabular
>
Re: Iceberg 0.12.0 Release Plan
Posted by Ryan Blue <bl...@tabular.io>.
I just merged the PR. Thanks for making it possible to create v2 tables
easily, Jack!
On Tue, Aug 3, 2021 at 1:02 PM Jack Ye <ye...@gmail.com> wrote:
> Thanks! The PR is mostly ready and just got approved by Anton. As soon as
> it is merged we can start the branch cut.
> -Jack
>
> On Mon, Aug 2, 2021 at 11:39 PM Carl Steinbach <cw...@gmail.com>
> wrote:
>
>> Hi Jack,
>>
>> I added #2887 to the 0.12.0 release project board
>> <https://github.com/apache/iceberg/projects/1>. When do you think this
>> patch will be committed?
>>
>> - Carl
>>
>> On Mon, Aug 2, 2021 at 4:28 PM Ryan Blue <bl...@tabular.io> wrote:
>>
>>> Jack, I've been reviewing that one so that we can get it in. Thanks for
>>> fixing it!
>>>
>>> On Mon, Aug 2, 2021 at 3:12 PM Jack Ye <ye...@gmail.com> wrote:
>>>
>>>> Thanks for the update Carl!
>>>>
>>>> Given that we have voted for the adoption of format v2, can we also get
>>>> this change in, so that people can start to use v2 tables?
>>>> https://github.com/apache/iceberg/pull/2887
>>>>
>>>> -Jack
>>>>
>>>> On Mon, Aug 2, 2021 at 3:08 PM Carl Steinbach <cw...@apache.org> wrote:
>>>>
>>>>> I want to provide everyone with a quick update on the 0.12.0 release
>>>>> process. At this point, #2906 Fix Partition field IDs in table
>>>>> replacement <https://github.com/apache/iceberg/pull/2906> is the only
>>>>> remaining blocker. Ryan is working on a fix and predicts that we'll be
>>>>> ready to cut the first release candidate by the end of this week.
>>>>>
>>>>> - Carl
>>>>>
>>>>> On Mon, Jul 19, 2021 at 2:58 PM Szehon Ho <sz...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Hi Carl,
>>>>>>
>>>>>> For the Issue: https://github.com/apache/iceberg/issues/2783
>>>>>>
>>>>>> The status is: I gave a bit of a try but couldn’t find an easy fix,
>>>>>> so hoping someone more knowledgable about this code has cycle to take a
>>>>>> look at it.
>>>>>>
>>>>>> It would be great to fix it for 0.12 as it seems to block more
>>>>>> metadata queries than before, but for timing purpose I’m not sure if its
>>>>>> feasible.
>>>>>>
>>>>>> Thanks
>>>>>> Szehon
>>>>>>
>>>>>> On Mon, Jul 19, 2021 at 2:19 PM Carl Steinbach <cw...@apache.org>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi Everyone,
>>>>>>>
>>>>>>> Currently, there are three issues blocking the release of 0.12.0:
>>>>>>>
>>>>>>>
>>>>>>> 1. #2308 Handle the case that RewriteFiles and RowDelta commit
>>>>>>> the transaction at the same time
>>>>>>> <https://github.com/apache/iceberg/issues/2308>
>>>>>>> 2. #2783 Metadata Table Empty Projection - Unknown type for int
>>>>>>> field. Type name: java.lang.string
>>>>>>> <https://github.com/apache/iceberg/issues/2783>
>>>>>>> 3. #2284 Core: reassign the partition field IDs and reuse any
>>>>>>> existing ID <https://github.com/apache/iceberg/pull/2284>s
>>>>>>>
>>>>>>> #2284 is in review.
>>>>>>>
>>>>>>> Ryan said he would take a look at #2308.
>>>>>>>
>>>>>>> @Szehon Ho <sz...@cloudera.com>, can you please confirm whether or
>>>>>>> not you're working on #2783?
>>>>>>>
>>>>>>> Thanks.
>>>>>>>
>>>>>>> - Carl
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Mon, Jul 19, 2021 at 12:31 PM Jack Ye <ye...@gmail.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> I haven't heard any news for the 0.12.0 release since then, are we
>>>>>>>> still planning for the release?
>>>>>>>>
>>>>>>>> Please let me know if there is anything we can do to help speed up
>>>>>>>> the process. (I just saw the release board, will try to at least review
>>>>>>>> those PRs)
>>>>>>>>
>>>>>>>> Best,
>>>>>>>> Jack Ye
>>>>>>>>
>>>>>>>> On Mon, Jul 12, 2021 at 5:41 PM Sreeram Garlapati <
>>>>>>>> gsreeramkumar@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Great, thanks Ryan.
>>>>>>>>>
>>>>>>>>> On Mon, Jul 12, 2021 at 5:17 PM Ryan Blue <bl...@tabular.io> wrote:
>>>>>>>>>
>>>>>>>>>> Sreeram, I was just waiting for tests to pass on that PR. I just
>>>>>>>>>> merged it.
>>>>>>>>>>
>>>>>>>>>> On Mon, Jul 12, 2021 at 4:41 PM Sreeram Garlapati <
>>>>>>>>>> gsreeramkumar@gmail.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi Carl,
>>>>>>>>>>>
>>>>>>>>>>> Thanks a lot for managing 0.12.0 release.
>>>>>>>>>>>
>>>>>>>>>>> Can you also pl. add this PR:
>>>>>>>>>>> https://github.com/apache/iceberg/pull/2752 - which adds the
>>>>>>>>>>> option "streaming-skip-delete-snapshots" - to Spark3
>>>>>>>>>>> micro_batch reader. Without this, streaming reads will fail if a snapshot
>>>>>>>>>>> of type delete or replace is encountered, & is pretty much unusable. This
>>>>>>>>>>> PR is already approved by multiple Committers - Ryan and Russell.
>>>>>>>>>>>
>>>>>>>>>>> PS: I am unsure if new PRs will be merged apart from the list
>>>>>>>>>>> proposed on the project board - into the *0.12.0* release, and
>>>>>>>>>>> hence, proposing this. If this PR will be merged - no action is needed. pl.
>>>>>>>>>>> pardon my ignorance.
>>>>>>>>>>>
>>>>>>>>>>> Best regards,
>>>>>>>>>>> Sreeram
>>>>>>>>>>>
>>>>>>>>>>> On Mon, Jul 12, 2021 at 4:14 PM Carl Steinbach <cw...@tabular.io>
>>>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Hi Grant,
>>>>>>>>>>>>
>>>>>>>>>>>> Good catch! I added PR-1648
>>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> to the 0.12.0
>>>>>>>>>>>> project board.
>>>>>>>>>>>>
>>>>>>>>>>>> - Carl
>>>>>>>>>>>>
>>>>>>>>>>>> On Mon, Jul 12, 2021 at 1:16 PM Grant Nicholas <
>>>>>>>>>>>> grant@spothero.com> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Howdy! Any updates on PR-1648
>>>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> which upgrades
>>>>>>>>>>>>> the avro version used in iceberg? I do not see it in the "To-Do" section
>>>>>>>>>>>>> linked above, but the older avro version has caused major problems
>>>>>>>>>>>>> described in this issue and it would be nice to get in 0.12.0.
>>>>>>>>>>>>> https://github.com/apache/iceberg/issues/1654
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 2:39 PM Carl Steinbach <cw...@apache.org>
>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Hi Everyone,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> I volunteered to be the release manager for the 0.12.0
>>>>>>>>>>>>>> release. My goal is to start cutting release candidates this Friday, 7/17
>>>>>>>>>>>>>> at 24:00 PST. I am tracking progress on this release on the Release
>>>>>>>>>>>>>> 0.12.0 Project Board
>>>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1>. Note that
>>>>>>>>>>>>>> this board only tracks issues that BLOCK the release.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> There are currently 7 PRs listed in the To-Do
>>>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1#column-14786627>
>>>>>>>>>>>>>> column. I am going to remove these PRs from the 0.12.0 release tomorrow,
>>>>>>>>>>>>>> 7/13 at 24:00 PST, unless they are updated with the following information:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> 1) Why does the PR need to be included in the 0.12.0 release?
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> 2) When will the PR will be ready for review?
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> If you have any questions or concerns, please get in touch
>>>>>>>>>>>>>> with me over email or slack.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> - Carl
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>>
>>>>>>>>>>>>> [image: SpotHero] <http://spothero.com/>
>>>>>>>>>>>>>
>>>>>>>>>>>>> Grant Nicholas / Senior Data Engineer II
>>>>>>>>>>>>> Pronouns <https://lgbt.ucsf.edu/pronounsmatter>: he/his
>>>>>>>>>>>>> grant@spothero.com
>>>>>>>>>>>>> spothero.com <http://www.spothero.com/> | LinkedIn
>>>>>>>>>>>>> <https://www.linkedin.com/in/grantanicholas>
>>>>>>>>>>>>> *Your perfect spot is waiting for you! Learn more
>>>>>>>>>>>>> at spothero.com/careers <http://spothero.com/careers>*
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Ryan Blue
>>>>>>>>>> Tabular
>>>>>>>>>>
>>>>>>>>>
>>>
>>> --
>>> Ryan Blue
>>> Tabular
>>>
>>
--
Ryan Blue
Tabular
Re: Iceberg 0.12.0 Release Plan
Posted by Jack Ye <ye...@gmail.com>.
Thanks! The PR is mostly ready and just got approved by Anton. As soon as
it is merged we can start the branch cut.
-Jack
On Mon, Aug 2, 2021 at 11:39 PM Carl Steinbach <cw...@gmail.com>
wrote:
> Hi Jack,
>
> I added #2887 to the 0.12.0 release project board
> <https://github.com/apache/iceberg/projects/1>. When do you think this
> patch will be committed?
>
> - Carl
>
> On Mon, Aug 2, 2021 at 4:28 PM Ryan Blue <bl...@tabular.io> wrote:
>
>> Jack, I've been reviewing that one so that we can get it in. Thanks for
>> fixing it!
>>
>> On Mon, Aug 2, 2021 at 3:12 PM Jack Ye <ye...@gmail.com> wrote:
>>
>>> Thanks for the update Carl!
>>>
>>> Given that we have voted for the adoption of format v2, can we also get
>>> this change in, so that people can start to use v2 tables?
>>> https://github.com/apache/iceberg/pull/2887
>>>
>>> -Jack
>>>
>>> On Mon, Aug 2, 2021 at 3:08 PM Carl Steinbach <cw...@apache.org> wrote:
>>>
>>>> I want to provide everyone with a quick update on the 0.12.0 release
>>>> process. At this point, #2906 Fix Partition field IDs in table
>>>> replacement <https://github.com/apache/iceberg/pull/2906> is the only
>>>> remaining blocker. Ryan is working on a fix and predicts that we'll be
>>>> ready to cut the first release candidate by the end of this week.
>>>>
>>>> - Carl
>>>>
>>>> On Mon, Jul 19, 2021 at 2:58 PM Szehon Ho <sz...@gmail.com>
>>>> wrote:
>>>>
>>>>> Hi Carl,
>>>>>
>>>>> For the Issue: https://github.com/apache/iceberg/issues/2783
>>>>>
>>>>> The status is: I gave a bit of a try but couldn’t find an easy fix, so
>>>>> hoping someone more knowledgable about this code has cycle to take a look
>>>>> at it.
>>>>>
>>>>> It would be great to fix it for 0.12 as it seems to block more
>>>>> metadata queries than before, but for timing purpose I’m not sure if its
>>>>> feasible.
>>>>>
>>>>> Thanks
>>>>> Szehon
>>>>>
>>>>> On Mon, Jul 19, 2021 at 2:19 PM Carl Steinbach <cw...@apache.org> wrote:
>>>>>
>>>>>> Hi Everyone,
>>>>>>
>>>>>> Currently, there are three issues blocking the release of 0.12.0:
>>>>>>
>>>>>>
>>>>>> 1. #2308 Handle the case that RewriteFiles and RowDelta commit
>>>>>> the transaction at the same time
>>>>>> <https://github.com/apache/iceberg/issues/2308>
>>>>>> 2. #2783 Metadata Table Empty Projection - Unknown type for int
>>>>>> field. Type name: java.lang.string
>>>>>> <https://github.com/apache/iceberg/issues/2783>
>>>>>> 3. #2284 Core: reassign the partition field IDs and reuse any
>>>>>> existing ID <https://github.com/apache/iceberg/pull/2284>s
>>>>>>
>>>>>> #2284 is in review.
>>>>>>
>>>>>> Ryan said he would take a look at #2308.
>>>>>>
>>>>>> @Szehon Ho <sz...@cloudera.com>, can you please confirm whether or
>>>>>> not you're working on #2783?
>>>>>>
>>>>>> Thanks.
>>>>>>
>>>>>> - Carl
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Mon, Jul 19, 2021 at 12:31 PM Jack Ye <ye...@gmail.com> wrote:
>>>>>>
>>>>>>> I haven't heard any news for the 0.12.0 release since then, are we
>>>>>>> still planning for the release?
>>>>>>>
>>>>>>> Please let me know if there is anything we can do to help speed up
>>>>>>> the process. (I just saw the release board, will try to at least review
>>>>>>> those PRs)
>>>>>>>
>>>>>>> Best,
>>>>>>> Jack Ye
>>>>>>>
>>>>>>> On Mon, Jul 12, 2021 at 5:41 PM Sreeram Garlapati <
>>>>>>> gsreeramkumar@gmail.com> wrote:
>>>>>>>
>>>>>>>> Great, thanks Ryan.
>>>>>>>>
>>>>>>>> On Mon, Jul 12, 2021 at 5:17 PM Ryan Blue <bl...@tabular.io> wrote:
>>>>>>>>
>>>>>>>>> Sreeram, I was just waiting for tests to pass on that PR. I just
>>>>>>>>> merged it.
>>>>>>>>>
>>>>>>>>> On Mon, Jul 12, 2021 at 4:41 PM Sreeram Garlapati <
>>>>>>>>> gsreeramkumar@gmail.com> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Carl,
>>>>>>>>>>
>>>>>>>>>> Thanks a lot for managing 0.12.0 release.
>>>>>>>>>>
>>>>>>>>>> Can you also pl. add this PR:
>>>>>>>>>> https://github.com/apache/iceberg/pull/2752 - which adds the
>>>>>>>>>> option "streaming-skip-delete-snapshots" - to Spark3 micro_batch
>>>>>>>>>> reader. Without this, streaming reads will fail if a snapshot of type
>>>>>>>>>> delete or replace is encountered, & is pretty much unusable. This PR is
>>>>>>>>>> already approved by multiple Committers - Ryan and Russell.
>>>>>>>>>>
>>>>>>>>>> PS: I am unsure if new PRs will be merged apart from the list
>>>>>>>>>> proposed on the project board - into the *0.12.0* release, and
>>>>>>>>>> hence, proposing this. If this PR will be merged - no action is needed. pl.
>>>>>>>>>> pardon my ignorance.
>>>>>>>>>>
>>>>>>>>>> Best regards,
>>>>>>>>>> Sreeram
>>>>>>>>>>
>>>>>>>>>> On Mon, Jul 12, 2021 at 4:14 PM Carl Steinbach <cw...@tabular.io>
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi Grant,
>>>>>>>>>>>
>>>>>>>>>>> Good catch! I added PR-1648
>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> to the 0.12.0
>>>>>>>>>>> project board.
>>>>>>>>>>>
>>>>>>>>>>> - Carl
>>>>>>>>>>>
>>>>>>>>>>> On Mon, Jul 12, 2021 at 1:16 PM Grant Nicholas <
>>>>>>>>>>> grant@spothero.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Howdy! Any updates on PR-1648
>>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> which upgrades
>>>>>>>>>>>> the avro version used in iceberg? I do not see it in the "To-Do" section
>>>>>>>>>>>> linked above, but the older avro version has caused major problems
>>>>>>>>>>>> described in this issue and it would be nice to get in 0.12.0.
>>>>>>>>>>>> https://github.com/apache/iceberg/issues/1654
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> On Mon, Jul 12, 2021 at 2:39 PM Carl Steinbach <cw...@apache.org>
>>>>>>>>>>>> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Hi Everyone,
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> I volunteered to be the release manager for the 0.12.0
>>>>>>>>>>>>> release. My goal is to start cutting release candidates this Friday, 7/17
>>>>>>>>>>>>> at 24:00 PST. I am tracking progress on this release on the Release
>>>>>>>>>>>>> 0.12.0 Project Board
>>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1>. Note that
>>>>>>>>>>>>> this board only tracks issues that BLOCK the release.
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> There are currently 7 PRs listed in the To-Do
>>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1#column-14786627>
>>>>>>>>>>>>> column. I am going to remove these PRs from the 0.12.0 release tomorrow,
>>>>>>>>>>>>> 7/13 at 24:00 PST, unless they are updated with the following information:
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> 1) Why does the PR need to be included in the 0.12.0 release?
>>>>>>>>>>>>>
>>>>>>>>>>>>> 2) When will the PR will be ready for review?
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> If you have any questions or concerns, please get in touch
>>>>>>>>>>>>> with me over email or slack.
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> - Carl
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>>
>>>>>>>>>>>> [image: SpotHero] <http://spothero.com/>
>>>>>>>>>>>>
>>>>>>>>>>>> Grant Nicholas / Senior Data Engineer II
>>>>>>>>>>>> Pronouns <https://lgbt.ucsf.edu/pronounsmatter>: he/his
>>>>>>>>>>>> grant@spothero.com
>>>>>>>>>>>> spothero.com <http://www.spothero.com/> | LinkedIn
>>>>>>>>>>>> <https://www.linkedin.com/in/grantanicholas>
>>>>>>>>>>>> *Your perfect spot is waiting for you! Learn more
>>>>>>>>>>>> at spothero.com/careers <http://spothero.com/careers>*
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Ryan Blue
>>>>>>>>> Tabular
>>>>>>>>>
>>>>>>>>
>>
>> --
>> Ryan Blue
>> Tabular
>>
>
Re: Iceberg 0.12.0 Release Plan
Posted by Carl Steinbach <cw...@gmail.com>.
Hi Jack,
I added #2887 to the 0.12.0 release project board
<https://github.com/apache/iceberg/projects/1>. When do you think this
patch will be committed?
- Carl
On Mon, Aug 2, 2021 at 4:28 PM Ryan Blue <bl...@tabular.io> wrote:
> Jack, I've been reviewing that one so that we can get it in. Thanks for
> fixing it!
>
> On Mon, Aug 2, 2021 at 3:12 PM Jack Ye <ye...@gmail.com> wrote:
>
>> Thanks for the update Carl!
>>
>> Given that we have voted for the adoption of format v2, can we also get
>> this change in, so that people can start to use v2 tables?
>> https://github.com/apache/iceberg/pull/2887
>>
>> -Jack
>>
>> On Mon, Aug 2, 2021 at 3:08 PM Carl Steinbach <cw...@apache.org> wrote:
>>
>>> I want to provide everyone with a quick update on the 0.12.0 release
>>> process. At this point, #2906 Fix Partition field IDs in table
>>> replacement <https://github.com/apache/iceberg/pull/2906> is the only
>>> remaining blocker. Ryan is working on a fix and predicts that we'll be
>>> ready to cut the first release candidate by the end of this week.
>>>
>>> - Carl
>>>
>>> On Mon, Jul 19, 2021 at 2:58 PM Szehon Ho <sz...@gmail.com>
>>> wrote:
>>>
>>>> Hi Carl,
>>>>
>>>> For the Issue: https://github.com/apache/iceberg/issues/2783
>>>>
>>>> The status is: I gave a bit of a try but couldn’t find an easy fix, so
>>>> hoping someone more knowledgable about this code has cycle to take a look
>>>> at it.
>>>>
>>>> It would be great to fix it for 0.12 as it seems to block more metadata
>>>> queries than before, but for timing purpose I’m not sure if its feasible.
>>>>
>>>> Thanks
>>>> Szehon
>>>>
>>>> On Mon, Jul 19, 2021 at 2:19 PM Carl Steinbach <cw...@apache.org> wrote:
>>>>
>>>>> Hi Everyone,
>>>>>
>>>>> Currently, there are three issues blocking the release of 0.12.0:
>>>>>
>>>>>
>>>>> 1. #2308 Handle the case that RewriteFiles and RowDelta commit the
>>>>> transaction at the same time
>>>>> <https://github.com/apache/iceberg/issues/2308>
>>>>> 2. #2783 Metadata Table Empty Projection - Unknown type for int
>>>>> field. Type name: java.lang.string
>>>>> <https://github.com/apache/iceberg/issues/2783>
>>>>> 3. #2284 Core: reassign the partition field IDs and reuse any
>>>>> existing ID <https://github.com/apache/iceberg/pull/2284>s
>>>>>
>>>>> #2284 is in review.
>>>>>
>>>>> Ryan said he would take a look at #2308.
>>>>>
>>>>> @Szehon Ho <sz...@cloudera.com>, can you please confirm whether or
>>>>> not you're working on #2783?
>>>>>
>>>>> Thanks.
>>>>>
>>>>> - Carl
>>>>>
>>>>>
>>>>>
>>>>> On Mon, Jul 19, 2021 at 12:31 PM Jack Ye <ye...@gmail.com> wrote:
>>>>>
>>>>>> I haven't heard any news for the 0.12.0 release since then, are we
>>>>>> still planning for the release?
>>>>>>
>>>>>> Please let me know if there is anything we can do to help speed up
>>>>>> the process. (I just saw the release board, will try to at least review
>>>>>> those PRs)
>>>>>>
>>>>>> Best,
>>>>>> Jack Ye
>>>>>>
>>>>>> On Mon, Jul 12, 2021 at 5:41 PM Sreeram Garlapati <
>>>>>> gsreeramkumar@gmail.com> wrote:
>>>>>>
>>>>>>> Great, thanks Ryan.
>>>>>>>
>>>>>>> On Mon, Jul 12, 2021 at 5:17 PM Ryan Blue <bl...@tabular.io> wrote:
>>>>>>>
>>>>>>>> Sreeram, I was just waiting for tests to pass on that PR. I just
>>>>>>>> merged it.
>>>>>>>>
>>>>>>>> On Mon, Jul 12, 2021 at 4:41 PM Sreeram Garlapati <
>>>>>>>> gsreeramkumar@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Hi Carl,
>>>>>>>>>
>>>>>>>>> Thanks a lot for managing 0.12.0 release.
>>>>>>>>>
>>>>>>>>> Can you also pl. add this PR:
>>>>>>>>> https://github.com/apache/iceberg/pull/2752 - which adds the
>>>>>>>>> option "streaming-skip-delete-snapshots" - to Spark3 micro_batch
>>>>>>>>> reader. Without this, streaming reads will fail if a snapshot of type
>>>>>>>>> delete or replace is encountered, & is pretty much unusable. This PR is
>>>>>>>>> already approved by multiple Committers - Ryan and Russell.
>>>>>>>>>
>>>>>>>>> PS: I am unsure if new PRs will be merged apart from the list
>>>>>>>>> proposed on the project board - into the *0.12.0* release, and
>>>>>>>>> hence, proposing this. If this PR will be merged - no action is needed. pl.
>>>>>>>>> pardon my ignorance.
>>>>>>>>>
>>>>>>>>> Best regards,
>>>>>>>>> Sreeram
>>>>>>>>>
>>>>>>>>> On Mon, Jul 12, 2021 at 4:14 PM Carl Steinbach <cw...@tabular.io>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Grant,
>>>>>>>>>>
>>>>>>>>>> Good catch! I added PR-1648
>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> to the 0.12.0
>>>>>>>>>> project board.
>>>>>>>>>>
>>>>>>>>>> - Carl
>>>>>>>>>>
>>>>>>>>>> On Mon, Jul 12, 2021 at 1:16 PM Grant Nicholas <
>>>>>>>>>> grant@spothero.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> Howdy! Any updates on PR-1648
>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> which upgrades
>>>>>>>>>>> the avro version used in iceberg? I do not see it in the "To-Do" section
>>>>>>>>>>> linked above, but the older avro version has caused major problems
>>>>>>>>>>> described in this issue and it would be nice to get in 0.12.0.
>>>>>>>>>>> https://github.com/apache/iceberg/issues/1654
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On Mon, Jul 12, 2021 at 2:39 PM Carl Steinbach <cw...@apache.org>
>>>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Hi Everyone,
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> I volunteered to be the release manager for the 0.12.0 release.
>>>>>>>>>>>> My goal is to start cutting release candidates this Friday, 7/17 at 24:00
>>>>>>>>>>>> PST. I am tracking progress on this release on the Release
>>>>>>>>>>>> 0.12.0 Project Board
>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1>. Note that this
>>>>>>>>>>>> board only tracks issues that BLOCK the release.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> There are currently 7 PRs listed in the To-Do
>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1#column-14786627>
>>>>>>>>>>>> column. I am going to remove these PRs from the 0.12.0 release tomorrow,
>>>>>>>>>>>> 7/13 at 24:00 PST, unless they are updated with the following information:
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> 1) Why does the PR need to be included in the 0.12.0 release?
>>>>>>>>>>>>
>>>>>>>>>>>> 2) When will the PR will be ready for review?
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> If you have any questions or concerns, please get in touch with
>>>>>>>>>>>> me over email or slack.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> - Carl
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>>
>>>>>>>>>>> [image: SpotHero] <http://spothero.com/>
>>>>>>>>>>>
>>>>>>>>>>> Grant Nicholas / Senior Data Engineer II
>>>>>>>>>>> Pronouns <https://lgbt.ucsf.edu/pronounsmatter>: he/his
>>>>>>>>>>> grant@spothero.com
>>>>>>>>>>> spothero.com <http://www.spothero.com/> | LinkedIn
>>>>>>>>>>> <https://www.linkedin.com/in/grantanicholas>
>>>>>>>>>>> *Your perfect spot is waiting for you! Learn more
>>>>>>>>>>> at spothero.com/careers <http://spothero.com/careers>*
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Ryan Blue
>>>>>>>> Tabular
>>>>>>>>
>>>>>>>
>
> --
> Ryan Blue
> Tabular
>
Re: Iceberg 0.12.0 Release Plan
Posted by Ryan Blue <bl...@tabular.io>.
Jack, I've been reviewing that one so that we can get it in. Thanks for
fixing it!
On Mon, Aug 2, 2021 at 3:12 PM Jack Ye <ye...@gmail.com> wrote:
> Thanks for the update Carl!
>
> Given that we have voted for the adoption of format v2, can we also get
> this change in, so that people can start to use v2 tables?
> https://github.com/apache/iceberg/pull/2887
>
> -Jack
>
> On Mon, Aug 2, 2021 at 3:08 PM Carl Steinbach <cw...@apache.org> wrote:
>
>> I want to provide everyone with a quick update on the 0.12.0 release
>> process. At this point, #2906 Fix Partition field IDs in table
>> replacement <https://github.com/apache/iceberg/pull/2906> is the only
>> remaining blocker. Ryan is working on a fix and predicts that we'll be
>> ready to cut the first release candidate by the end of this week.
>>
>> - Carl
>>
>> On Mon, Jul 19, 2021 at 2:58 PM Szehon Ho <sz...@gmail.com>
>> wrote:
>>
>>> Hi Carl,
>>>
>>> For the Issue: https://github.com/apache/iceberg/issues/2783
>>>
>>> The status is: I gave a bit of a try but couldn’t find an easy fix, so
>>> hoping someone more knowledgable about this code has cycle to take a look
>>> at it.
>>>
>>> It would be great to fix it for 0.12 as it seems to block more metadata
>>> queries than before, but for timing purpose I’m not sure if its feasible.
>>>
>>> Thanks
>>> Szehon
>>>
>>> On Mon, Jul 19, 2021 at 2:19 PM Carl Steinbach <cw...@apache.org> wrote:
>>>
>>>> Hi Everyone,
>>>>
>>>> Currently, there are three issues blocking the release of 0.12.0:
>>>>
>>>>
>>>> 1. #2308 Handle the case that RewriteFiles and RowDelta commit the
>>>> transaction at the same time
>>>> <https://github.com/apache/iceberg/issues/2308>
>>>> 2. #2783 Metadata Table Empty Projection - Unknown type for int
>>>> field. Type name: java.lang.string
>>>> <https://github.com/apache/iceberg/issues/2783>
>>>> 3. #2284 Core: reassign the partition field IDs and reuse any
>>>> existing ID <https://github.com/apache/iceberg/pull/2284>s
>>>>
>>>> #2284 is in review.
>>>>
>>>> Ryan said he would take a look at #2308.
>>>>
>>>> @Szehon Ho <sz...@cloudera.com>, can you please confirm whether or
>>>> not you're working on #2783?
>>>>
>>>> Thanks.
>>>>
>>>> - Carl
>>>>
>>>>
>>>>
>>>> On Mon, Jul 19, 2021 at 12:31 PM Jack Ye <ye...@gmail.com> wrote:
>>>>
>>>>> I haven't heard any news for the 0.12.0 release since then, are we
>>>>> still planning for the release?
>>>>>
>>>>> Please let me know if there is anything we can do to help speed up the
>>>>> process. (I just saw the release board, will try to at least review those
>>>>> PRs)
>>>>>
>>>>> Best,
>>>>> Jack Ye
>>>>>
>>>>> On Mon, Jul 12, 2021 at 5:41 PM Sreeram Garlapati <
>>>>> gsreeramkumar@gmail.com> wrote:
>>>>>
>>>>>> Great, thanks Ryan.
>>>>>>
>>>>>> On Mon, Jul 12, 2021 at 5:17 PM Ryan Blue <bl...@tabular.io> wrote:
>>>>>>
>>>>>>> Sreeram, I was just waiting for tests to pass on that PR. I just
>>>>>>> merged it.
>>>>>>>
>>>>>>> On Mon, Jul 12, 2021 at 4:41 PM Sreeram Garlapati <
>>>>>>> gsreeramkumar@gmail.com> wrote:
>>>>>>>
>>>>>>>> Hi Carl,
>>>>>>>>
>>>>>>>> Thanks a lot for managing 0.12.0 release.
>>>>>>>>
>>>>>>>> Can you also pl. add this PR:
>>>>>>>> https://github.com/apache/iceberg/pull/2752 - which adds the
>>>>>>>> option "streaming-skip-delete-snapshots" - to Spark3 micro_batch
>>>>>>>> reader. Without this, streaming reads will fail if a snapshot of type
>>>>>>>> delete or replace is encountered, & is pretty much unusable. This PR is
>>>>>>>> already approved by multiple Committers - Ryan and Russell.
>>>>>>>>
>>>>>>>> PS: I am unsure if new PRs will be merged apart from the list
>>>>>>>> proposed on the project board - into the *0.12.0* release, and
>>>>>>>> hence, proposing this. If this PR will be merged - no action is needed. pl.
>>>>>>>> pardon my ignorance.
>>>>>>>>
>>>>>>>> Best regards,
>>>>>>>> Sreeram
>>>>>>>>
>>>>>>>> On Mon, Jul 12, 2021 at 4:14 PM Carl Steinbach <cw...@tabular.io>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi Grant,
>>>>>>>>>
>>>>>>>>> Good catch! I added PR-1648
>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> to the 0.12.0
>>>>>>>>> project board.
>>>>>>>>>
>>>>>>>>> - Carl
>>>>>>>>>
>>>>>>>>> On Mon, Jul 12, 2021 at 1:16 PM Grant Nicholas <gr...@spothero.com>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Howdy! Any updates on PR-1648
>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> which upgrades the
>>>>>>>>>> avro version used in iceberg? I do not see it in the "To-Do" section linked
>>>>>>>>>> above, but the older avro version has caused major problems described in
>>>>>>>>>> this issue and it would be nice to get in 0.12.0.
>>>>>>>>>> https://github.com/apache/iceberg/issues/1654
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On Mon, Jul 12, 2021 at 2:39 PM Carl Steinbach <cw...@apache.org>
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi Everyone,
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> I volunteered to be the release manager for the 0.12.0 release.
>>>>>>>>>>> My goal is to start cutting release candidates this Friday, 7/17 at 24:00
>>>>>>>>>>> PST. I am tracking progress on this release on the Release
>>>>>>>>>>> 0.12.0 Project Board
>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1>. Note that this
>>>>>>>>>>> board only tracks issues that BLOCK the release.
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> There are currently 7 PRs listed in the To-Do
>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1#column-14786627>
>>>>>>>>>>> column. I am going to remove these PRs from the 0.12.0 release tomorrow,
>>>>>>>>>>> 7/13 at 24:00 PST, unless they are updated with the following information:
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> 1) Why does the PR need to be included in the 0.12.0 release?
>>>>>>>>>>>
>>>>>>>>>>> 2) When will the PR will be ready for review?
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> If you have any questions or concerns, please get in touch with
>>>>>>>>>>> me over email or slack.
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Thanks.
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> - Carl
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>>
>>>>>>>>>> [image: SpotHero] <http://spothero.com/>
>>>>>>>>>>
>>>>>>>>>> Grant Nicholas / Senior Data Engineer II
>>>>>>>>>> Pronouns <https://lgbt.ucsf.edu/pronounsmatter>: he/his
>>>>>>>>>> grant@spothero.com
>>>>>>>>>> spothero.com <http://www.spothero.com/> | LinkedIn
>>>>>>>>>> <https://www.linkedin.com/in/grantanicholas>
>>>>>>>>>> *Your perfect spot is waiting for you! Learn more
>>>>>>>>>> at spothero.com/careers <http://spothero.com/careers>*
>>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Ryan Blue
>>>>>>> Tabular
>>>>>>>
>>>>>>
--
Ryan Blue
Tabular
Re: Iceberg 0.12.0 Release Plan
Posted by Jack Ye <ye...@gmail.com>.
Thanks for the update Carl!
Given that we have voted for the adoption of format v2, can we also get
this change in, so that people can start to use v2 tables?
https://github.com/apache/iceberg/pull/2887
-Jack
On Mon, Aug 2, 2021 at 3:08 PM Carl Steinbach <cw...@apache.org> wrote:
> I want to provide everyone with a quick update on the 0.12.0 release
> process. At this point, #2906 Fix Partition field IDs in table replacement
> <https://github.com/apache/iceberg/pull/2906> is the only remaining
> blocker. Ryan is working on a fix and predicts that we'll be ready to cut
> the first release candidate by the end of this week.
>
> - Carl
>
> On Mon, Jul 19, 2021 at 2:58 PM Szehon Ho <sz...@gmail.com> wrote:
>
>> Hi Carl,
>>
>> For the Issue: https://github.com/apache/iceberg/issues/2783
>>
>> The status is: I gave a bit of a try but couldn’t find an easy fix, so
>> hoping someone more knowledgable about this code has cycle to take a look
>> at it.
>>
>> It would be great to fix it for 0.12 as it seems to block more metadata
>> queries than before, but for timing purpose I’m not sure if its feasible.
>>
>> Thanks
>> Szehon
>>
>> On Mon, Jul 19, 2021 at 2:19 PM Carl Steinbach <cw...@apache.org> wrote:
>>
>>> Hi Everyone,
>>>
>>> Currently, there are three issues blocking the release of 0.12.0:
>>>
>>>
>>> 1. #2308 Handle the case that RewriteFiles and RowDelta commit the
>>> transaction at the same time
>>> <https://github.com/apache/iceberg/issues/2308>
>>> 2. #2783 Metadata Table Empty Projection - Unknown type for int
>>> field. Type name: java.lang.string
>>> <https://github.com/apache/iceberg/issues/2783>
>>> 3. #2284 Core: reassign the partition field IDs and reuse any
>>> existing ID <https://github.com/apache/iceberg/pull/2284>s
>>>
>>> #2284 is in review.
>>>
>>> Ryan said he would take a look at #2308.
>>>
>>> @Szehon Ho <sz...@cloudera.com>, can you please confirm whether or not
>>> you're working on #2783?
>>>
>>> Thanks.
>>>
>>> - Carl
>>>
>>>
>>>
>>> On Mon, Jul 19, 2021 at 12:31 PM Jack Ye <ye...@gmail.com> wrote:
>>>
>>>> I haven't heard any news for the 0.12.0 release since then, are we
>>>> still planning for the release?
>>>>
>>>> Please let me know if there is anything we can do to help speed up the
>>>> process. (I just saw the release board, will try to at least review those
>>>> PRs)
>>>>
>>>> Best,
>>>> Jack Ye
>>>>
>>>> On Mon, Jul 12, 2021 at 5:41 PM Sreeram Garlapati <
>>>> gsreeramkumar@gmail.com> wrote:
>>>>
>>>>> Great, thanks Ryan.
>>>>>
>>>>> On Mon, Jul 12, 2021 at 5:17 PM Ryan Blue <bl...@tabular.io> wrote:
>>>>>
>>>>>> Sreeram, I was just waiting for tests to pass on that PR. I just
>>>>>> merged it.
>>>>>>
>>>>>> On Mon, Jul 12, 2021 at 4:41 PM Sreeram Garlapati <
>>>>>> gsreeramkumar@gmail.com> wrote:
>>>>>>
>>>>>>> Hi Carl,
>>>>>>>
>>>>>>> Thanks a lot for managing 0.12.0 release.
>>>>>>>
>>>>>>> Can you also pl. add this PR:
>>>>>>> https://github.com/apache/iceberg/pull/2752 - which adds the option
>>>>>>> "streaming-skip-delete-snapshots" - to Spark3 micro_batch reader.
>>>>>>> Without this, streaming reads will fail if a snapshot of type delete or
>>>>>>> replace is encountered, & is pretty much unusable. This PR is already
>>>>>>> approved by multiple Committers - Ryan and Russell.
>>>>>>>
>>>>>>> PS: I am unsure if new PRs will be merged apart from the list
>>>>>>> proposed on the project board - into the *0.12.0* release, and
>>>>>>> hence, proposing this. If this PR will be merged - no action is needed. pl.
>>>>>>> pardon my ignorance.
>>>>>>>
>>>>>>> Best regards,
>>>>>>> Sreeram
>>>>>>>
>>>>>>> On Mon, Jul 12, 2021 at 4:14 PM Carl Steinbach <cw...@tabular.io>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi Grant,
>>>>>>>>
>>>>>>>> Good catch! I added PR-1648
>>>>>>>> <https://github.com/apache/iceberg/pull/1648> to the 0.12.0
>>>>>>>> project board.
>>>>>>>>
>>>>>>>> - Carl
>>>>>>>>
>>>>>>>> On Mon, Jul 12, 2021 at 1:16 PM Grant Nicholas <gr...@spothero.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Howdy! Any updates on PR-1648
>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> which upgrades the
>>>>>>>>> avro version used in iceberg? I do not see it in the "To-Do" section linked
>>>>>>>>> above, but the older avro version has caused major problems described in
>>>>>>>>> this issue and it would be nice to get in 0.12.0.
>>>>>>>>> https://github.com/apache/iceberg/issues/1654
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Mon, Jul 12, 2021 at 2:39 PM Carl Steinbach <cw...@apache.org>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Everyone,
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> I volunteered to be the release manager for the 0.12.0 release.
>>>>>>>>>> My goal is to start cutting release candidates this Friday, 7/17 at 24:00
>>>>>>>>>> PST. I am tracking progress on this release on the Release
>>>>>>>>>> 0.12.0 Project Board
>>>>>>>>>> <https://github.com/apache/iceberg/projects/1>. Note that this
>>>>>>>>>> board only tracks issues that BLOCK the release.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> There are currently 7 PRs listed in the To-Do
>>>>>>>>>> <https://github.com/apache/iceberg/projects/1#column-14786627>
>>>>>>>>>> column. I am going to remove these PRs from the 0.12.0 release tomorrow,
>>>>>>>>>> 7/13 at 24:00 PST, unless they are updated with the following information:
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> 1) Why does the PR need to be included in the 0.12.0 release?
>>>>>>>>>>
>>>>>>>>>> 2) When will the PR will be ready for review?
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> If you have any questions or concerns, please get in touch with
>>>>>>>>>> me over email or slack.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Thanks.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> - Carl
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>>
>>>>>>>>> [image: SpotHero] <http://spothero.com/>
>>>>>>>>>
>>>>>>>>> Grant Nicholas / Senior Data Engineer II
>>>>>>>>> Pronouns <https://lgbt.ucsf.edu/pronounsmatter>: he/his
>>>>>>>>> grant@spothero.com
>>>>>>>>> spothero.com <http://www.spothero.com/> | LinkedIn
>>>>>>>>> <https://www.linkedin.com/in/grantanicholas>
>>>>>>>>> *Your perfect spot is waiting for you! Learn more
>>>>>>>>> at spothero.com/careers <http://spothero.com/careers>*
>>>>>>>>>
>>>>>>>>
>>>>>>
>>>>>> --
>>>>>> Ryan Blue
>>>>>> Tabular
>>>>>>
>>>>>