You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@iceberg.apache.org by Gabor Kaszab <ga...@apache.org> on 2025/01/22 09:32:40 UTC
[DISCUSS] Adding RemoveSchemasUpdate update type to REST spec
Hi Iceberg Community,
There has been a PR merged recently that enhances "expire snapshots" to
drop the unused partition specs. I myself started working now on a very
similar PR just for dropping the unused schemas.
As per this change I have a PR
<https://github.com/apache/iceberg/pull/12022> to extend the update types
in the REST spec with RemoveSchemasUpdate (similarly to this one
<https://github.com/apache/iceberg/pull/10846>).
Would you mind giving some feedback on this PR?
Thanks,
Gabor
Re: [DISCUSS] Adding RemoveSchemasUpdate update type to REST spec
Posted by Eduard Tudenhöfner <et...@apache.org>.
I agree that it makes sense to add this, so I'm +1 on this.
On Mon, Jan 27, 2025 at 3:38 PM Jean-Baptiste Onofré <jb...@nanthrax.net>
wrote:
> Hi Gabor
>
> Sorry for the late reply.
>
> It makes sense to me. Thanks !
>
> Regards
> JB
>
> On Wed, Jan 22, 2025 at 10:32 AM Gabor Kaszab <ga...@apache.org>
> wrote:
> >
> > Hi Iceberg Community,
> >
> > There has been a PR merged recently that enhances "expire snapshots" to
> drop the unused partition specs. I myself started working now on a very
> similar PR just for dropping the unused schemas.
> > As per this change I have a PR to extend the update types in the REST
> spec with RemoveSchemasUpdate (similarly to this one).
> >
> > Would you mind giving some feedback on this PR?
> >
> > Thanks,
> > Gabor
> >
>
Re: [DISCUSS] Adding RemoveSchemasUpdate update type to REST spec
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Hi Gabor
Sorry for the late reply.
It makes sense to me. Thanks !
Regards
JB
On Wed, Jan 22, 2025 at 10:32 AM Gabor Kaszab <ga...@apache.org> wrote:
>
> Hi Iceberg Community,
>
> There has been a PR merged recently that enhances "expire snapshots" to drop the unused partition specs. I myself started working now on a very similar PR just for dropping the unused schemas.
> As per this change I have a PR to extend the update types in the REST spec with RemoveSchemasUpdate (similarly to this one).
>
> Would you mind giving some feedback on this PR?
>
> Thanks,
> Gabor
>
Re: [DISCUSS] Adding RemoveSchemasUpdate update type to REST spec
Posted by Gabor Kaszab <ga...@apache.org>.
Thanks for the support, Amogh!
Would be great to hear other opinions too! :)
Meanwhile, I have the PR for removing the unused schemas:
https://github.com/apache/iceberg/pull/12089
And this is the PR for the REST spec change for the new update type:
https://github.com/apache/iceberg/pull/12022 (This one requires a vote, but
I wanted to solicit general opinions first)
Hope this makes sense!
Gabor
On Wed, Jan 22, 2025 at 11:35 PM Amogh Jahagirdar <2a...@gmail.com> wrote:
> Thanks Gabor for starting this thread,
>
> I'm +1 on adding the RemoveSchemasUpdate to the REST Spec! I think it's an
> important step in maintaining metadata to ensure that it's as small
> as possible.
> Thanks,
>
> Amogh Jahagirdar
>
> On Wed, Jan 22, 2025 at 2:34 AM Gabor Kaszab <ga...@apache.org>
> wrote:
>
>> Hi Iceberg Community,
>>
>> There has been a PR merged recently that enhances "expire snapshots" to
>> drop the unused partition specs. I myself started working now on a very
>> similar PR just for dropping the unused schemas.
>> As per this change I have a PR
>> <https://github.com/apache/iceberg/pull/12022> to extend the update
>> types in the REST spec with RemoveSchemasUpdate (similarly to this one
>> <https://github.com/apache/iceberg/pull/10846>).
>>
>> Would you mind giving some feedback on this PR?
>>
>> Thanks,
>> Gabor
>>
>>
Re: [DISCUSS] Adding RemoveSchemasUpdate update type to REST spec
Posted by Amogh Jahagirdar <2a...@gmail.com>.
Thanks Gabor for starting this thread,
I'm +1 on adding the RemoveSchemasUpdate to the REST Spec! I think it's an
important step in maintaining metadata to ensure that it's as small
as possible.
Thanks,
Amogh Jahagirdar
On Wed, Jan 22, 2025 at 2:34 AM Gabor Kaszab <ga...@apache.org> wrote:
> Hi Iceberg Community,
>
> There has been a PR merged recently that enhances "expire snapshots" to
> drop the unused partition specs. I myself started working now on a very
> similar PR just for dropping the unused schemas.
> As per this change I have a PR
> <https://github.com/apache/iceberg/pull/12022> to extend the update types
> in the REST spec with RemoveSchemasUpdate (similarly to this one
> <https://github.com/apache/iceberg/pull/10846>).
>
> Would you mind giving some feedback on this PR?
>
> Thanks,
> Gabor
>
>