You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@paimon.apache.org by Jingsong Li <ji...@gmail.com> on 2024/05/16 09:27:33 UTC

[DISCUSS] PIP-22: Introduce repair metastore procedure

Hi devs,

I want to bring a discussion for PIP-22 [1].

In some cases, the schema on the file system may differ from the one
in the metastore:

1. There is a database in the file system, but not in the metastore
2. There are tables in the file system, but not in metastore
3. The schema in the file system is different from the metastore
4. The partition in the file system is inconsistent with the metastore

We lack a method to synchronize information from the file system to Metastore.

This PIP aims to add repair_meta procedure to provide this method.

[1] https://cwiki.apache.org/confluence/display/PAIMON/PIP-22%3A+Introduce+repair+metastore+procedure

Best,
Jingsong

Re: [DISCUSS] PIP-22: Introduce repair metastore procedure

Posted by Jingsong Li <ji...@gmail.com>.
welcome, thanks kerwin

Kerwin <zh...@gmail.com>于2024年5月17日 周五09:33写道:

> Very good idea and friendly for users using hive metastore.
>
> If this task is not claimed by a contributor, I am willing to implement
> this part of the code.
>
> --
> Best Wish
> — Kerwin (zhuangchong)
>
>
>
> Jingsong Li <ji...@gmail.com> 于2024年5月16日周四 17:27写道:
>
> > Hi devs,
> >
> > I want to bring a discussion for PIP-22 [1].
> >
> > In some cases, the schema on the file system may differ from the one
> > in the metastore:
> >
> > 1. There is a database in the file system, but not in the metastore
> > 2. There are tables in the file system, but not in metastore
> > 3. The schema in the file system is different from the metastore
> > 4. The partition in the file system is inconsistent with the metastore
> >
> > We lack a method to synchronize information from the file system to
> > Metastore.
> >
> > This PIP aims to add repair_meta procedure to provide this method.
> >
> > [1]
> >
> https://cwiki.apache.org/confluence/display/PAIMON/PIP-22%3A+Introduce+repair+metastore+procedure
> >
> > Best,
> > Jingsong
> >
>

Re: [DISCUSS] PIP-22: Introduce repair metastore procedure

Posted by Kerwin <zh...@gmail.com>.
Very good idea and friendly for users using hive metastore.

If this task is not claimed by a contributor, I am willing to implement
this part of the code.

--
Best Wish
— Kerwin (zhuangchong)



Jingsong Li <ji...@gmail.com> 于2024年5月16日周四 17:27写道:

> Hi devs,
>
> I want to bring a discussion for PIP-22 [1].
>
> In some cases, the schema on the file system may differ from the one
> in the metastore:
>
> 1. There is a database in the file system, but not in the metastore
> 2. There are tables in the file system, but not in metastore
> 3. The schema in the file system is different from the metastore
> 4. The partition in the file system is inconsistent with the metastore
>
> We lack a method to synchronize information from the file system to
> Metastore.
>
> This PIP aims to add repair_meta procedure to provide this method.
>
> [1]
> https://cwiki.apache.org/confluence/display/PAIMON/PIP-22%3A+Introduce+repair+metastore+procedure
>
> Best,
> Jingsong
>