You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@paimon.apache.org by Nicholas Jiang <ni...@apache.org> on 2024/07/08 07:44:56 UTC
[DISCUSS] Time for releasing 0.1.0 version of Paimon WebUI
Hey, Paimon community,
Paimon WebUI[1] is a lakehouse management platform built on Paimon. It has already completed all the features of the first version, including Paimon metadata management, CDC data integration, and data querying etc. From my perspective, it’s time to prepare for releasing 0.1.0 version of Paimon WebUI.
Looking forward to your feedback.
[1] https://github.com/apache/paimon-webui
Regards,
Nicholas Jiang
Re: [External] Re: [DISCUSS] Time for releasing 0.1.0 version of Paimon WebUI
Posted by Max Falk <gf...@yelp.com.INVALID>.
Hi folks,
would love to try Paimon Web UI but there‘s no release and a project
release cannot be built because of internal npm dependencies.
Any chance we can get another RC soon?
Best regards
Max
On Thu 11. Jul 2024 at 11:21, Guojun Li <gj...@gmail.com> wrote:
> Thanks Nicholas for the contributions on Paimon WebUI, looking forward to
> the first release.
>
> Best,
> Guojun
>
> On Thu, Jul 11, 2024 at 4:57 PM Nicholas Jiang <ni...@apache.org>
> wrote:
>
> > Hi, Paimon community,
> >
> > Thank you for your feedback. I will start the RC voting thread of 0.1.0
> > version for Paimon WebUI as soon as possible. Thanks again for all
> feedback.
> >
> > Regards,
> > Nicholas Jiang
> >
> > On 2024/07/08 07:44:56 Nicholas Jiang wrote:
> > > Hey, Paimon community,
> > >
> > > Paimon WebUI[1] is a lakehouse management platform built on Paimon. It
> > has already completed all the features of the first version, including
> > Paimon metadata management, CDC data integration, and data querying etc.
> > From my perspective, it’s time to prepare for releasing 0.1.0 version of
> > Paimon WebUI.
> > >
> > > Looking forward to your feedback.
> > >
> > > [1] https://github.com/apache/paimon-webui
> > >
> > > Regards,
> > > Nicholas Jiang
> >
>
Re: [DISCUSS] Time for releasing 0.1.0 version of Paimon WebUI
Posted by Guojun Li <gj...@gmail.com>.
Thanks Nicholas for the contributions on Paimon WebUI, looking forward to
the first release.
Best,
Guojun
On Thu, Jul 11, 2024 at 4:57 PM Nicholas Jiang <ni...@apache.org>
wrote:
> Hi, Paimon community,
>
> Thank you for your feedback. I will start the RC voting thread of 0.1.0
> version for Paimon WebUI as soon as possible. Thanks again for all feedback.
>
> Regards,
> Nicholas Jiang
>
> On 2024/07/08 07:44:56 Nicholas Jiang wrote:
> > Hey, Paimon community,
> >
> > Paimon WebUI[1] is a lakehouse management platform built on Paimon. It
> has already completed all the features of the first version, including
> Paimon metadata management, CDC data integration, and data querying etc.
> From my perspective, it’s time to prepare for releasing 0.1.0 version of
> Paimon WebUI.
> >
> > Looking forward to your feedback.
> >
> > [1] https://github.com/apache/paimon-webui
> >
> > Regards,
> > Nicholas Jiang
>
Re: [DISCUSS] Time for releasing 0.1.0 version of Paimon WebUI
Posted by Nicholas Jiang <ni...@apache.org>.
Hi, Paimon community,
Thank you for your feedback. I will start the RC voting thread of 0.1.0 version for Paimon WebUI as soon as possible. Thanks again for all feedback.
Regards,
Nicholas Jiang
On 2024/07/08 07:44:56 Nicholas Jiang wrote:
> Hey, Paimon community,
>
> Paimon WebUI[1] is a lakehouse management platform built on Paimon. It has already completed all the features of the first version, including Paimon metadata management, CDC data integration, and data querying etc. From my perspective, it’s time to prepare for releasing 0.1.0 version of Paimon WebUI.
>
> Looking forward to your feedback.
>
> [1] https://github.com/apache/paimon-webui
>
> Regards,
> Nicholas Jiang
Re: [DISCUSS] Time for releasing 0.1.0 version of Paimon WebUI
Posted by Jingsong Li <ji...@gmail.com>.
Thanks Nicholas and all contributors of Paimon WebUI!
Best,
Jingsong
On Mon, Jul 8, 2024 at 3:45 PM Nicholas Jiang <ni...@apache.org> wrote:
>
> Hey, Paimon community,
>
> Paimon WebUI[1] is a lakehouse management platform built on Paimon. It has already completed all the features of the first version, including Paimon metadata management, CDC data integration, and data querying etc. From my perspective, it’s time to prepare for releasing 0.1.0 version of Paimon WebUI.
>
> Looking forward to your feedback.
>
> [1] https://github.com/apache/paimon-webui
>
> Regards,
> Nicholas Jiang
Re: [DISCUSS] Time for releasing 0.1.0 version of Paimon WebUI
Posted by 王刚 <wa...@apache.org>.
Congratulations that the first version of Paimon Web is ready.
Best,
WangGang
Re:[DISCUSS] Time for releasing 0.1.0 version of Paimon WebUI
Posted by 欧阳武林 <ou...@163.com>.
Thanks a lot to Nicholas Jiang, Make sense! Let‘s make our lake more easier to use.
At 2024-07-08 15:44:56, "Nicholas Jiang" <ni...@apache.org> wrote:
>Hey, Paimon community,
>
>Paimon WebUI[1] is a lakehouse management platform built on Paimon. It has already completed all the features of the first version, including Paimon metadata management, CDC data integration, and data querying etc. From my perspective, it’s time to prepare for releasing 0.1.0 version of Paimon WebUI.
>
>Looking forward to your feedback.
>
>[1] https://github.com/apache/paimon-webui
>
>Regards,
>Nicholas Jiang
Re: [DISCUSS] Set CoreOptions.SYNC_ALL_PROPERTIES default to true
Posted by JUNHAO YE <ye...@gmail.com>.
Thanks, all!
There are 5 +1s, all the people involving approve this change. This pull request will be bring up today.
Best,
Junhao.
> 2025年4月2日 22:31，Yubin Li <li...@163.com> 写道：
>
> +1 for the proposal, it is also helpful for our scenarios.
>
>
>
>
> Regards,
>
> Yubin
>
>
> 在 2025-04-02 19:40:46，"王刚" <wa...@apache.org> 写道：
>> +1 ,this is helpful for users who only use Hive SQL to query the details of
>> Paimon tables.
>>
>> wj wang <ho...@gmail.com> 于2025年4月2日周三 14:05写道：
>>
>>> +1
>>>
>>> On Wed, Apr 2, 2025 at 11:13 AM Wei Wu <wo...@gmail.com> wrote:
>>>>
>>>> +1 for this change.
>>>>
>>>> We have deployed multiple engines (such as Spark and Flink) to read and
>>>> write Paimon in our internal environment, and we need to use Hive
>>> metastore
>>>> for unified management of Paimon tables. We found that if users need to
>>>> manually set this option, metadata for many Paimon tables is missing in
>>>> HMS. I would prefer this option to be set to 'true' by default,
>>> eliminating
>>>> the need for manual configuration by users.
>>>>
>>>> Thanks,
>>>> Wei
>>>>
>>>> On Tue, Apr 1, 2025 at 6:18 PM JUNHAO YE <ye...@gmail.com>
>>> wrote:
>>>>
>>>>> Hi, devs.
>>>>>
>>>>> Paimon option contains one config "sync-all-properties", which decides
>>>>> whether to sync all properties to hive metastore.
>>>>> As far ad I am concerned, it's better to set it default to true to
>>> reduce
>>>>> user's burden.
>>>>>
>>>>> How do you think? Please reply this email if you have different
>>> opinions.
>>>>>
>>>>> Thanks,
>>>>> Junhao
>>>>>
>>>
Re:Re: [DISCUSS] Set CoreOptions.SYNC_ALL_PROPERTIES default to true
Posted by Yubin Li <li...@163.com>.
+1 for the proposal, it is also helpful for our scenarios.
Regards,
Yubin
在 2025-04-02 19:40:46，"王刚" <wa...@apache.org> 写道：
>+1 ,this is helpful for users who only use Hive SQL to query the details of
>Paimon tables.
>
>wj wang <ho...@gmail.com> 于2025年4月2日周三 14:05写道：
>
>> +1
>>
>> On Wed, Apr 2, 2025 at 11:13 AM Wei Wu <wo...@gmail.com> wrote:
>> >
>> > +1 for this change.
>> >
>> > We have deployed multiple engines (such as Spark and Flink) to read and
>> > write Paimon in our internal environment, and we need to use Hive
>> metastore
>> > for unified management of Paimon tables. We found that if users need to
>> > manually set this option, metadata for many Paimon tables is missing in
>> > HMS. I would prefer this option to be set to 'true' by default,
>> eliminating
>> > the need for manual configuration by users.
>> >
>> > Thanks,
>> > Wei
>> >
>> > On Tue, Apr 1, 2025 at 6:18 PM JUNHAO YE <ye...@gmail.com>
>> wrote:
>> >
>> > > Hi, devs.
>> > >
>> > > Paimon option contains one config "sync-all-properties", which decides
>> > > whether to sync all properties to hive metastore.
>> > > As far ad I am concerned, it's better to set it default to true to
>> reduce
>> > > user's burden.
>> > >
>> > > How do you think? Please reply this email if you have different
>> opinions.
>> > >
>> > > Thanks,
>> > > Junhao
>> > >
>>
Re: [DISCUSS] Set CoreOptions.SYNC_ALL_PROPERTIES default to true
Posted by 王刚 <wa...@apache.org>.
+1 ,this is helpful for users who only use Hive SQL to query the details of
Paimon tables.
wj wang <ho...@gmail.com> 于2025年4月2日周三 14:05写道：
> +1
>
> On Wed, Apr 2, 2025 at 11:13 AM Wei Wu <wo...@gmail.com> wrote:
> >
> > +1 for this change.
> >
> > We have deployed multiple engines (such as Spark and Flink) to read and
> > write Paimon in our internal environment, and we need to use Hive
> metastore
> > for unified management of Paimon tables. We found that if users need to
> > manually set this option, metadata for many Paimon tables is missing in
> > HMS. I would prefer this option to be set to 'true' by default,
> eliminating
> > the need for manual configuration by users.
> >
> > Thanks,
> > Wei
> >
> > On Tue, Apr 1, 2025 at 6:18 PM JUNHAO YE <ye...@gmail.com>
> wrote:
> >
> > > Hi, devs.
> > >
> > > Paimon option contains one config "sync-all-properties", which decides
> > > whether to sync all properties to hive metastore.
> > > As far ad I am concerned, it's better to set it default to true to
> reduce
> > > user's burden.
> > >
> > > How do you think? Please reply this email if you have different
> opinions.
> > >
> > > Thanks,
> > > Junhao
> > >
>
Re: [DISCUSS] Set CoreOptions.SYNC_ALL_PROPERTIES default to true
Posted by wj wang <ho...@gmail.com>.
+1
On Wed, Apr 2, 2025 at 11:13 AM Wei Wu <wo...@gmail.com> wrote:
>
> +1 for this change.
>
> We have deployed multiple engines (such as Spark and Flink) to read and
> write Paimon in our internal environment, and we need to use Hive metastore
> for unified management of Paimon tables. We found that if users need to
> manually set this option, metadata for many Paimon tables is missing in
> HMS. I would prefer this option to be set to 'true' by default, eliminating
> the need for manual configuration by users.
>
> Thanks,
> Wei
>
> On Tue, Apr 1, 2025 at 6:18 PM JUNHAO YE <ye...@gmail.com> wrote:
>
> > Hi, devs.
> >
> > Paimon option contains one config "sync-all-properties", which decides
> > whether to sync all properties to hive metastore.
> > As far ad I am concerned, it's better to set it default to true to reduce
> > user's burden.
> >
> > How do you think? Please reply this email if you have different opinions.
> >
> > Thanks,
> > Junhao
> >
Re: [DISCUSS] Set CoreOptions.SYNC_ALL_PROPERTIES default to true
Posted by Wei Wu <wo...@gmail.com>.
+1 for this change.
We have deployed multiple engines (such as Spark and Flink) to read and
write Paimon in our internal environment, and we need to use Hive metastore
for unified management of Paimon tables. We found that if users need to
manually set this option, metadata for many Paimon tables is missing in
HMS. I would prefer this option to be set to 'true' by default, eliminating
the need for manual configuration by users.
Thanks,
Wei
On Tue, Apr 1, 2025 at 6:18 PM JUNHAO YE <ye...@gmail.com> wrote:
> Hi, devs.
>
> Paimon option contains one config "sync-all-properties", which decides
> whether to sync all properties to hive metastore.
> As far ad I am concerned, it's better to set it default to true to reduce
> user's burden.
>
> How do you think? Please reply this email if you have different opinions.
>
> Thanks,
> Junhao
>
Re: [DISCUSS] Set CoreOptions.SYNC_ALL_PROPERTIES default to true
Posted by Jingsong Li <ji...@gmail.com>.
+1 for this.
I don't think there's any harm in it.
Best,
Jingsong
On Tue, Apr 1, 2025 at 6:18 PM JUNHAO YE <ye...@gmail.com> wrote:
>
> Hi, devs.
>
> Paimon option contains one config "sync-all-properties", which decides whether to sync all properties to hive metastore.
> As far ad I am concerned, it's better to set it default to true to reduce user's burden.
>
> How do you think? Please reply this email if you have different opinions.
>
> Thanks,
> Junhao
>
[DISCUSS] Set CoreOptions.SYNC_ALL_PROPERTIES default to true
Posted by JUNHAO YE <ye...@gmail.com>.
Hi, devs.
Paimon option contains one config "sync-all-properties", which decides whether to sync all properties to hive metastore.
As far ad I am concerned, it's better to set it default to true to reduce user's burden.
How do you think? Please reply this email if you have different opinions.
Thanks,
Junhao
Re: [DISCUSS] Time for releasing 0.1.0 version of Paimon WebUI
Posted by Ming Li <jo...@gmail.com>.
Thanks Nicholas for driving this! I think it is a very useful platform that
provides convenience for users to use paimon. Looking forward to the
release of version 0.1.0!
Best,
Ming Li
Nicholas Jiang <ni...@apache.org> 于2024年7月8日周一 15:45写道：
> Hey, Paimon community,
>
> Paimon WebUI[1] is a lakehouse management platform built on Paimon. It has
> already completed all the features of the first version, including Paimon
> metadata management, CDC data integration, and data querying etc. From my
> perspective, it’s time to prepare for releasing 0.1.0 version of Paimon
> WebUI.
>
> Looking forward to your feedback.
>
> [1] https://github.com/apache/paimon-webui
>
> Regards,
> Nicholas Jiang