You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by dong wang <el...@gmail.com> on 2015/03/05 07:53:19 UTC
how to remove the unuseful information or failed jobs in order not to
see them on the WEB GUI
Hi all, when building the cubes and running the jobs, some of them fail
and some of them are just for test use, so, do we have scripts to delete
them in order not to see them on the WEB GUI? or must we operate the HIVE
and HBASE clients to delete the unuseful job rows, unuseful hbase tables,
temp hive tables, and etc?
RE: how to remove the unuseful information or failed jobs in order
not to see them on the WEB GUI
Posted by Santoshakhilesh <sa...@huawei.com>.
Warning: this will remove all the metadata from view, so handle with care.
Regards,
Santosh Akhilesh
Bangalore R&D
HUAWEI TECHNOLOGIES CO.,LTD.
www.huawei.com
-------------------------------------------------------------------------------------------------------------------------------------
This e-mail and its attachments contain confidential information from HUAWEI, which
is intended only for the person or entity whose address is listed above. Any use of the
information contained herein in any way (including, but not limited to, total or partial
disclosure, reproduction, or dissemination) by persons other than the intended
recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!
________________________________________
From: Santoshakhilesh
Sent: Thursday, March 05, 2015 12:29 PM
To: dev@kylin.incubator.apache.org
Subject: RE: how to remove the unuseful information or failed jobs in order not to see them on the WEB GUI
One way I learned from shaofiang was to create new htable in kylin.property
kylin_metadata_new_qa - changed to new and then restart
# The metadata store in hbase
kylin.metadata.url=kylin_metadata_new_qa@hbase
Ofcourse these things you can do only when you are playing and not in production env :)
Regards,
Santosh Akhilesh
Bangalore R&D
HUAWEI TECHNOLOGIES CO.,LTD.
www.huawei.com
-------------------------------------------------------------------------------------------------------------------------------------
This e-mail and its attachments contain confidential information from HUAWEI, which
is intended only for the person or entity whose address is listed above. Any use of the
information contained herein in any way (including, but not limited to, total or partial
disclosure, reproduction, or dissemination) by persons other than the intended
recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!
________________________________________
From: hongbin ma [mahongbin@apache.org]
Sent: Thursday, March 05, 2015 12:26 PM
To: dev@kylin.incubator.apache.org
Subject: Re: how to remove the unuseful information or failed jobs in order not to see them on the WEB GUI
As far as I know there's not way to clean them in GUI. Just make sure the
jobs in "Error" state are discarded
On Thu, Mar 5, 2015 at 2:53 PM, dong wang <el...@gmail.com> wrote:
> Hi all, when building the cubes and running the jobs, some of them fail
> and some of them are just for test use, so, do we have scripts to delete
> them in order not to see them on the WEB GUI? or must we operate the HIVE
> and HBASE clients to delete the unuseful job rows, unuseful hbase tables,
> temp hive tables, and etc?
>
RE: how to remove the unuseful information or failed jobs in order
not to see them on the WEB GUI
Posted by Santoshakhilesh <sa...@huawei.com>.
One way I learned from shaofiang was to create new htable in kylin.property
kylin_metadata_new_qa - changed to new and then restart
# The metadata store in hbase
kylin.metadata.url=kylin_metadata_new_qa@hbase
Ofcourse these things you can do only when you are playing and not in production env :)
Regards,
Santosh Akhilesh
Bangalore R&D
HUAWEI TECHNOLOGIES CO.,LTD.
www.huawei.com
-------------------------------------------------------------------------------------------------------------------------------------
This e-mail and its attachments contain confidential information from HUAWEI, which
is intended only for the person or entity whose address is listed above. Any use of the
information contained herein in any way (including, but not limited to, total or partial
disclosure, reproduction, or dissemination) by persons other than the intended
recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!
________________________________________
From: hongbin ma [mahongbin@apache.org]
Sent: Thursday, March 05, 2015 12:26 PM
To: dev@kylin.incubator.apache.org
Subject: Re: how to remove the unuseful information or failed jobs in order not to see them on the WEB GUI
As far as I know there's not way to clean them in GUI. Just make sure the
jobs in "Error" state are discarded
On Thu, Mar 5, 2015 at 2:53 PM, dong wang <el...@gmail.com> wrote:
> Hi all, when building the cubes and running the jobs, some of them fail
> and some of them are just for test use, so, do we have scripts to delete
> them in order not to see them on the WEB GUI? or must we operate the HIVE
> and HBASE clients to delete the unuseful job rows, unuseful hbase tables,
> temp hive tables, and etc?
>
Re: how to remove the unuseful information or failed jobs in order
not to see them on the WEB GUI
Posted by hongbin ma <ma...@apache.org>.
hi Santosh,
please take a look at :
https://github.com/KylinOLAP/Kylin/wiki/Kylin-Metadata-Store
On Thu, Mar 5, 2015 at 3:05 PM, Santoshakhilesh <santosh.akhilesh@huawei.com
> wrote:
> Actually I have a question here , Just incase like me I have already done
> such things.
> If we are faced with things getting messed up. What to do ?
>
> Can I manually remove everything from hive and hbase and restart kylin ,
> it will be ok.
> Or I should delete some stuffs from local disk or hdfs ?
>
> Its better to know as sometimes you are experimenting , you tend to mess
> things so if Kylin experts can give a method it will be useful.
>
> Regards,
> Santosh Akhilesh
> Bangalore R&D
> HUAWEI TECHNOLOGIES CO.,LTD.
>
> www.huawei.com
>
> -------------------------------------------------------------------------------------------------------------------------------------
> This e-mail and its attachments contain confidential information from
> HUAWEI, which
> is intended only for the person or entity whose address is listed above.
> Any use of the
> information contained herein in any way (including, but not limited to,
> total or partial
> disclosure, reproduction, or dissemination) by persons other than the
> intended
> recipient(s) is prohibited. If you receive this e-mail in error, please
> notify the sender by
> phone or email immediately and delete it!
>
> ________________________________________
> From: hongbin ma [mahongbin@apache.org]
> Sent: Thursday, March 05, 2015 12:31 PM
> To: dev@kylin.incubator.apache.org
> Subject: Re: how to remove the unuseful information or failed jobs in
> order not to see them on the WEB GUI
>
> Technically there's a way to clean them by manipulating our meta store in
> hbase, however I suggest not to take the risk of messing things up.
>
> On Thu, Mar 5, 2015 at 2:56 PM, hongbin ma <ma...@apache.org> wrote:
>
> > As far as I know there's not way to clean them in GUI. Just make sure the
> > jobs in "Error" state are discarded
> >
> > On Thu, Mar 5, 2015 at 2:53 PM, dong wang <el...@gmail.com>
> wrote:
> >
> >> Hi all, when building the cubes and running the jobs, some of them
> fail
> >> and some of them are just for test use, so, do we have scripts to delete
> >> them in order not to see them on the WEB GUI? or must we operate the
> HIVE
> >> and HBASE clients to delete the unuseful job rows, unuseful hbase
> tables,
> >> temp hive tables, and etc?
> >>
> >
> >
>
RE: how to remove the unuseful information or failed jobs in order
not to see them on the WEB GUI
Posted by Santoshakhilesh <sa...@huawei.com>.
Actually I have a question here , Just incase like me I have already done such things.
If we are faced with things getting messed up. What to do ?
Can I manually remove everything from hive and hbase and restart kylin , it will be ok.
Or I should delete some stuffs from local disk or hdfs ?
Its better to know as sometimes you are experimenting , you tend to mess things so if Kylin experts can give a method it will be useful.
Regards,
Santosh Akhilesh
Bangalore R&D
HUAWEI TECHNOLOGIES CO.,LTD.
www.huawei.com
-------------------------------------------------------------------------------------------------------------------------------------
This e-mail and its attachments contain confidential information from HUAWEI, which
is intended only for the person or entity whose address is listed above. Any use of the
information contained herein in any way (including, but not limited to, total or partial
disclosure, reproduction, or dissemination) by persons other than the intended
recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!
________________________________________
From: hongbin ma [mahongbin@apache.org]
Sent: Thursday, March 05, 2015 12:31 PM
To: dev@kylin.incubator.apache.org
Subject: Re: how to remove the unuseful information or failed jobs in order not to see them on the WEB GUI
Technically there's a way to clean them by manipulating our meta store in
hbase, however I suggest not to take the risk of messing things up.
On Thu, Mar 5, 2015 at 2:56 PM, hongbin ma <ma...@apache.org> wrote:
> As far as I know there's not way to clean them in GUI. Just make sure the
> jobs in "Error" state are discarded
>
> On Thu, Mar 5, 2015 at 2:53 PM, dong wang <el...@gmail.com> wrote:
>
>> Hi all, when building the cubes and running the jobs, some of them fail
>> and some of them are just for test use, so, do we have scripts to delete
>> them in order not to see them on the WEB GUI? or must we operate the HIVE
>> and HBASE clients to delete the unuseful job rows, unuseful hbase tables,
>> temp hive tables, and etc?
>>
>
>
Re: how to remove the unuseful information or failed jobs in order
not to see them on the WEB GUI
Posted by hongbin ma <ma...@apache.org>.
Technically there's a way to clean them by manipulating our meta store in
hbase, however I suggest not to take the risk of messing things up.
On Thu, Mar 5, 2015 at 2:56 PM, hongbin ma <ma...@apache.org> wrote:
> As far as I know there's not way to clean them in GUI. Just make sure the
> jobs in "Error" state are discarded
>
> On Thu, Mar 5, 2015 at 2:53 PM, dong wang <el...@gmail.com> wrote:
>
>> Hi all, when building the cubes and running the jobs, some of them fail
>> and some of them are just for test use, so, do we have scripts to delete
>> them in order not to see them on the WEB GUI? or must we operate the HIVE
>> and HBASE clients to delete the unuseful job rows, unuseful hbase tables,
>> temp hive tables, and etc?
>>
>
>
Re: how to remove the unuseful information or failed jobs in order
not to see them on the WEB GUI
Posted by hongbin ma <ma...@apache.org>.
As far as I know there's not way to clean them in GUI. Just make sure the
jobs in "Error" state are discarded
On Thu, Mar 5, 2015 at 2:53 PM, dong wang <el...@gmail.com> wrote:
> Hi all, when building the cubes and running the jobs, some of them fail
> and some of them are just for test use, so, do we have scripts to delete
> them in order not to see them on the WEB GUI? or must we operate the HIVE
> and HBASE clients to delete the unuseful job rows, unuseful hbase tables,
> temp hive tables, and etc?
>