You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by Abhilash L L <ab...@infoworks.io> on 2015/10/25 19:49:16 UTC
Issue with stale cube desc in Cuboid.java
Hello,
We create cubes on the fly and we recreate the cube in certain cases
with the same cube name.
In Cuboid.java there is a cuboid cache based on the cube name.
If we create a cube with some description and then we drop the cube
and create it with a different description, it will still get the stale
cache from the cuboid_cache and cause error while adding cubing jobs in
CubingJobBuilder.
If I restart kylin, we are able to go through with the build since the
stale desc is not there anymore. We should be removing from the cache if
the cube is dropped.
We are on Kylin 0.7.2
Regards,
Abhilash
Re: Issue with stale cube desc in Cuboid.java
Posted by ShaoFeng Shi <sh...@apache.org>.
Before the upgrade, I suggest you take a backup of the metadata table,
either by "./bin/metastore.sh backup", or use hbase snapshot command.
2015-10-26 11:13 GMT+08:00 Abhilash L L <ab...@infoworks.io>:
> Thanks a lot Luke and ShaoFeng, we will check if we can upgrade to v1.1
> easily since metadata is compatible
>
>
>
> Regards,
> Abhilash
>
> On Mon, Oct 26, 2015 at 6:21 AM, ShaoFeng Shi <sh...@apache.org>
> wrote:
>
> > I think this issue has been fixed in v1.0, please check the following
> JIRA:
> > https://issues.apache.org/jira/browse/KYLIN-797
> > https://issues.apache.org/jira/browse/KYLIN-898
> >
> > If you're still on v0.7.2, suggest you upgrade to latest v1.1 version;
> v1.0
> > and v1.1 are mainly bug fix and enhancement from 0.7.x, the metadata
> > is compitable backward;
> >
> > 2015-10-26 8:04 GMT+08:00 Luke Han <lu...@gmail.com>:
> >
> > > Hi Abhilash, please check "admin" page, there's one button to "Reload
> > > metadata" which will clear such cache.
> > >
> > > Thanks.
> > >
> > >
> > > Best Regards!
> > > ---------------------
> > >
> > > Luke Han
> > >
> > > On Mon, Oct 26, 2015 at 2:49 AM, Abhilash L L <ab...@infoworks.io>
> > > wrote:
> > >
> > > > Hello,
> > > >
> > > > We create cubes on the fly and we recreate the cube in certain
> > cases
> > > > with the same cube name.
> > > >
> > > > In Cuboid.java there is a cuboid cache based on the cube name.
> > > >
> > > > If we create a cube with some description and then we drop the
> > cube
> > > > and create it with a different description, it will still get the
> stale
> > > > cache from the cuboid_cache and cause error while adding cubing jobs
> in
> > > > CubingJobBuilder.
> > > >
> > > > If I restart kylin, we are able to go through with the build
> since
> > > the
> > > > stale desc is not there anymore. We should be removing from the cache
> > if
> > > > the cube is dropped.
> > > >
> > > > We are on Kylin 0.7.2
> > > >
> > > > Regards,
> > > > Abhilash
> > > >
> > >
> >
> >
> >
> > --
> > Best regards,
> >
> > Shaofeng Shi
> >
>
--
Best regards,
Shaofeng Shi
Re: Issue with stale cube desc in Cuboid.java
Posted by Abhilash L L <ab...@infoworks.io>.
Thanks a lot Luke and ShaoFeng, we will check if we can upgrade to v1.1
easily since metadata is compatible
Regards,
Abhilash
On Mon, Oct 26, 2015 at 6:21 AM, ShaoFeng Shi <sh...@apache.org>
wrote:
> I think this issue has been fixed in v1.0, please check the following JIRA:
> https://issues.apache.org/jira/browse/KYLIN-797
> https://issues.apache.org/jira/browse/KYLIN-898
>
> If you're still on v0.7.2, suggest you upgrade to latest v1.1 version; v1.0
> and v1.1 are mainly bug fix and enhancement from 0.7.x, the metadata
> is compitable backward;
>
> 2015-10-26 8:04 GMT+08:00 Luke Han <lu...@gmail.com>:
>
> > Hi Abhilash, please check "admin" page, there's one button to "Reload
> > metadata" which will clear such cache.
> >
> > Thanks.
> >
> >
> > Best Regards!
> > ---------------------
> >
> > Luke Han
> >
> > On Mon, Oct 26, 2015 at 2:49 AM, Abhilash L L <ab...@infoworks.io>
> > wrote:
> >
> > > Hello,
> > >
> > > We create cubes on the fly and we recreate the cube in certain
> cases
> > > with the same cube name.
> > >
> > > In Cuboid.java there is a cuboid cache based on the cube name.
> > >
> > > If we create a cube with some description and then we drop the
> cube
> > > and create it with a different description, it will still get the stale
> > > cache from the cuboid_cache and cause error while adding cubing jobs in
> > > CubingJobBuilder.
> > >
> > > If I restart kylin, we are able to go through with the build since
> > the
> > > stale desc is not there anymore. We should be removing from the cache
> if
> > > the cube is dropped.
> > >
> > > We are on Kylin 0.7.2
> > >
> > > Regards,
> > > Abhilash
> > >
> >
>
>
>
> --
> Best regards,
>
> Shaofeng Shi
>
Re: Issue with stale cube desc in Cuboid.java
Posted by ShaoFeng Shi <sh...@apache.org>.
I think this issue has been fixed in v1.0, please check the following JIRA:
https://issues.apache.org/jira/browse/KYLIN-797
https://issues.apache.org/jira/browse/KYLIN-898
If you're still on v0.7.2, suggest you upgrade to latest v1.1 version; v1.0
and v1.1 are mainly bug fix and enhancement from 0.7.x, the metadata
is compitable backward;
2015-10-26 8:04 GMT+08:00 Luke Han <lu...@gmail.com>:
> Hi Abhilash, please check "admin" page, there's one button to "Reload
> metadata" which will clear such cache.
>
> Thanks.
>
>
> Best Regards!
> ---------------------
>
> Luke Han
>
> On Mon, Oct 26, 2015 at 2:49 AM, Abhilash L L <ab...@infoworks.io>
> wrote:
>
> > Hello,
> >
> > We create cubes on the fly and we recreate the cube in certain cases
> > with the same cube name.
> >
> > In Cuboid.java there is a cuboid cache based on the cube name.
> >
> > If we create a cube with some description and then we drop the cube
> > and create it with a different description, it will still get the stale
> > cache from the cuboid_cache and cause error while adding cubing jobs in
> > CubingJobBuilder.
> >
> > If I restart kylin, we are able to go through with the build since
> the
> > stale desc is not there anymore. We should be removing from the cache if
> > the cube is dropped.
> >
> > We are on Kylin 0.7.2
> >
> > Regards,
> > Abhilash
> >
>
--
Best regards,
Shaofeng Shi
Re: Issue with stale cube desc in Cuboid.java
Posted by Luke Han <lu...@gmail.com>.
Hi Abhilash, please check "admin" page, there's one button to "Reload
metadata" which will clear such cache.
Thanks.
Best Regards!
---------------------
Luke Han
On Mon, Oct 26, 2015 at 2:49 AM, Abhilash L L <ab...@infoworks.io> wrote:
> Hello,
>
> We create cubes on the fly and we recreate the cube in certain cases
> with the same cube name.
>
> In Cuboid.java there is a cuboid cache based on the cube name.
>
> If we create a cube with some description and then we drop the cube
> and create it with a different description, it will still get the stale
> cache from the cuboid_cache and cause error while adding cubing jobs in
> CubingJobBuilder.
>
> If I restart kylin, we are able to go through with the build since the
> stale desc is not there anymore. We should be removing from the cache if
> the cube is dropped.
>
> We are on Kylin 0.7.2
>
> Regards,
> Abhilash
>