You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kylin.apache.org by Tao Wong <wo...@gmail.com> on 2015/05/12 12:38:57 UTC

No table shows after restoring the metadata

Hi,
I backup and restore the metadata to do some test.
The cubes demostrate as expected ,but no tables shows in "Query" tap.

Re: No table shows after restoring the metadata

Posted by ShaoFeng Shi <sh...@apache.org>.

Interesting, we didn't see this before so I have no idea; Purge cube will
drop all existing cube segments, not knowing how it solved this; Anyway,
glad to hear Kylin works on CDH now, thanks!

2015-05-14 14:58 GMT+08:00 Tao Wong <wo...@gmail.com>:

> Problem solved.
>
> After restoring ,I have to purge the cube first.
>
> 2015-05-14 14:29 GMT+08:00 Tao Wong <wo...@gmail.com>:
>
> > Hi,shaofeng
> >
> > nice job !
> > the table appears.
> >
> > but i still couldn't run SQL query after cube be refreshed.
> >
> > ==========================[QUERY]===============================
> > SQL: select dt user_fact where province_id<>-1 and city_type_id<>-1 and
> > city_id<>-1 group by dt
> > User: ADMIN
> > Success: false
> > Duration: 0.002
> > Project: user
> > Realization Names: []
> > Cuboid Ids: []
> > Total scan count: 0
> > Result row count: 0
> > Accept Partial: true
> > Is Partial Result: false
> > Hit Cache: true
> > Message: exception while executing query: Error when scan from lower key
> > ^@^@^@^@^@^@^@^O^@^@^@^@ to upper key ^@^@^@^@^@^@^@^Oï¿½ï¿½ï¿½ï¿½^@ on
> > table KYLIN_1BH1WBQ2ZE.
> >
> > 2015-05-13 10:53 GMT+08:00 Tao Wong <wo...@gmail.com>:
> >
> >> YES.Also CDH env.but its version is 5.3.X
> >> we are cautious with restore operation as the machines deploied CDH
> 5.3.X
> >> are on-line.
> >>
> >> 2015-05-13 10:44 GMT+08:00 ShaoFeng Shi <sh...@apache.org>:
> >>
> >>> BTW, which env did you migrate the metadata/cubes to this CDH env? Is
> it
> >>> also CDH or other hadoop env? Does it have the same issue there?
> >>>
> >>> 2015-05-13 10:43 GMT+08:00 ShaoFeng Shi <sh...@apache.org>:
> >>>
> >>> > okay get it; please watch
> >>> https://issues.apache.org/jira/browse/KYLIN-761
> >>> > for any update; I'm setting up a CDH environment to check this.
> >>> >
> >>> > 2015-05-13 10:39 GMT+08:00 Tao Wong <wo...@gmail.com>:
> >>> >
> >>> >> *are you running Kylin on CDH? *
> >>> >> YES. we are running kylin on CDH 5.4.x
> >>> >>
> >>> >> *What's the status of the cubes after "refresh the cube
> successfully"
> >>> ?*
> >>> >> actually,i backup the metadata from one kylin system and restore it
> on
> >>> >> another one.
> >>> >> after i restore the metadata,the status of cubes in the "Cubes" Tab
> >>> are
> >>> >> all
> >>> >> "READY".
> >>> >> refresh does not change its status.
> >>> >>
> >>> >> * Is there any error in kylin.log when "can not do the query
> >>> operation"?*
> >>> >>
> >>> >> User: ADMIN
> >>> >> Success: false
> >>> >> Duration: 0.001
> >>> >> Project: ProjectName
> >>> >> Realization Names: []
> >>> >> Cuboid Ids: []
> >>> >> Total scan count: 0
> >>> >> Result row count: 0
> >>> >> Accept Partial: true
> >>> >> Is Partial Result: false
> >>> >> Hit Cache: true
> >>> >> Message: Error instantiating JsonCustomSchema(name=ProjectName)
> >>> >>
> >>> >>
> >>> >> 2015-05-13 9:41 GMT+08:00 ShaoFeng Shi <sh...@apache.org>:
> >>> >>
> >>> >> > Tao, are you running Kylin on CDH? What's the status of the cubes
> >>> after
> >>> >> > "refresh the cube successfully"? Is there any error in kylin.log
> >>> when
> >>> >> "can
> >>> >> > not do the query operation"?
> >>> >> >
> >>> >> > 2015-05-12 18:46 GMT+08:00 Tao Wong <wo...@gmail.com>:
> >>> >> >
> >>> >> > > BTW:
> >>> >> > >
> >>> >> > > after restoring the metadata ,i can resresh the cube
> successfully.
> >>> >> > > but with  no tables, i can not do the query operation.
> >>> >> > >
> >>> >> > > 2015-05-12 18:38 GMT+08:00 Tao Wong <wo...@gmail.com>:
> >>> >> > >
> >>> >> > > > Hi,
> >>> >> > > > I backup and restore the metadata to do some test.
> >>> >> > > > The cubes demostrate as expected ,but no tables shows in
> "Query"
> >>> >> tap.
> >>> >> > > >
> >>> >> > > >
> >>> >> > > >
> >>> >> > >
> >>> >> >
> >>> >>
> >>> >
> >>> >
> >>>
> >>
> >>
> >
>

Re: No table shows after restoring the metadata

Posted by Tao Wong <wo...@gmail.com>.

Problem solved.

After restoring ,I have to purge the cube first.

2015-05-14 14:29 GMT+08:00 Tao Wong <wo...@gmail.com>:

> Hi,shaofeng
>
> nice job !
> the table appears.
>
> but i still couldn't run SQL query after cube be refreshed.
>
> ==========================[QUERY]===============================
> SQL: select dt user_fact where province_id<>-1 and city_type_id<>-1 and
> city_id<>-1 group by dt
> User: ADMIN
> Success: false
> Duration: 0.002
> Project: user
> Realization Names: []
> Cuboid Ids: []
> Total scan count: 0
> Result row count: 0
> Accept Partial: true
> Is Partial Result: false
> Hit Cache: true
> Message: exception while executing query: Error when scan from lower key
> ^@^@^@^@^@^@^@^O^@^@^@^@ to upper key ^@^@^@^@^@^@^@^Oï¿½ï¿½ï¿½ï¿½^@ on
> table KYLIN_1BH1WBQ2ZE.
>
> 2015-05-13 10:53 GMT+08:00 Tao Wong <wo...@gmail.com>:
>
>> YES.Also CDH env.but its version is 5.3.X
>> we are cautious with restore operation as the machines deploied CDH 5.3.X
>> are on-line.
>>
>> 2015-05-13 10:44 GMT+08:00 ShaoFeng Shi <sh...@apache.org>:
>>
>>> BTW, which env did you migrate the metadata/cubes to this CDH env? Is it
>>> also CDH or other hadoop env? Does it have the same issue there?
>>>
>>> 2015-05-13 10:43 GMT+08:00 ShaoFeng Shi <sh...@apache.org>:
>>>
>>> > okay get it; please watch
>>> https://issues.apache.org/jira/browse/KYLIN-761
>>> > for any update; I'm setting up a CDH environment to check this.
>>> >
>>> > 2015-05-13 10:39 GMT+08:00 Tao Wong <wo...@gmail.com>:
>>> >
>>> >> *are you running Kylin on CDH? *
>>> >> YES. we are running kylin on CDH 5.4.x
>>> >>
>>> >> *What's the status of the cubes after "refresh the cube successfully"
>>> ?*
>>> >> actually,i backup the metadata from one kylin system and restore it on
>>> >> another one.
>>> >> after i restore the metadata,the status of cubes in the "Cubes" Tab
>>> are
>>> >> all
>>> >> "READY".
>>> >> refresh does not change its status.
>>> >>
>>> >> * Is there any error in kylin.log when "can not do the query
>>> operation"?*
>>> >>
>>> >> User: ADMIN
>>> >> Success: false
>>> >> Duration: 0.001
>>> >> Project: ProjectName
>>> >> Realization Names: []
>>> >> Cuboid Ids: []
>>> >> Total scan count: 0
>>> >> Result row count: 0
>>> >> Accept Partial: true
>>> >> Is Partial Result: false
>>> >> Hit Cache: true
>>> >> Message: Error instantiating JsonCustomSchema(name=ProjectName)
>>> >>
>>> >>
>>> >> 2015-05-13 9:41 GMT+08:00 ShaoFeng Shi <sh...@apache.org>:
>>> >>
>>> >> > Tao, are you running Kylin on CDH? What's the status of the cubes
>>> after
>>> >> > "refresh the cube successfully"? Is there any error in kylin.log
>>> when
>>> >> "can
>>> >> > not do the query operation"?
>>> >> >
>>> >> > 2015-05-12 18:46 GMT+08:00 Tao Wong <wo...@gmail.com>:
>>> >> >
>>> >> > > BTW:
>>> >> > >
>>> >> > > after restoring the metadata ,i can resresh the cube successfully.
>>> >> > > but with  no tables, i can not do the query operation.
>>> >> > >
>>> >> > > 2015-05-12 18:38 GMT+08:00 Tao Wong <wo...@gmail.com>:
>>> >> > >
>>> >> > > > Hi,
>>> >> > > > I backup and restore the metadata to do some test.
>>> >> > > > The cubes demostrate as expected ,but no tables shows in "Query"
>>> >> tap.
>>> >> > > >
>>> >> > > >
>>> >> > > >
>>> >> > >
>>> >> >
>>> >>
>>> >
>>> >
>>>
>>
>>
>

Re: No table shows after restoring the metadata

Posted by Tao Wong <wo...@gmail.com>.

Hi,shaofeng

nice job !
the table appears.

but i still couldn't run SQL query after cube be refreshed.

==========================[QUERY]===============================
SQL: select dt user_fact where province_id<>-1 and city_type_id<>-1 and
city_id<>-1 group by dt
User: ADMIN
Success: false
Duration: 0.002
Project: user
Realization Names: []
Cuboid Ids: []
Total scan count: 0
Result row count: 0
Accept Partial: true
Is Partial Result: false
Hit Cache: true
Message: exception while executing query: Error when scan from lower key
^@^@^@^@^@^@^@^O^@^@^@^@ to upper key ^@^@^@^@^@^@^@^Oï¿½ï¿½ï¿½ï¿½^@ on
table KYLIN_1BH1WBQ2ZE.

2015-05-13 10:53 GMT+08:00 Tao Wong <wo...@gmail.com>:

> YES.Also CDH env.but its version is 5.3.X
> we are cautious with restore operation as the machines deploied CDH 5.3.X
> are on-line.
>
> 2015-05-13 10:44 GMT+08:00 ShaoFeng Shi <sh...@apache.org>:
>
>> BTW, which env did you migrate the metadata/cubes to this CDH env? Is it
>> also CDH or other hadoop env? Does it have the same issue there?
>>
>> 2015-05-13 10:43 GMT+08:00 ShaoFeng Shi <sh...@apache.org>:
>>
>> > okay get it; please watch
>> https://issues.apache.org/jira/browse/KYLIN-761
>> > for any update; I'm setting up a CDH environment to check this.
>> >
>> > 2015-05-13 10:39 GMT+08:00 Tao Wong <wo...@gmail.com>:
>> >
>> >> *are you running Kylin on CDH? *
>> >> YES. we are running kylin on CDH 5.4.x
>> >>
>> >> *What's the status of the cubes after "refresh the cube successfully"
>> ?*
>> >> actually,i backup the metadata from one kylin system and restore it on
>> >> another one.
>> >> after i restore the metadata,the status of cubes in the "Cubes" Tab are
>> >> all
>> >> "READY".
>> >> refresh does not change its status.
>> >>
>> >> * Is there any error in kylin.log when "can not do the query
>> operation"?*
>> >>
>> >> User: ADMIN
>> >> Success: false
>> >> Duration: 0.001
>> >> Project: ProjectName
>> >> Realization Names: []
>> >> Cuboid Ids: []
>> >> Total scan count: 0
>> >> Result row count: 0
>> >> Accept Partial: true
>> >> Is Partial Result: false
>> >> Hit Cache: true
>> >> Message: Error instantiating JsonCustomSchema(name=ProjectName)
>> >>
>> >>
>> >> 2015-05-13 9:41 GMT+08:00 ShaoFeng Shi <sh...@apache.org>:
>> >>
>> >> > Tao, are you running Kylin on CDH? What's the status of the cubes
>> after
>> >> > "refresh the cube successfully"? Is there any error in kylin.log when
>> >> "can
>> >> > not do the query operation"?
>> >> >
>> >> > 2015-05-12 18:46 GMT+08:00 Tao Wong <wo...@gmail.com>:
>> >> >
>> >> > > BTW:
>> >> > >
>> >> > > after restoring the metadata ,i can resresh the cube successfully.
>> >> > > but with  no tables, i can not do the query operation.
>> >> > >
>> >> > > 2015-05-12 18:38 GMT+08:00 Tao Wong <wo...@gmail.com>:
>> >> > >
>> >> > > > Hi,
>> >> > > > I backup and restore the metadata to do some test.
>> >> > > > The cubes demostrate as expected ,but no tables shows in "Query"
>> >> tap.
>> >> > > >
>> >> > > >
>> >> > > >
>> >> > >
>> >> >
>> >>
>> >
>> >
>>
>
>

Re: No table shows after restoring the metadata

Posted by Tao Wong <wo...@gmail.com>.

YES.Also CDH env.but its version is 5.3.X
we are cautious with restore operation as the machines deploied CDH 5.3.X
are on-line.

2015-05-13 10:44 GMT+08:00 ShaoFeng Shi <sh...@apache.org>:

> BTW, which env did you migrate the metadata/cubes to this CDH env? Is it
> also CDH or other hadoop env? Does it have the same issue there?
>
> 2015-05-13 10:43 GMT+08:00 ShaoFeng Shi <sh...@apache.org>:
>
> > okay get it; please watch
> https://issues.apache.org/jira/browse/KYLIN-761
> > for any update; I'm setting up a CDH environment to check this.
> >
> > 2015-05-13 10:39 GMT+08:00 Tao Wong <wo...@gmail.com>:
> >
> >> *are you running Kylin on CDH? *
> >> YES. we are running kylin on CDH 5.4.x
> >>
> >> *What's the status of the cubes after "refresh the cube successfully" ?*
> >> actually,i backup the metadata from one kylin system and restore it on
> >> another one.
> >> after i restore the metadata,the status of cubes in the "Cubes" Tab are
> >> all
> >> "READY".
> >> refresh does not change its status.
> >>
> >> * Is there any error in kylin.log when "can not do the query
> operation"?*
> >>
> >> User: ADMIN
> >> Success: false
> >> Duration: 0.001
> >> Project: ProjectName
> >> Realization Names: []
> >> Cuboid Ids: []
> >> Total scan count: 0
> >> Result row count: 0
> >> Accept Partial: true
> >> Is Partial Result: false
> >> Hit Cache: true
> >> Message: Error instantiating JsonCustomSchema(name=ProjectName)
> >>
> >>
> >> 2015-05-13 9:41 GMT+08:00 ShaoFeng Shi <sh...@apache.org>:
> >>
> >> > Tao, are you running Kylin on CDH? What's the status of the cubes
> after
> >> > "refresh the cube successfully"? Is there any error in kylin.log when
> >> "can
> >> > not do the query operation"?
> >> >
> >> > 2015-05-12 18:46 GMT+08:00 Tao Wong <wo...@gmail.com>:
> >> >
> >> > > BTW:
> >> > >
> >> > > after restoring the metadata ,i can resresh the cube successfully.
> >> > > but with  no tables, i can not do the query operation.
> >> > >
> >> > > 2015-05-12 18:38 GMT+08:00 Tao Wong <wo...@gmail.com>:
> >> > >
> >> > > > Hi,
> >> > > > I backup and restore the metadata to do some test.
> >> > > > The cubes demostrate as expected ,but no tables shows in "Query"
> >> tap.
> >> > > >
> >> > > >
> >> > > >
> >> > >
> >> >
> >>
> >
> >
>

Re: No table shows after restoring the metadata

Posted by ShaoFeng Shi <sh...@apache.org>.

BTW, which env did you migrate the metadata/cubes to this CDH env? Is it
also CDH or other hadoop env? Does it have the same issue there?

2015-05-13 10:43 GMT+08:00 ShaoFeng Shi <sh...@apache.org>:

> okay get it; please watch https://issues.apache.org/jira/browse/KYLIN-761
> for any update; I'm setting up a CDH environment to check this.
>
> 2015-05-13 10:39 GMT+08:00 Tao Wong <wo...@gmail.com>:
>
>> *are you running Kylin on CDH? *
>> YES. we are running kylin on CDH 5.4.x
>>
>> *What's the status of the cubes after "refresh the cube successfully" ?*
>> actually,i backup the metadata from one kylin system and restore it on
>> another one.
>> after i restore the metadata,the status of cubes in the "Cubes" Tab are
>> all
>> "READY".
>> refresh does not change its status.
>>
>> * Is there any error in kylin.log when "can not do the query operation"?*
>>
>> User: ADMIN
>> Success: false
>> Duration: 0.001
>> Project: ProjectName
>> Realization Names: []
>> Cuboid Ids: []
>> Total scan count: 0
>> Result row count: 0
>> Accept Partial: true
>> Is Partial Result: false
>> Hit Cache: true
>> Message: Error instantiating JsonCustomSchema(name=ProjectName)
>>
>>
>> 2015-05-13 9:41 GMT+08:00 ShaoFeng Shi <sh...@apache.org>:
>>
>> > Tao, are you running Kylin on CDH? What's the status of the cubes after
>> > "refresh the cube successfully"? Is there any error in kylin.log when
>> "can
>> > not do the query operation"?
>> >
>> > 2015-05-12 18:46 GMT+08:00 Tao Wong <wo...@gmail.com>:
>> >
>> > > BTW:
>> > >
>> > > after restoring the metadata ,i can resresh the cube successfully.
>> > > but with  no tables, i can not do the query operation.
>> > >
>> > > 2015-05-12 18:38 GMT+08:00 Tao Wong <wo...@gmail.com>:
>> > >
>> > > > Hi,
>> > > > I backup and restore the metadata to do some test.
>> > > > The cubes demostrate as expected ,but no tables shows in "Query"
>> tap.
>> > > >
>> > > >
>> > > >
>> > >
>> >
>>
>
>

Re: No table shows after restoring the metadata

Posted by ShaoFeng Shi <sh...@apache.org>.

okay get it; please watch https://issues.apache.org/jira/browse/KYLIN-761
for any update; I'm setting up a CDH environment to check this.

2015-05-13 10:39 GMT+08:00 Tao Wong <wo...@gmail.com>:

> *are you running Kylin on CDH? *
> YES. we are running kylin on CDH 5.4.x
>
> *What's the status of the cubes after "refresh the cube successfully" ?*
> actually,i backup the metadata from one kylin system and restore it on
> another one.
> after i restore the metadata,the status of cubes in the "Cubes" Tab are all
> "READY".
> refresh does not change its status.
>
> * Is there any error in kylin.log when "can not do the query operation"?*
>
> User: ADMIN
> Success: false
> Duration: 0.001
> Project: ProjectName
> Realization Names: []
> Cuboid Ids: []
> Total scan count: 0
> Result row count: 0
> Accept Partial: true
> Is Partial Result: false
> Hit Cache: true
> Message: Error instantiating JsonCustomSchema(name=ProjectName)
>
>
> 2015-05-13 9:41 GMT+08:00 ShaoFeng Shi <sh...@apache.org>:
>
> > Tao, are you running Kylin on CDH? What's the status of the cubes after
> > "refresh the cube successfully"? Is there any error in kylin.log when
> "can
> > not do the query operation"?
> >
> > 2015-05-12 18:46 GMT+08:00 Tao Wong <wo...@gmail.com>:
> >
> > > BTW:
> > >
> > > after restoring the metadata ,i can resresh the cube successfully.
> > > but with  no tables, i can not do the query operation.
> > >
> > > 2015-05-12 18:38 GMT+08:00 Tao Wong <wo...@gmail.com>:
> > >
> > > > Hi,
> > > > I backup and restore the metadata to do some test.
> > > > The cubes demostrate as expected ,but no tables shows in "Query" tap.
> > > >
> > > >
> > > >
> > >
> >
>

Re: No table shows after restoring the metadata

Posted by Tao Wong <wo...@gmail.com>.

*are you running Kylin on CDH? *
YES. we are running kylin on CDH 5.4.x

*What's the status of the cubes after "refresh the cube successfully" ?*
actually,i backup the metadata from one kylin system and restore it on
another one.
after i restore the metadata,the status of cubes in the "Cubes" Tab are all
"READY".
refresh does not change its status.

* Is there any error in kylin.log when "can not do the query operation"?*

User: ADMIN
Success: false
Duration: 0.001
Project: ProjectName
Realization Names: []
Cuboid Ids: []
Total scan count: 0
Result row count: 0
Accept Partial: true
Is Partial Result: false
Hit Cache: true
Message: Error instantiating JsonCustomSchema(name=ProjectName)


2015-05-13 9:41 GMT+08:00 ShaoFeng Shi <sh...@apache.org>:

> Tao, are you running Kylin on CDH? What's the status of the cubes after
> "refresh the cube successfully"? Is there any error in kylin.log when "can
> not do the query operation"?
>
> 2015-05-12 18:46 GMT+08:00 Tao Wong <wo...@gmail.com>:
>
> > BTW:
> >
> > after restoring the metadata ,i can resresh the cube successfully.
> > but with  no tables, i can not do the query operation.
> >
> > 2015-05-12 18:38 GMT+08:00 Tao Wong <wo...@gmail.com>:
> >
> > > Hi,
> > > I backup and restore the metadata to do some test.
> > > The cubes demostrate as expected ,but no tables shows in "Query" tap.
> > >
> > >
> > >
> >
>

Re: No table shows after restoring the metadata

Posted by ShaoFeng Shi <sh...@apache.org>.

Tao, are you running Kylin on CDH? What's the status of the cubes after
"refresh the cube successfully"? Is there any error in kylin.log when "can
not do the query operation"?

2015-05-12 18:46 GMT+08:00 Tao Wong <wo...@gmail.com>:

> BTW:
>
> after restoring the metadata ,i can resresh the cube successfully.
> but with  no tables, i can not do the query operation.
>
> 2015-05-12 18:38 GMT+08:00 Tao Wong <wo...@gmail.com>:
>
> > Hi,
> > I backup and restore the metadata to do some test.
> > The cubes demostrate as expected ,but no tables shows in "Query" tap.
> >
> >
> >
>

Re: No table shows after restoring the metadata

Posted by Tao Wong <wo...@gmail.com>.

BTW:

after restoring the metadata ,i can resresh the cube successfully.
but with  no tables, i can not do the query operation.

2015-05-12 18:38 GMT+08:00 Tao Wong <wo...@gmail.com>:

> Hi,
> I backup and restore the metadata to do some test.
> The cubes demostrate as expected ,but no tables shows in "Query" tap.
>
>
>