You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by "446463844@qq.com" <44...@qq.com> on 2017/01/05 05:12:57 UTC
java.lang.IllegalStateException: GlobalDict /dict/tableName/column should have 0 or 1 append dict but 2! - in Step 4 - Build Dimension Dictionary
Hi all:
I Meet a problem when I build a cube
java.lang.IllegalStateException: GlobalDict /dict/tableName/column should have 0 or 1 append dict but 2! - in Step 4 - Build Dimension Dictionary
it seems that in Globel Dict have more than one same object In Trie Dictionary .How can I slove this problem.
I had perplexd with this problem :(
446463844@qq.com
Re: Re: java.lang.IllegalStateException: GlobalDict
/dict/tableName/column should have 0 or 1 append dict but 2! - in Step 4 -
Build Dimension Dictionary
Posted by funky <fu...@gmail.com>.
yes ,you are right
to slove this problem must do two things
1.check kylin_metadata "/dict/default.table_name/columns/"
2.check your segement data .filter all key with your need.
compare to this.and delete them to leave one
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/java-lang-IllegalStateException-GlobalDict-dict-tableName-column-should-have-0-or-1-append-dict-but-y-tp6848p7376.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: Re: java.lang.IllegalStateException: GlobalDict
/dict/tableName/column should have 0 or 1 append dict but 2! - in Step 4 -
Build Dimension Dictionary
Posted by Tony Lee <bt...@gmail.com>.
Same problem while i was testing a cube, after i built, purged and dropped
the cube several times.
Inspired by the source code, I scan the hbase *kylin_metadata* table like
this,
scan 'kylin_metadata', {STARTROW=>'/dict/DEFAULT.TABLE_NAME/COLUMN_NAME/',
> ENDROW=>'/dict/DEFAULT.TABLE_NAME/COLUMN_NAME0', FILTER=>"KeyOnlyFilter()"}
and found 2 rows.
After I delete both of them and rebuild the cube, everything is ok
So, i suppose maybe kylin forget to delete these cache when i purged or
dropped the cube?
On Thu, Jan 5, 2017 at 4:04 PM, Billy Liu <bi...@apache.org> wrote:
> My question is if you could reproduce this issue by "Sample Data". The
> "Sample Data" is released together with Apache Kylin. It seems you have
> followed the steps of
> http://kylin.apache.org/blog/2016/08/01/count-distinct-in-kylin/ But we
> do
> not know what's your actual data set?
>
> 2017-01-05 15:53 GMT+08:00 446463844@qq.com <44...@qq.com>:
>
> > Yes . the problem maybe in here
> > .1) In Kylin Measures Settings. I select a column as a count_distinct
> > cloumn and return type is bitmap like this
> > Name Expression Parameters
> > Return Type
> > distinct_key count_distinct value:rowkey,type:column
> > bitmap
> > ps:rowkey is a column in my fact table.
> >
> > .2)In kylin Advanced Settings
> > I select this cloumn as global dictionary .like this:
> > Advanced Dictionaries
> > Column Builder Class
> > rowkey org.apache.kylin.dict.
> > GlobalDictionaryBuilder
> >
> >
> > I do this beacuse in my query sql "select count(distinct(rowkey)) from
> > user_info group by xxxx ".\
> > I don't kown I Whether or not it clearly with my problem ?
> >
> >
> >
> >
> >
> > 446463844@qq.com
> >
> > From: Billy Liu
> > Date: 2017-01-05 15:11
> > To: dev
> > Subject: Re: Re: java.lang.IllegalStateException: GlobalDict
> > /dict/tableName/column should have 0 or 1 append dict but 2! - in Step 4
> -
> > Build Dimension Dictionary
> > So could you reproduce your issue step by steps with sample data？
> >
> > 2017-01-05 14:53 GMT+08:00 446463844@qq.com <44...@qq.com>:
> >
> > > Yes,but it is not work.In kylin webUI console it still throw this
> error
> > > On Build Dimension Dictionary in Step 4.
> > >
> > >
> > >
> > > 446463844@qq.com
> > >
> > > From: Billy Liu
> > > Date: 2017-01-05 14:45
> > > To: dev
> > > Subject: Re: java.lang.IllegalStateException: GlobalDict
> > > /dict/tableName/column should have 0 or 1 append dict but 2! - in Step
> 4
> > -
> > > Build Dimension Dictionary
> > > When you describe some problem, make sure you have all steps to
> reproduce
> > > the issue. Otherwise no one would know what happened. I remembered you
> > > mention that you deleted some files manually on HDFS by yourself in
> some
> > > JIRA.
> > >
> > > 2017-01-05 13:12 GMT+08:00 446463844@qq.com <44...@qq.com>:
> > >
> > > > Hi all:
> > > > I Meet a problem when I build a cube
> > > > java.lang.IllegalStateException: GlobalDict /dict/tableName/column
> > > > should have 0 or 1 append dict but 2! - in Step 4 - Build Dimension
> > > > Dictionary
> > > >
> > > > it seems that in Globel Dict have more than one same object In Trie
> > > > Dictionary .How can I slove this problem.
> > > > I had perplexd with this problem :(
> > > >
> > > >
> > > >
> > > >
> > > > 446463844@qq.com
> > > >
> > >
> >
>
Re: Re: java.lang.IllegalStateException: GlobalDict
/dict/tableName/column should have 0 or 1 append dict but 2! - in Step 4 -
Build Dimension Dictionary
Posted by Billy Liu <bi...@apache.org>.
My question is if you could reproduce this issue by "Sample Data". The
"Sample Data" is released together with Apache Kylin. It seems you have
followed the steps of
http://kylin.apache.org/blog/2016/08/01/count-distinct-in-kylin/ But we do
not know what's your actual data set?
2017-01-05 15:53 GMT+08:00 446463844@qq.com <44...@qq.com>:
> Yes . the problem maybe in here
> .1) In Kylin Measures Settings. I select a column as a count_distinct
> cloumn and return type is bitmap like this
> Name Expression Parameters
> Return Type
> distinct_key count_distinct value:rowkey,type:column
> bitmap
> ps:rowkey is a column in my fact table.
>
> .2)In kylin Advanced Settings
> I select this cloumn as global dictionary .like this:
> Advanced Dictionaries
> Column Builder Class
> rowkey org.apache.kylin.dict.
> GlobalDictionaryBuilder
>
>
> I do this beacuse in my query sql "select count(distinct(rowkey)) from
> user_info group by xxxx ".\
> I don't kown I Whether or not it clearly with my problem ?
>
>
>
>
>
> 446463844@qq.com
>
> From: Billy Liu
> Date: 2017-01-05 15:11
> To: dev
> Subject: Re: Re: java.lang.IllegalStateException: GlobalDict
> /dict/tableName/column should have 0 or 1 append dict but 2! - in Step 4 -
> Build Dimension Dictionary
> So could you reproduce your issue step by steps with sample data？
>
> 2017-01-05 14:53 GMT+08:00 446463844@qq.com <44...@qq.com>:
>
> > Yes,but it is not work.In kylin webUI console it still throw this error
> > On Build Dimension Dictionary in Step 4.
> >
> >
> >
> > 446463844@qq.com
> >
> > From: Billy Liu
> > Date: 2017-01-05 14:45
> > To: dev
> > Subject: Re: java.lang.IllegalStateException: GlobalDict
> > /dict/tableName/column should have 0 or 1 append dict but 2! - in Step 4
> -
> > Build Dimension Dictionary
> > When you describe some problem, make sure you have all steps to reproduce
> > the issue. Otherwise no one would know what happened. I remembered you
> > mention that you deleted some files manually on HDFS by yourself in some
> > JIRA.
> >
> > 2017-01-05 13:12 GMT+08:00 446463844@qq.com <44...@qq.com>:
> >
> > > Hi all:
> > > I Meet a problem when I build a cube
> > > java.lang.IllegalStateException: GlobalDict /dict/tableName/column
> > > should have 0 or 1 append dict but 2! - in Step 4 - Build Dimension
> > > Dictionary
> > >
> > > it seems that in Globel Dict have more than one same object In Trie
> > > Dictionary .How can I slove this problem.
> > > I had perplexd with this problem :(
> > >
> > >
> > >
> > >
> > > 446463844@qq.com
> > >
> >
>
Re: Re: java.lang.IllegalStateException: GlobalDict /dict/tableName/column should have 0 or 1 append dict but 2! - in Step 4 - Build Dimension Dictionary
Posted by "446463844@qq.com" <44...@qq.com>.
Yes . the problem maybe in here
.1) In Kylin Measures Settings. I select a column as a count_distinct cloumn and return type is bitmap like this
Name Expression Parameters Return Type
distinct_key count_distinct value:rowkey,type:column bitmap
ps:rowkey is a column in my fact table.
.2)In kylin Advanced Settings
I select this cloumn as global dictionary .like this:
Advanced Dictionaries
Column Builder Class
rowkey org.apache.kylin.dict.GlobalDictionaryBuilder
I do this beacuse in my query sql "select count(distinct(rowkey)) from user_info group by xxxx ".\
I don't kown I Whether or not it clearly with my problem ?
446463844@qq.com
From: Billy Liu
Date: 2017-01-05 15:11
To: dev
Subject: Re: Re: java.lang.IllegalStateException: GlobalDict /dict/tableName/column should have 0 or 1 append dict but 2! - in Step 4 - Build Dimension Dictionary
So could you reproduce your issue step by steps with sample data？
2017-01-05 14:53 GMT+08:00 446463844@qq.com <44...@qq.com>:
> Yes,but it is not work.In kylin webUI console it still throw this error
> On Build Dimension Dictionary in Step 4.
>
>
>
> 446463844@qq.com
>
> From: Billy Liu
> Date: 2017-01-05 14:45
> To: dev
> Subject: Re: java.lang.IllegalStateException: GlobalDict
> /dict/tableName/column should have 0 or 1 append dict but 2! - in Step 4 -
> Build Dimension Dictionary
> When you describe some problem, make sure you have all steps to reproduce
> the issue. Otherwise no one would know what happened. I remembered you
> mention that you deleted some files manually on HDFS by yourself in some
> JIRA.
>
> 2017-01-05 13:12 GMT+08:00 446463844@qq.com <44...@qq.com>:
>
> > Hi all:
> > I Meet a problem when I build a cube
> > java.lang.IllegalStateException: GlobalDict /dict/tableName/column
> > should have 0 or 1 append dict but 2! - in Step 4 - Build Dimension
> > Dictionary
> >
> > it seems that in Globel Dict have more than one same object In Trie
> > Dictionary .How can I slove this problem.
> > I had perplexd with this problem :(
> >
> >
> >
> >
> > 446463844@qq.com
> >
>
Re: Re: java.lang.IllegalStateException: GlobalDict
/dict/tableName/column should have 0 or 1 append dict but 2! - in Step 4 -
Build Dimension Dictionary
Posted by Billy Liu <bi...@apache.org>.
So could you reproduce your issue step by steps with sample data？
2017-01-05 14:53 GMT+08:00 446463844@qq.com <44...@qq.com>:
> Yes,but it is not work.In kylin webUI console it still throw this error
> On Build Dimension Dictionary in Step 4.
>
>
>
> 446463844@qq.com
>
> From: Billy Liu
> Date: 2017-01-05 14:45
> To: dev
> Subject: Re: java.lang.IllegalStateException: GlobalDict
> /dict/tableName/column should have 0 or 1 append dict but 2! - in Step 4 -
> Build Dimension Dictionary
> When you describe some problem, make sure you have all steps to reproduce
> the issue. Otherwise no one would know what happened. I remembered you
> mention that you deleted some files manually on HDFS by yourself in some
> JIRA.
>
> 2017-01-05 13:12 GMT+08:00 446463844@qq.com <44...@qq.com>:
>
> > Hi all:
> > I Meet a problem when I build a cube
> > java.lang.IllegalStateException: GlobalDict /dict/tableName/column
> > should have 0 or 1 append dict but 2! - in Step 4 - Build Dimension
> > Dictionary
> >
> > it seems that in Globel Dict have more than one same object In Trie
> > Dictionary .How can I slove this problem.
> > I had perplexd with this problem :(
> >
> >
> >
> >
> > 446463844@qq.com
> >
>
Re: Re: java.lang.IllegalStateException: GlobalDict /dict/tableName/column should have 0 or 1 append dict but 2! - in Step 4 - Build Dimension Dictionary
Posted by "446463844@qq.com" <44...@qq.com>.
Yes,but it is not work.In kylin webUI console it still throw this error On Build Dimension Dictionary in Step 4.
446463844@qq.com
From: Billy Liu
Date: 2017-01-05 14:45
To: dev
Subject: Re: java.lang.IllegalStateException: GlobalDict /dict/tableName/column should have 0 or 1 append dict but 2! - in Step 4 - Build Dimension Dictionary
When you describe some problem, make sure you have all steps to reproduce
the issue. Otherwise no one would know what happened. I remembered you
mention that you deleted some files manually on HDFS by yourself in some
JIRA.
2017-01-05 13:12 GMT+08:00 446463844@qq.com <44...@qq.com>:
> Hi all:
> I Meet a problem when I build a cube
> java.lang.IllegalStateException: GlobalDict /dict/tableName/column
> should have 0 or 1 append dict but 2! - in Step 4 - Build Dimension
> Dictionary
>
> it seems that in Globel Dict have more than one same object In Trie
> Dictionary .How can I slove this problem.
> I had perplexd with this problem :(
>
>
>
>
> 446463844@qq.com
>
Re: java.lang.IllegalStateException: GlobalDict /dict/tableName/column
should have 0 or 1 append dict but 2! - in Step 4 - Build Dimension Dictionary
Posted by Billy Liu <bi...@apache.org>.
When you describe some problem, make sure you have all steps to reproduce
the issue. Otherwise no one would know what happened. I remembered you
mention that you deleted some files manually on HDFS by yourself in some
JIRA.
2017-01-05 13:12 GMT+08:00 446463844@qq.com <44...@qq.com>:
> Hi all:
> I Meet a problem when I build a cube
> java.lang.IllegalStateException: GlobalDict /dict/tableName/column
> should have 0 or 1 append dict but 2! - in Step 4 - Build Dimension
> Dictionary
>
> it seems that in Globel Dict have more than one same object In Trie
> Dictionary .How can I slove this problem.
> I had perplexd with this problem :(
>
>
>
>
> 446463844@qq.com
>