You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by 谁主沉浮 <83...@qq.com> on 2017/09/15 03:54:24 UTC
[KYLIN-1668] - Rowkey column shouldn’t allow delete and add
[KYLIN-1668] - Rowkey column shouldn’t allow delete and add
Kylin new version 2.1, this problem still exists，cannot delete
回复： [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
Posted by 谁主沉浮 <83...@qq.com>.
Thanks
------------------ 原始邮件 ------------------
发件人: "Billy Liu";<bi...@apache.org>;
发送时间: 2017年9月15日(星期五) 晚上6:32
收件人: "dev"<de...@kylin.apache.org>;
主题: Re: [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
1. Use Derived Dimension will reduce the number of rowkey, but also may
hurt the query performance.
2. Increase the threshold of the HBase region size,
# The cut size for hbase region, in GB.
kylin.storage.hbase.region-cut-gb=5
3. Split the large cube into two small cubes according to your query
patterns.
2017-09-15 14:28 GMT+08:00 谁主沉浮 <83...@qq.com>:
> We have more dimensions, and can reach more than 20, so the number of
> region will be much larger, and rowkey also accounts for a lot, so how to
> reduce the HBase region count?
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "Billy Liu";<bi...@apache.org>;
> 发送时间: 2017年9月15日(星期五) 下午2:24
> 收件人: "dev"<de...@kylin.apache.org>;
>
> 主题: Re: [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
>
>
>
> Rowkey is the physical format of dimensions.
>
> 2017-09-15 12:55 GMT+08:00 谁主沉浮 <83...@qq.com>:
>
> > If you don't want to delete the dimension, how do you delete some rowkey?
> >
> >
> > ------------------ 原始邮件 ------------------
> > 发件人: "Billy Liu";<bi...@apache.org>;
> > 发送时间: 2017年9月15日(星期五) 中午12:51
> > 收件人: "dev"<de...@kylin.apache.org>;
> >
> > 主题: Re: [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
> >
> >
> >
> > Rowkey is generated by the chosen dimensions. If you want to remove some
> > rowkey, remove the dimension will work.
> >
> > 2017-09-15 11:54 GMT+08:00 谁主沉浮 <83...@qq.com>:
> >
> > > [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
> > > Kylin new version 2.1, this problem still exists，cannot delete
> >
>
Re: [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
Posted by Billy Liu <bi...@apache.org>.
1. Use Derived Dimension will reduce the number of rowkey, but also may
hurt the query performance.
2. Increase the threshold of the HBase region size,
# The cut size for hbase region, in GB.
kylin.storage.hbase.region-cut-gb=5
3. Split the large cube into two small cubes according to your query
patterns.
2017-09-15 14:28 GMT+08:00 谁主沉浮 <83...@qq.com>:
> We have more dimensions, and can reach more than 20, so the number of
> region will be much larger, and rowkey also accounts for a lot, so how to
> reduce the HBase region count?
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "Billy Liu";<bi...@apache.org>;
> 发送时间: 2017年9月15日(星期五) 下午2:24
> 收件人: "dev"<de...@kylin.apache.org>;
>
> 主题: Re: [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
>
>
>
> Rowkey is the physical format of dimensions.
>
> 2017-09-15 12:55 GMT+08:00 谁主沉浮 <83...@qq.com>:
>
> > If you don't want to delete the dimension, how do you delete some rowkey?
> >
> >
> > ------------------ 原始邮件 ------------------
> > 发件人: "Billy Liu";<bi...@apache.org>;
> > 发送时间: 2017年9月15日(星期五) 中午12:51
> > 收件人: "dev"<de...@kylin.apache.org>;
> >
> > 主题: Re: [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
> >
> >
> >
> > Rowkey is generated by the chosen dimensions. If you want to remove some
> > rowkey, remove the dimension will work.
> >
> > 2017-09-15 11:54 GMT+08:00 谁主沉浮 <83...@qq.com>:
> >
> > > [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
> > > Kylin new version 2.1, this problem still exists，cannot delete
> >
>
回复： [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
Posted by 谁主沉浮 <83...@qq.com>.
We have more dimensions, and can reach more than 20, so the number of region will be much larger, and rowkey also accounts for a lot, so how to reduce the HBase region count?
------------------ 原始邮件 ------------------
发件人: "Billy Liu";<bi...@apache.org>;
发送时间: 2017年9月15日(星期五) 下午2:24
收件人: "dev"<de...@kylin.apache.org>;
主题: Re: [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
Rowkey is the physical format of dimensions.
2017-09-15 12:55 GMT+08:00 谁主沉浮 <83...@qq.com>:
> If you don't want to delete the dimension, how do you delete some rowkey?
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "Billy Liu";<bi...@apache.org>;
> 发送时间: 2017年9月15日(星期五) 中午12:51
> 收件人: "dev"<de...@kylin.apache.org>;
>
> 主题: Re: [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
>
>
>
> Rowkey is generated by the chosen dimensions. If you want to remove some
> rowkey, remove the dimension will work.
>
> 2017-09-15 11:54 GMT+08:00 谁主沉浮 <83...@qq.com>:
>
> > [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
> > Kylin new version 2.1, this problem still exists，cannot delete
>
Re: [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
Posted by Billy Liu <bi...@apache.org>.
Rowkey is the physical format of dimensions.
2017-09-15 12:55 GMT+08:00 谁主沉浮 <83...@qq.com>:
> If you don't want to delete the dimension, how do you delete some rowkey?
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "Billy Liu";<bi...@apache.org>;
> 发送时间: 2017年9月15日(星期五) 中午12:51
> 收件人: "dev"<de...@kylin.apache.org>;
>
> 主题: Re: [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
>
>
>
> Rowkey is generated by the chosen dimensions. If you want to remove some
> rowkey, remove the dimension will work.
>
> 2017-09-15 11:54 GMT+08:00 谁主沉浮 <83...@qq.com>:
>
> > [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
> > Kylin new version 2.1, this problem still exists，cannot delete
>
回复： [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
Posted by 谁主沉浮 <83...@qq.com>.
If you don't want to delete the dimension, how do you delete some rowkey?
------------------ 原始邮件 ------------------
发件人: "Billy Liu";<bi...@apache.org>;
发送时间: 2017年9月15日(星期五) 中午12:51
收件人: "dev"<de...@kylin.apache.org>;
主题: Re: [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
Rowkey is generated by the chosen dimensions. If you want to remove some
rowkey, remove the dimension will work.
2017-09-15 11:54 GMT+08:00 谁主沉浮 <83...@qq.com>:
> [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
> Kylin new version 2.1, this problem still exists，cannot delete
Re: [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
Posted by Billy Liu <bi...@apache.org>.
Rowkey is generated by the chosen dimensions. If you want to remove some
rowkey, remove the dimension will work.
2017-09-15 11:54 GMT+08:00 谁主沉浮 <83...@qq.com>:
> [KYLIN-1668] - Rowkey column shouldn’t allow delete and add
> Kylin new version 2.1, this problem still exists，cannot delete