You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by 赵天烁 <zh...@meizu.com> on 2016/07/27 07:06:37 UTC
partition Date column can't be bigint?
sometimes our hive table has a unified date column -- stat_date,but it's a bigint ,when I create a model I can't choose that column which is the only date column to be partition date,is it possible to remove this restriction?
________________________________
赵天烁
Kevin Zhao
zhaotianshuo@meizu.com<ma...@meizu.com>
珠海市魅族科技有限公司
MEIZU Technology Co., Ltd.
广东省珠海市科技创新海岸魅族科技楼
MEIZU Tech Bldg., Technology & Innovation Coast
Zhuhai, 519085, Guangdong, China
meizu.com
Re: Re: partition Date column can't be bigint?
Posted by 赵天烁 <zh...@meizu.com>.
ok,got it
________________________________
赵天烁
Kevin Zhao
zhaotianshuo@meizu.com<ma...@meizu.com>
珠海市魅族科技有限公司
MEIZU Technology Co., Ltd.
广东省珠海市科技创新海岸魅族科技楼
MEIZU Tech Bldg., Technology & Innovation Coast
Zhuhai, 519085, Guangdong, China
meizu.com
From: ShaoFeng Shi<ma...@apache.org>
Date: 2016-07-29 11:44
To: 赵天烁<ma...@meizu.com>
CC: user<ma...@kylin.apache.org>
Subject: Re: Re: partition Date column can't be bigint?
https://kylin.apache.org/docs15/howto/howto_backup_metadata.html
2016-07-29 11:19 GMT+08:00 赵天烁 <zh...@meizu.com>>:
ok,I'll have a try, how to manually modify cube definition?
________________________________
赵天烁
Kevin Zhao
zhaotianshuo@meizu.com<ma...@meizu.com>
珠海市魅族科技有限公司
MEIZU Technology Co., Ltd.
广东省珠海市科技创新海岸魅族科技楼
MEIZU Tech Bldg., Technology & Innovation Coast
Zhuhai, 519085, Guangdong, China
meizu.com<http://meizu.com>
From: ShaoFeng Shi<ma...@apache.org>
Date: 2016-07-29 10:47
To: 赵天烁<ma...@meizu.com>
CC: user<ma...@kylin.apache.org>
Subject: Re: Re: partition Date column can't be bigint?
Not a tool, but an extension point, which you can implement your own logic for the partition condition, check the interface IPartitionConditionBuilder in PartitionDesc.java. And also you need manully modify the cube definition; You can have a try if you have to do so.
2016-07-28 14:24 GMT+08:00 赵天烁 <zh...@meizu.com>>:
yes,exactly.
so as far as I could tell,there will be a configure tools to fit different date column types right?
________________________________
赵天烁
Kevin Zhao
zhaotianshuo@meizu.com<ma...@meizu.com>
珠海市魅族科技有限公司
MEIZU Technology Co., Ltd.
广东省珠海市科技创新海岸魅族科技楼
MEIZU Tech Bldg., Technology & Innovation Coast
Zhuhai, 519085, Guangdong, China
meizu.com<http://meizu.com>
From: ShaoFeng Shi<ma...@apache.org>
Date: 2016-07-28 14:16
To: user@kylin.apache.org<ma...@kylin.apache.org>
Subject: Re: partition Date column can't be bigint?
Hi Tianshuo, is this JIRA matching your question? https://issues.apache.org/jira/browse/KYLIN-1698
2016-07-27 15:06 GMT+08:00 赵天烁 <zh...@meizu.com>>:
sometimes our hive table has a unified date column -- stat_date,but it's a bigint ,when I create a model I can't choose that column which is the only date column to be partition date,is it possible to remove this restriction?
________________________________
赵天烁
Kevin Zhao
zhaotianshuo@meizu.com<ma...@meizu.com>
珠海市魅族科技有限公司
MEIZU Technology Co., Ltd.
广东省珠海市科技创新海岸魅族科技楼
MEIZU Tech Bldg., Technology & Innovation Coast
Zhuhai, 519085, Guangdong, China
meizu.com<http://meizu.com>
--
Best regards,
Shaofeng Shi
--
Best regards,
Shaofeng Shi
--
Best regards,
Shaofeng Shi
Re: Re: partition Date column can't be bigint?
Posted by ShaoFeng Shi <sh...@apache.org>.
https://kylin.apache.org/docs15/howto/howto_backup_metadata.html
2016-07-29 11:19 GMT+08:00 赵天烁 <zh...@meizu.com>:
> ok,I'll have a try, how to manually modify cube definition?
>
> ------------------------------
>
> 赵天烁
>
> Kevin Zhao
>
> *zhaotianshuo@meizu.com <zh...@meizu.com>*
>
>
>
> 珠海市魅族科技有限公司
>
> MEIZU Technology Co., Ltd.
>
> 广东省珠海市科技创新海岸魅族科技楼
>
> MEIZU Tech Bldg., Technology & Innovation Coast
>
> Zhuhai, 519085, Guangdong, China
>
> meizu.com
>
>
> *From:* ShaoFeng Shi <sh...@apache.org>
> *Date:* 2016-07-29 10:47
> *To:* 赵天烁 <zh...@meizu.com>
> *CC:* user <us...@kylin.apache.org>
> *Subject:* Re: Re: partition Date column can't be bigint?
> Not a tool, but an extension point, which you can implement your own logic
> for the partition condition, check the interface
> IPartitionConditionBuilder in PartitionDesc.java. And also you need
> manully modify the cube definition; You can have a try if you have to do so.
>
> 2016-07-28 14:24 GMT+08:00 赵天烁 <zh...@meizu.com>:
>
>> yes,exactly.
>> so as far as I could tell,there will be a configure tools to fit
>> different date column types right?
>>
>> ------------------------------
>>
>> 赵天烁
>>
>> Kevin Zhao
>>
>> *zhaotianshuo@meizu.com <zh...@meizu.com>*
>>
>>
>>
>> 珠海市魅族科技有限公司
>>
>> MEIZU Technology Co., Ltd.
>>
>> 广东省珠海市科技创新海岸魅族科技楼
>>
>> MEIZU Tech Bldg., Technology & Innovation Coast
>>
>> Zhuhai, 519085, Guangdong, China
>>
>> meizu.com
>>
>>
>> *From:* ShaoFeng Shi <sh...@apache.org>
>> *Date:* 2016-07-28 14:16
>> *To:* user@kylin.apache.org
>> *Subject:* Re: partition Date column can't be bigint?
>> Hi Tianshuo, is this JIRA matching your question?
>> https://issues.apache.org/jira/browse/KYLIN-1698
>>
>> 2016-07-27 15:06 GMT+08:00 赵天烁 <zh...@meizu.com>:
>>
>>> sometimes our hive table has a unified date column -- stat_date,but it's
>>> a bigint ,when I create a model I can't choose that column which is the
>>> only date column to be partition date,is it possible to remove this
>>> restriction?
>>>
>>> ------------------------------
>>>
>>> 赵天烁
>>>
>>> Kevin Zhao
>>>
>>> *zhaotianshuo@meizu.com <zh...@meizu.com>*
>>>
>>>
>>>
>>> 珠海市魅族科技有限公司
>>>
>>> MEIZU Technology Co., Ltd.
>>>
>>> 广东省珠海市科技创新海岸魅族科技楼
>>>
>>> MEIZU Tech Bldg., Technology & Innovation Coast
>>>
>>> Zhuhai, 519085, Guangdong, China
>>>
>>> meizu.com
>>>
>>
>>
>>
>> --
>> Best regards,
>>
>> Shaofeng Shi
>>
>>
>
>
> --
> Best regards,
>
> Shaofeng Shi
>
>
--
Best regards,
Shaofeng Shi
Re: Re: partition Date column can't be bigint?
Posted by 赵天烁 <zh...@meizu.com>.
ok,I'll have a try, how to manually modify cube definition?
________________________________
赵天烁
Kevin Zhao
zhaotianshuo@meizu.com<ma...@meizu.com>
珠海市魅族科技有限公司
MEIZU Technology Co., Ltd.
广东省珠海市科技创新海岸魅族科技楼
MEIZU Tech Bldg., Technology & Innovation Coast
Zhuhai, 519085, Guangdong, China
meizu.com
From: ShaoFeng Shi<ma...@apache.org>
Date: 2016-07-29 10:47
To: 赵天烁<ma...@meizu.com>
CC: user<ma...@kylin.apache.org>
Subject: Re: Re: partition Date column can't be bigint?
Not a tool, but an extension point, which you can implement your own logic for the partition condition, check the interface IPartitionConditionBuilder in PartitionDesc.java. And also you need manully modify the cube definition; You can have a try if you have to do so.
2016-07-28 14:24 GMT+08:00 赵天烁 <zh...@meizu.com>>:
yes,exactly.
so as far as I could tell,there will be a configure tools to fit different date column types right?
________________________________
赵天烁
Kevin Zhao
zhaotianshuo@meizu.com<ma...@meizu.com>
珠海市魅族科技有限公司
MEIZU Technology Co., Ltd.
广东省珠海市科技创新海岸魅族科技楼
MEIZU Tech Bldg., Technology & Innovation Coast
Zhuhai, 519085, Guangdong, China
meizu.com<http://meizu.com>
From: ShaoFeng Shi<ma...@apache.org>
Date: 2016-07-28 14:16
To: user@kylin.apache.org<ma...@kylin.apache.org>
Subject: Re: partition Date column can't be bigint?
Hi Tianshuo, is this JIRA matching your question? https://issues.apache.org/jira/browse/KYLIN-1698
2016-07-27 15:06 GMT+08:00 赵天烁 <zh...@meizu.com>>:
sometimes our hive table has a unified date column -- stat_date,but it's a bigint ,when I create a model I can't choose that column which is the only date column to be partition date,is it possible to remove this restriction?
________________________________
赵天烁
Kevin Zhao
zhaotianshuo@meizu.com<ma...@meizu.com>
珠海市魅族科技有限公司
MEIZU Technology Co., Ltd.
广东省珠海市科技创新海岸魅族科技楼
MEIZU Tech Bldg., Technology & Innovation Coast
Zhuhai, 519085, Guangdong, China
meizu.com<http://meizu.com>
--
Best regards,
Shaofeng Shi
--
Best regards,
Shaofeng Shi
Re: Re: partition Date column can't be bigint?
Posted by ShaoFeng Shi <sh...@apache.org>.
Not a tool, but an extension point, which you can implement your own logic
for the partition condition, check the interface IPartitionConditionBuilder in
PartitionDesc.java. And also you need manully modify the cube definition;
You can have a try if you have to do so.
2016-07-28 14:24 GMT+08:00 赵天烁 <zh...@meizu.com>:
> yes,exactly.
> so as far as I could tell,there will be a configure tools to fit different
> date column types right?
>
> ------------------------------
>
> 赵天烁
>
> Kevin Zhao
>
> *zhaotianshuo@meizu.com <zh...@meizu.com>*
>
>
>
> 珠海市魅族科技有限公司
>
> MEIZU Technology Co., Ltd.
>
> 广东省珠海市科技创新海岸魅族科技楼
>
> MEIZU Tech Bldg., Technology & Innovation Coast
>
> Zhuhai, 519085, Guangdong, China
>
> meizu.com
>
>
> *From:* ShaoFeng Shi <sh...@apache.org>
> *Date:* 2016-07-28 14:16
> *To:* user@kylin.apache.org
> *Subject:* Re: partition Date column can't be bigint?
> Hi Tianshuo, is this JIRA matching your question?
> https://issues.apache.org/jira/browse/KYLIN-1698
>
> 2016-07-27 15:06 GMT+08:00 赵天烁 <zh...@meizu.com>:
>
>> sometimes our hive table has a unified date column -- stat_date,but it's
>> a bigint ,when I create a model I can't choose that column which is the
>> only date column to be partition date,is it possible to remove this
>> restriction?
>>
>> ------------------------------
>>
>> 赵天烁
>>
>> Kevin Zhao
>>
>> *zhaotianshuo@meizu.com <zh...@meizu.com>*
>>
>>
>>
>> 珠海市魅族科技有限公司
>>
>> MEIZU Technology Co., Ltd.
>>
>> 广东省珠海市科技创新海岸魅族科技楼
>>
>> MEIZU Tech Bldg., Technology & Innovation Coast
>>
>> Zhuhai, 519085, Guangdong, China
>>
>> meizu.com
>>
>
>
>
> --
> Best regards,
>
> Shaofeng Shi
>
>
--
Best regards,
Shaofeng Shi
Re: Re: partition Date column can't be bigint?
Posted by 赵天烁 <zh...@meizu.com>.
yes,exactly.
so as far as I could tell,there will be a configure tools to fit different date column types right?
________________________________
赵天烁
Kevin Zhao
zhaotianshuo@meizu.com<ma...@meizu.com>
珠海市魅族科技有限公司
MEIZU Technology Co., Ltd.
广东省珠海市科技创新海岸魅族科技楼
MEIZU Tech Bldg., Technology & Innovation Coast
Zhuhai, 519085, Guangdong, China
meizu.com
From: ShaoFeng Shi<ma...@apache.org>
Date: 2016-07-28 14:16
To: user@kylin.apache.org<ma...@kylin.apache.org>
Subject: Re: partition Date column can't be bigint?
Hi Tianshuo, is this JIRA matching your question? https://issues.apache.org/jira/browse/KYLIN-1698
2016-07-27 15:06 GMT+08:00 赵天烁 <zh...@meizu.com>>:
sometimes our hive table has a unified date column -- stat_date,but it's a bigint ,when I create a model I can't choose that column which is the only date column to be partition date,is it possible to remove this restriction?
________________________________
赵天烁
Kevin Zhao
zhaotianshuo@meizu.com<ma...@meizu.com>
珠海市魅族科技有限公司
MEIZU Technology Co., Ltd.
广东省珠海市科技创新海岸魅族科技楼
MEIZU Tech Bldg., Technology & Innovation Coast
Zhuhai, 519085, Guangdong, China
meizu.com<http://meizu.com>
--
Best regards,
Shaofeng Shi
Re: partition Date column can't be bigint?
Posted by ShaoFeng Shi <sh...@apache.org>.
Hi Tianshuo, is this JIRA matching your question?
https://issues.apache.org/jira/browse/KYLIN-1698
2016-07-27 15:06 GMT+08:00 赵天烁 <zh...@meizu.com>:
> sometimes our hive table has a unified date column -- stat_date,but it's a
> bigint ,when I create a model I can't choose that column which is the only
> date column to be partition date,is it possible to remove this restriction?
>
> ------------------------------
>
> 赵天烁
>
> Kevin Zhao
>
> *zhaotianshuo@meizu.com <zh...@meizu.com>*
>
>
>
> 珠海市魅族科技有限公司
>
> MEIZU Technology Co., Ltd.
>
> 广东省珠海市科技创新海岸魅族科技楼
>
> MEIZU Tech Bldg., Technology & Innovation Coast
>
> Zhuhai, 519085, Guangdong, China
>
> meizu.com
>
--
Best regards,
Shaofeng Shi