You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by deva namaste <oh...@gmail.com> on 2018/07/27 19:58:45 UTC
Date with hhmi
Hello,
I do have fact table with date column where dates are in this format
"YYYY-MM-DD" ( e.g. 2016-01-01). The same fact table is joined with date
dimension table same format column (and the other columns are year_no,
qtr_no, month_no, etc).
My new data in fact table is coming in "2016-01-01 16:45:00" format (15
mins intervals).
How can I handle this situation? I do not want to have all detailed level
intervals in Date dimension since it will add lots of data.
Any idea you would recommend?
(fact table format "YYYY-MM-DD HH24:MI:SS" will not be joined with
dimension table "YYYY-MM-DD" )
Thanks
Re: Date with hhmi
Posted by deva namaste <oh...@gmail.com>.
Thanks ShaoFeng.
Deva
On Mon, Jul 30, 2018 at 11:14 PM, ShaoFeng Shi <sh...@apache.org>
wrote:
> Hi Deva,
>
> There is a blog in Chinese about using Hive view for Kylin:
> https://www.cnblogs.com/hark0623/p/5584922.html
>
> You can try it with Google translate :-)
>
> 2018-07-31 2:30 GMT+08:00 deva namaste <oh...@gmail.com>:
>
>> Thanks Sheofeng. Can you please provide an example or point me to the
>> URL link to get the idea.
>> Deva
>>
>> On Mon, Jul 30, 2018 at 1:44 AM, ShaoFeng Shi <sh...@apache.org>
>> wrote:
>>
>>> Hi Deva,
>>>
>>> If you couldn't add this date column, you can define a Hive view over
>>> it, adding the column virtually (maybe with substr function). Then use this
>>> view as the fact table in Kylin cube.
>>>
>>> 2018-07-30 4:08 GMT+08:00 deva namaste <oh...@gmail.com>:
>>>
>>>> Hello friends, Any idea? Thanks
>>>>
>>>> On Fri, Jul 27, 2018 at 3:58 PM, deva namaste <oh...@gmail.com> wrote:
>>>>
>>>>> Hello,
>>>>>
>>>>> I do have fact table with date column where dates are in this format
>>>>> "YYYY-MM-DD" ( e.g. 2016-01-01). The same fact table is joined with date
>>>>> dimension table same format column (and the other columns are year_no,
>>>>> qtr_no, month_no, etc).
>>>>>
>>>>> My new data in fact table is coming in "2016-01-01 16:45:00" format
>>>>> (15 mins intervals).
>>>>>
>>>>> How can I handle this situation? I do not want to have all detailed
>>>>> level intervals in Date dimension since it will add lots of data.
>>>>>
>>>>> Any idea you would recommend?
>>>>> (fact table format "YYYY-MM-DD HH24:MI:SS" will not be joined with
>>>>> dimension table "YYYY-MM-DD" )
>>>>>
>>>>> Thanks
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Best regards,
>>>
>>> Shaofeng Shi 史少锋
>>>
>>>
>>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>
Re: Date with hhmi
Posted by ShaoFeng Shi <sh...@apache.org>.
Hi Deva,
There is a blog in Chinese about using Hive view for Kylin:
https://www.cnblogs.com/hark0623/p/5584922.html
You can try it with Google translate :-)
2018-07-31 2:30 GMT+08:00 deva namaste <oh...@gmail.com>:
> Thanks Sheofeng. Can you please provide an example or point me to the URL
> link to get the idea.
> Deva
>
> On Mon, Jul 30, 2018 at 1:44 AM, ShaoFeng Shi <sh...@apache.org>
> wrote:
>
>> Hi Deva,
>>
>> If you couldn't add this date column, you can define a Hive view over it,
>> adding the column virtually (maybe with substr function). Then use this
>> view as the fact table in Kylin cube.
>>
>> 2018-07-30 4:08 GMT+08:00 deva namaste <oh...@gmail.com>:
>>
>>> Hello friends, Any idea? Thanks
>>>
>>> On Fri, Jul 27, 2018 at 3:58 PM, deva namaste <oh...@gmail.com> wrote:
>>>
>>>> Hello,
>>>>
>>>> I do have fact table with date column where dates are in this format
>>>> "YYYY-MM-DD" ( e.g. 2016-01-01). The same fact table is joined with date
>>>> dimension table same format column (and the other columns are year_no,
>>>> qtr_no, month_no, etc).
>>>>
>>>> My new data in fact table is coming in "2016-01-01 16:45:00" format
>>>> (15 mins intervals).
>>>>
>>>> How can I handle this situation? I do not want to have all detailed
>>>> level intervals in Date dimension since it will add lots of data.
>>>>
>>>> Any idea you would recommend?
>>>> (fact table format "YYYY-MM-DD HH24:MI:SS" will not be joined with
>>>> dimension table "YYYY-MM-DD" )
>>>>
>>>> Thanks
>>>>
>>>
>>>
>>
>>
>> --
>> Best regards,
>>
>> Shaofeng Shi 史少锋
>>
>>
>
--
Best regards,
Shaofeng Shi 史少锋
Re: Date with hhmi
Posted by deva namaste <oh...@gmail.com>.
Thanks Sheofeng. Can you please provide an example or point me to the URL
link to get the idea.
Deva
On Mon, Jul 30, 2018 at 1:44 AM, ShaoFeng Shi <sh...@apache.org>
wrote:
> Hi Deva,
>
> If you couldn't add this date column, you can define a Hive view over it,
> adding the column virtually (maybe with substr function). Then use this
> view as the fact table in Kylin cube.
>
> 2018-07-30 4:08 GMT+08:00 deva namaste <oh...@gmail.com>:
>
>> Hello friends, Any idea? Thanks
>>
>> On Fri, Jul 27, 2018 at 3:58 PM, deva namaste <oh...@gmail.com> wrote:
>>
>>> Hello,
>>>
>>> I do have fact table with date column where dates are in this format
>>> "YYYY-MM-DD" ( e.g. 2016-01-01). The same fact table is joined with date
>>> dimension table same format column (and the other columns are year_no,
>>> qtr_no, month_no, etc).
>>>
>>> My new data in fact table is coming in "2016-01-01 16:45:00" format (15
>>> mins intervals).
>>>
>>> How can I handle this situation? I do not want to have all detailed
>>> level intervals in Date dimension since it will add lots of data.
>>>
>>> Any idea you would recommend?
>>> (fact table format "YYYY-MM-DD HH24:MI:SS" will not be joined with
>>> dimension table "YYYY-MM-DD" )
>>>
>>> Thanks
>>>
>>
>>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>
Re: Date with hhmi
Posted by ShaoFeng Shi <sh...@apache.org>.
Hi Deva,
If you couldn't add this date column, you can define a Hive view over it,
adding the column virtually (maybe with substr function). Then use this
view as the fact table in Kylin cube.
2018-07-30 4:08 GMT+08:00 deva namaste <oh...@gmail.com>:
> Hello friends, Any idea? Thanks
>
> On Fri, Jul 27, 2018 at 3:58 PM, deva namaste <oh...@gmail.com> wrote:
>
>> Hello,
>>
>> I do have fact table with date column where dates are in this format
>> "YYYY-MM-DD" ( e.g. 2016-01-01). The same fact table is joined with date
>> dimension table same format column (and the other columns are year_no,
>> qtr_no, month_no, etc).
>>
>> My new data in fact table is coming in "2016-01-01 16:45:00" format (15
>> mins intervals).
>>
>> How can I handle this situation? I do not want to have all detailed
>> level intervals in Date dimension since it will add lots of data.
>>
>> Any idea you would recommend?
>> (fact table format "YYYY-MM-DD HH24:MI:SS" will not be joined with
>> dimension table "YYYY-MM-DD" )
>>
>> Thanks
>>
>
>
--
Best regards,
Shaofeng Shi 史少锋
Re: Date with hhmi
Posted by deva namaste <oh...@gmail.com>.
Hello friends, Any idea? Thanks
On Fri, Jul 27, 2018 at 3:58 PM, deva namaste <oh...@gmail.com> wrote:
> Hello,
>
> I do have fact table with date column where dates are in this format
> "YYYY-MM-DD" ( e.g. 2016-01-01). The same fact table is joined with date
> dimension table same format column (and the other columns are year_no,
> qtr_no, month_no, etc).
>
> My new data in fact table is coming in "2016-01-01 16:45:00" format (15
> mins intervals).
>
> How can I handle this situation? I do not want to have all detailed level
> intervals in Date dimension since it will add lots of data.
>
> Any idea you would recommend?
> (fact table format "YYYY-MM-DD HH24:MI:SS" will not be joined with
> dimension table "YYYY-MM-DD" )
>
> Thanks
>