You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "liyang (JIRA)" <ji...@apache.org> on 2016/02/18 10:54:18 UTC
[jira] [Commented] (KYLIN-1427) Enable partition date column to
support date and hour as separate columns for increment cube build
[ https://issues.apache.org/jira/browse/KYLIN-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15152043#comment-15152043 ]
liyang commented on KYLIN-1427:
-------------------------------
More info copied from discussion with customer.
What We Want
- Hourly incremental build a cube
What We Need
- A timestamp column on FACT_TABLE that Kylin can use to tell old data from the new
- Overwriting the hive table every hour is not required
- Partitioning the hive table is not required
- The above can work but maybe slow when reading hive if hive partition is not enabled on the timestamp column
Alternative
- Kylin to support incremental load from a date column + a time (hour) column (KYLIN-1427), letting Hive partition be comfortably enabled on the date column
> Enable partition date column to support date and hour as separate columns for increment cube build
> ---------------------------------------------------------------------------------------------------
>
> Key: KYLIN-1427
> URL: https://issues.apache.org/jira/browse/KYLIN-1427
> Project: Kylin
> Issue Type: Task
> Components: Metadata, REST Service, Web
> Reporter: qianqiaoneng
>
> There are some data table, which save date and hour at 2 columns. For this kind of source data, kylin currently doesn't support incrementally build the cube. Open this JIRA to track this feature.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)