You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Hao Chen (JIRA)" <ji...@apache.org> on 2016/02/22 09:45:18 UTC
[jira] [Comment Edited] (KYLIN-1427) Enable partition date column
to support date and hour as separate columns for increment cube build
[ https://issues.apache.org/jira/browse/KYLIN-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15156623#comment-15156623 ]
Hao Chen edited comment on KYLIN-1427 at 2/22/16 8:44 AM:
----------------------------------------------------------
h2. Changes
- Support multiple columns as hierarchy json string for being compatible with older version of metadata.
- Extend "org.apache.kylin.metadata.model.PartitionDesc$MultiColumnPartitionConditionBuilder" to support multiple partition columns
h2. Sample
{code}
{
"partition_desc": {
"partition_date_column": "DEFAULT.TEST_KYLIN_FACT.CAL_DT,DEFAULT.TEST_KYLIN_FACT.CAL_HOUR,TEST_KYLIN_FACT.CAL_MINUTE ",
"partition_date_start": 0,
"partition_date_format": "yyyy-MM-dd,hh,mm",
"partition_type": "APPEND",
"partition_condition_builder": "org.apache.kylin.metadata.model.PartitionDesc$DefaultPartitionConditionBuilder"
}
}
{code}
Or
{code}
{
"partition_desc": {
"partition_date_column": "[{
\"partition_date_column\": \"DEFAULT.TEST_KYLIN_FACT.CAL_DT\",
\"partition_date_format\": \"yyyy-MM-dd\",
},
{
\"partition_date_column\": \"DEFAULT.TEST_KYLIN_FACT.CAL_HOUR\",
\"partition_date_format\": \"HH\",
},
{
\"partition_date_column\": \"DEFAULT.TEST_KYLIN_FACT.CAL_MINUTE\",
\"partition_date_format\": \"mm\",
}
]",
"partition_date_start": 0,
"partition_type": "APPEND",
"partition_condition_builder": "org.apache.kylin.metadata.model.PartitionDesc$DefaultPartitionConditionBuilder"
}
}
{code}
h2. Partition SQL Condition
{code}
WHERE (TEST_KYLIN_FACT.CAL_DT >= "2016-02-21" AND TEST_KYLIN_FACT.CAL_DT < "2016-02-22") AND (TEST_KYLIN_FACT.CAL_HOUR >= "12" AND TEST_KYLIN_FACT.CAL_HOUR < "13") AND (TEST_KYLIN_FACT.CAL_MINUTE >= "0" AND TEST_KYLIN_FACT.CAL_MINUTE < "30")
{code}
was (Author: haoch):
h2. Changes
- Support multiple columns separated with "," instead of hierarchy json for being compatible with older version of metadata.
- Extend "org.apache.kylin.metadata.model.PartitionDesc$DefaultPartitionConditionBuilder" to support multiple partition columns
h2. Sample
{code}
{
"partition_desc": {
"partition_date_column": "DEFAULT.TEST_KYLIN_FACT.CAL_DT,DEFAULT.TEST_KYLIN_FACT.CAL_HOUR,TEST_KYLIN_FACT.CAL_MINUTE ",
"partition_date_start": 0,
"partition_date_format": "yyyy-MM-dd,hh,mm",
"partition_type": "APPEND",
"partition_condition_builder": "org.apache.kylin.metadata.model.PartitionDesc$DefaultPartitionConditionBuilder"
}
}
{code}
h2. Partition SQL Condition
{code}
WHERE (TEST_KYLIN_FACT.CAL_DT >= "2016-02-21" AND TEST_KYLIN_FACT.CAL_DT < "2016-02-22") AND (TEST_KYLIN_FACT.CAL_HOUR >= "12" AND TEST_KYLIN_FACT.CAL_HOUR < "13") AND (TEST_KYLIN_FACT.CAL_MINUTE >= "0" AND TEST_KYLIN_FACT.CAL_MINUTE < "30")
{code}
> Enable partition date column to support date and hour as separate columns for increment cube build
> ---------------------------------------------------------------------------------------------------
>
> Key: KYLIN-1427
> URL: https://issues.apache.org/jira/browse/KYLIN-1427
> Project: Kylin
> Issue Type: Task
> Components: Metadata, REST Service, Web
> Reporter: qianqiaoneng
> Assignee: Hao Chen
>
> There are some data table, which save date and hour at 2 columns. For this kind of source data, kylin currently doesn't support incrementally build the cube. Open this JIRA to track this feature.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)