You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2019/10/29 04:04:00 UTC
[jira] [Commented] (KYLIN-4211) PartitionDesc support custom year、month、day partitions name
[ https://issues.apache.org/jira/browse/KYLIN-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961657#comment-16961657 ]
ASF GitHub Bot commented on KYLIN-4211:
---------------------------------------
bigxiaochu commented on pull request #904: KYLIN-4211 PartitionDesc support custom year、month、day partitions name
URL: https://github.com/apache/kylin/pull/904
https://issues.apache.org/jira/browse/KYLIN-4211
PartitionDesc support custom year、month、day partitions name
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
> PartitionDesc support custom year、month、day partitions name
> -----------------------------------------------------------
>
> Key: KYLIN-4211
> URL: https://issues.apache.org/jira/browse/KYLIN-4211
> Project: Kylin
> Issue Type: Improvement
> Reporter: chuxiao
> Priority: Major
> Attachments: KYLIN-4211.master.001.patch
>
>
> YearMonthDayPartitionConditionBuilder supports partition named year, month, day, but can not support partition names like Y, M, D.
> Because there are user using fact table partitioned by Y, M, D, so add CustomYearMonthDayFieldPartitionConditionBuilder, support custom year, month, day partitions name.
> Partition metadata in model.json like:
> {
> "uuid" : "459d48c1-a8a6-cdf5-6ea7-e2ae48b248e9",
> "last_modified" : 1571652918478,
> "version" : "2.6.0.20500",
> "name" : "kylin_sales_ymd",
> "owner" : "admin",
> "is_draft" : false,
> "description" : "",
> "fact_table" : "BIGDATA_KYLIN.KYLIN_SALES_YMD",
> "lookups" : [ ],
> "dimensions" : [ {
> "table" : "KYLIN_SALES_YMD",
> "columns" : [ "LEAF_CATEG_ID", "TRANS_ID", "SLR_SEGMENT_CD", "SELLER_ID", "BUYER_ID", "OPS_USER_ID", "OPS_REGION", "Y", "M", "D" ]
> } ],
> "metrics" : [ "KYLIN_SALES_YMD.PRICE", "KYLIN_SALES_YMD.ITEM_COUNT" ],
> "filter_condition" : "",
> "partition_desc" : {
> "partition_date_column" : "KYLIN_SALES_YMD.Y, KYLIN_SALES_YMD.M, KYLIN_SALES_YMD.D",
> "partition_time_column" : null,
> "partition_date_start" : 0,
> "partition_date_format" : "yyyy-MM-dd",
> "partition_time_format" : "HH:mm:ss",
> "partition_type" : "APPEND",
> "partition_condition_builder" : "org.apache.kylin.metadata.model.PartitionDesc$CustomYearMonthDayFieldPartitionConditionBuilder"
> },
> "capacity" : "MEDIUM"
> }
> Partition_date_column is the year, month, and day partition field split by ','.， and Partition_condition_builder is org.apache.kylin.metadata.model.PartitionDesc$CustomYearMonthDayFieldPartitionConditionBuilder
> Web can create a normal model and "Edit JSON" on Kylin web
--
This message was sent by Atlassian Jira
(v8.3.4#803005)