You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2019/12/17 08:02:00 UTC
[jira] [Commented] (KYLIN-4211) PartitionDesc support custom year、month、day partitions name
[ https://issues.apache.org/jira/browse/KYLIN-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997963#comment-16997963 ]
ASF subversion and git services commented on KYLIN-4211:
--------------------------------------------------------
Commit 2b830a3e6d6e17d488af307d030e0d73d094aa74 in kylin's branch refs/heads/master from bigxiaochu
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=2b830a3 ]
KYLIN-4211 PartitionDesc support custom year、month、day partitions name
> PartitionDesc support custom year、month、day partitions name
> -----------------------------------------------------------
>
> Key: KYLIN-4211
> URL: https://issues.apache.org/jira/browse/KYLIN-4211
> Project: Kylin
> Issue Type: Improvement
> Reporter: chuxiao
> Priority: Major
> Fix For: v3.1.0
>
> Attachments: KYLIN-4211.master.001.patch
>
>
> YearMonthDayPartitionConditionBuilder supports partition named year, month, day, but can not support partition names like Y, M, D.
> Because there are user using fact table partitioned by Y, M, D, so add CustomYearMonthDayFieldPartitionConditionBuilder, support custom year, month, day partitions name.
> Partition metadata in model.json like:
> {
> "uuid" : "459d48c1-a8a6-cdf5-6ea7-e2ae48b248e9",
> "last_modified" : 1571652918478,
> "version" : "2.6.0.20500",
> "name" : "kylin_sales_ymd",
> "owner" : "admin",
> "is_draft" : false,
> "description" : "",
> "fact_table" : "BIGDATA_KYLIN.KYLIN_SALES_YMD",
> "lookups" : [ ],
> "dimensions" : [ {
> "table" : "KYLIN_SALES_YMD",
> "columns" : [ "LEAF_CATEG_ID", "TRANS_ID", "SLR_SEGMENT_CD", "SELLER_ID", "BUYER_ID", "OPS_USER_ID", "OPS_REGION", "Y", "M", "D" ]
> } ],
> "metrics" : [ "KYLIN_SALES_YMD.PRICE", "KYLIN_SALES_YMD.ITEM_COUNT" ],
> "filter_condition" : "",
> "partition_desc" : {
> "partition_date_column" : "KYLIN_SALES_YMD.Y, KYLIN_SALES_YMD.M, KYLIN_SALES_YMD.D",
> "partition_time_column" : null,
> "partition_date_start" : 0,
> "partition_date_format" : "yyyy-MM-dd",
> "partition_time_format" : "HH:mm:ss",
> "partition_type" : "APPEND",
> "partition_condition_builder" : "org.apache.kylin.metadata.model.PartitionDesc$CustomYearMonthDayFieldPartitionConditionBuilder"
> },
> "capacity" : "MEDIUM"
> }
> Partition_date_column is the year, month, and day partition field split by ','.， and Partition_condition_builder is org.apache.kylin.metadata.model.PartitionDesc$CustomYearMonthDayFieldPartitionConditionBuilder
> Web can create a normal model and "Edit JSON" on Kylin web
--
This message was sent by Atlassian Jira
(v8.3.4#803005)