You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2019/10/25 14:09:00 UTC

[jira] [Commented] (KYLIN-4205) configuration support set hive.intermediate-table-prefix

    [ https://issues.apache.org/jira/browse/KYLIN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16959787#comment-16959787 ] 

ASF GitHub Bot commented on KYLIN-4205:
---------------------------------------

bigxiaochu commented on pull request #899: KYLIN-4205 configuration support set hive.intermediate-table-prefix
URL: https://github.com/apache/kylin/pull/899
 
 
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> configuration support set hive.intermediate-table-prefix
> --------------------------------------------------------
>
>                 Key: KYLIN-4205
>                 URL: https://issues.apache.org/jira/browse/KYLIN-4205
>             Project: Kylin
>          Issue Type: Improvement
>          Components: Job Engine
>    Affects Versions: v3.0.0-alpha
>            Reporter: chuxiao
>            Priority: Major
>         Attachments: KYLIN-4205.master.001.patch
>
>
> There are thousands of cubes in didi,  so in order to cut the metadata we have 4 kylin clusters. They use 1 hdfs cluster, 1 hive database, and 1 hbase cluster.
> KYLIN_INTERMEDIATE_PREFIX is set by MetadataConstants. In order to the unused intermediate table can be properly cleaned up by cleanTool,  the intermediate table prefix needs to be set differently by kylin config.
> kylin config  add kylin.source.hive.intermediate-table-prefix, default 'kylin_intermediate_'. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)