[jira] [Comment Edited] (KYLIN-1826) kylin support more than one hive based on different hadoop claster

["fengYu (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KYLIN-1826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15615336#comment-15615336 ] 

fengYu edited comment on KYLIN-1826 at 10/28/16 1:05 PM:
---------------------------------------------------------

Hi, I have remove the threadlocal variable and cut the patch to 2 parts, one is about controller such as create project, load table. another is about add or modify some source jobs.

We have test this in our production environment for more than 4 months.  so I think it is steady.

the patch is base on kylin 1.5.4.1 release, wish it can be review and merge as soon as possible. Thanks a lot.


was (Author: feng_xiao_yu):
Hi, I have remove the threadlocal virable and cut the patch to 2 parts, one is about controller such as create project, load table. another is about add or modify some source jobs.

We have test this in our production environment for more than 4 months.  so I think it is steady.

the patch is base on kylin 1.5.4.1 release, wish it can be review and merge as soon as possible. Thanks a lot.

> kylin support more than one hive based on different hadoop claster
> ------------------------------------------------------------------
>
>                 Key: KYLIN-1826
>                 URL: https://issues.apache.org/jira/browse/KYLIN-1826
>             Project: Kylin
>          Issue Type: Improvement
>          Components: Environment 
>    Affects Versions: v1.5.2
>            Reporter: fengYu
>            Assignee: fengYu
>         Attachments: 0001-KYLIN-1826-add-external-hive-interface-project-table.patch, 0002-KYLIN-1826-add-and-modify-cube-source-job-for-extern.patch
>
>
> Currently, kylin only support one hive which should run by 'hive' command, However, when source data located in more than one hive we should deploy more kylin instance and more than one metastore. which is difficult to manager and may cause some conflict.
> I has been working on it Recently, In our cluster, there are some hive client(different metastore) which based on different hadoop cluster, I add a new hive source type which called 'external hive' in kylin 1.5.x
> Thanks to kylin Plug-in architecture in 2.x, which make this work easiler. the main modification are:
> 1. add hive root directory in hive config file, external hive client exist in this directory. hive named by directory name.
> 2. add hive-site.xml file while loading hive tables.
> 3. store hive name into project, one project can only take one hive as source.
> 4. change and add some job to support job building.
> I will upload my patch if I finish all my tests.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)