You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "liyang (JIRA)" <ji...@apache.org> on 2016/10/19 00:25:58 UTC

[jira] [Resolved] (KYLIN-1839) improvement set classpath before submitting mr job

     [ https://issues.apache.org/jira/browse/KYLIN-1839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

liyang resolved KYLIN-1839.
---------------------------
       Resolution: Fixed
    Fix Version/s: v1.6.0

> improvement set classpath before submitting mr job
> --------------------------------------------------
>
>                 Key: KYLIN-1839
>                 URL: https://issues.apache.org/jira/browse/KYLIN-1839
>             Project: Kylin
>          Issue Type: Improvement
>          Components: Job Engine
>    Affects Versions: v1.5.2
>            Reporter: fengYu
>            Assignee: fengYu
>             Fix For: v1.6.0
>
>         Attachments: 0001-KYLIN-1839-support-kylin-lib-in-HDFS.patch
>
>
> in setClasspath, kylin will alway find hive jars from hive dependency using regex, however, this will not change in one process lifetime, so I cache the location of tmpjars and tmpfiles.
> What is more, support extends user lib setting to hdfs path rather than only support local filesystem which will cause upload jars every time if DistributedCache do not exist.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)