You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "fengYu (JIRA)" <ji...@apache.org> on 2016/06/30 01:50:11 UTC

[jira] [Created] (KYLIN-1839) improvement set classpath before submitting mr job

fengYu created KYLIN-1839:
-----------------------------

             Summary: improvement set classpath before submitting mr job
                 Key: KYLIN-1839
                 URL: https://issues.apache.org/jira/browse/KYLIN-1839
             Project: Kylin
          Issue Type: Improvement
          Components: Job Engine
    Affects Versions: v1.5.2
            Reporter: fengYu
            Assignee: fengYu


in setClasspath, kylin will alway find hive jars from hive dependency using regex, however, this will not change in one process lifetime, so I cache the location of tmpjars and tmpfiles.

What is more, support extends user lib setting to hdfs path rather than only support local filesystem which will cause upload jars every time if DistributedCache do not exist.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)