[jira] [Commented] (KYLIN-2584) Always use embeded spark for spark-cubing

["Shaofeng SHI (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KYLIN-2584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16134356#comment-16134356 ] 

Shaofeng SHI commented on KYLIN-2584:
-------------------------------------

We need keep the flexibility to use environment Spark. For example, in Azure HDInsight, it's better to use the Spark in HDInsight because it has the support for Azure storage. While the community Spark doesn't.

> Always use embeded spark for spark-cubing
> -----------------------------------------
>
>                 Key: KYLIN-2584
>                 URL: https://issues.apache.org/jira/browse/KYLIN-2584
>             Project: Kylin
>          Issue Type: Improvement
>          Components: Spark Engine
>    Affects Versions: v2.0.0
>            Reporter: Dong Li
>            Assignee: Shaofeng SHI
>
> We've embeded spark binaries in kylin package since 2.0.0. But still allowed to use other SPARK_HOME defined in environment.
> If this SPARK version is not comtipable with kylin 2.0, for example, spark 2.0, which affects kylin classpath and block startup of kylin service.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)