You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by 彭鱼宴 <46...@qq.com> on 2018/07/19 04:55:07 UTC
回复： Want to know the Version of Spark can use in Kylin.
Hi Shaofeng,
Thanks for your reply. I know Kylin now embeds Spark. I mean, if I want to build the cube on spark engine, using the spark cluster 2.3.1 I already deploy， can it success? Or will it just use the spark engine embeded in Kylin?
Looking forward to your reply and help. This bothers me the whole last week.
Best,
Zhefu Peng
------------------ 原始邮件 ------------------
发件人: "ShaoFeng Shi"<sh...@apache.org>;
发送时间: 2018年7月18日(星期三) 中午11:14
收件人: "user"<us...@kylin.apache.org>;
主题: Re: Want to know the Version of Spark can use in Kylin.
Kylin 2.1 to 2.4 embeds Spark 2.1.1+ for Cube building. The dependency can be found in https://kylin.apache.org/docs/install/index.html
Only Kylin 2.0 uses Spark 1.6.
2018-07-17 15:08 GMT+08:00 彭鱼宴 <46...@qq.com>:
Hi,
Can someone tell me what the version of Spark can Kylin use to build the cube? As we all know, the latest version of Kylin is embeded with Spark 1.6 . However, if I already deployed my own spark cluster but not 1.6, can it run successfully to build the cube? And, I want to know the impact of hive cluster, since Apache is always strict with the match between hive version and spark version.
In sum, just wanna know whether the kylin can support spark 2.3.0 or other versions?
Looking forward to your reply and help.
Best wishes,
Zhefu Peng
--
Best regards,
Shaofeng Shi 史少锋
Re: Want to know the Version of Spark can use in Kylin.
Posted by ShaoFeng Shi <sh...@apache.org>.
Hi Peng,
Spark 2.3 won't work, please check:
https://issues.apache.org/jira/browse/KYLIN-3272
2018-07-19 12:55 GMT+08:00 彭鱼宴 <46...@qq.com>:
> Hi Shaofeng,
>
> Thanks for your reply. I know Kylin now embeds Spark. I mean, if I want
> to build the cube on spark engine, using the spark cluster 2.3.1 I already
> deploy， can it success? Or will it just use the spark engine embeded in
> Kylin?
>
> Looking forward to your reply and help. This bothers me the whole last
> week.
>
> Best,
> Zhefu Peng
> ------------------ 原始邮件 ------------------
> *发件人:* "ShaoFeng Shi"<sh...@apache.org>;
> *发送时间:* 2018年7月18日(星期三) 中午11:14
> *收件人:* "user"<us...@kylin.apache.org>;
> *主题:* Re: Want to know the Version of Spark can use in Kylin.
>
> Kylin 2.1 to 2.4 embeds Spark 2.1.1+ for Cube building. The dependency can
> be found in https://kylin.apache.org/docs/install/index.html
>
> Only Kylin 2.0 uses Spark 1.6.
>
> 2018-07-17 15:08 GMT+08:00 彭鱼宴 <46...@qq.com>:
>
>> Hi,
>>
>> Can someone tell me what the version of Spark can Kylin use to build the
>> cube? As we all know, the latest version of Kylin is embeded with Spark 1.6
>> . However, if I already deployed my own spark cluster but not 1.6, can it
>> run successfully to build the cube? And, I want to know the impact of hive
>> cluster, since Apache is always strict with the match between hive version
>> and spark version.
>>
>> In sum, just wanna know whether the kylin can support spark 2.3.0 or
>> other versions?
>>
>> Looking forward to your reply and help.
>>
>> Best wishes,
>> Zhefu Peng
>>
>>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>
--
Best regards,
Shaofeng Shi 史少锋