You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by ShaoFeng Shi <sh...@apache.org> on 2019/03/08 02:42:22 UTC
[Discuss] Won't ship Spark binary in Kylin binary anymore
Hello,
As we know Kylin ships a Spark in its binary package; The total package
becomes bigger and bigger as the version grows; the latest version (v2.6.1)
is bigger than 350MB, which was rejected by Apache SVN server when trying
to upload the new package. Among the 350MB, more than 200MB is Spark, while
Spark is not mandatory for Kylin.
So I would propose to exclude Spark from Kylin's binary package, from the
current v2.6.1; the user just needs to point SPARK_HOME to any a folder of
the expected spark version, or manually download and then put it to
KYLIN_HOME/spark. All other behaviors are not impacted.
Just share your comments if any.
Best regards,
Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org
Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org
Join Kylin dev mail group: dev-subscribe@kylin.apache.org
Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
Posted by Li Yang <li...@apache.org>.
+1 makes sense to me
On Fri, Mar 8, 2019 at 5:55 PM Luke Han <lu...@gmail.com> wrote:
> +1
>
> Best Regards!
> ---------------------
>
> Luke Han
>
>
> On Fri, Mar 8, 2019 at 3:34 PM Billy Liu <bi...@apache.org> wrote:
>
>> +1
>>
>> With Warm regards
>>
>> Billy Liu
>>
>>
>> Zhong, Yanghong <ya...@ebay.com> 于2019年3月8日周五 上午11:27写道：
>>
>>> Agree to exclude spark binary.
>>>
>>>
>>>
>>> --
>>>
>>> Best regards,
>>>
>>> Yanghong Zhong
>>>
>>>
>>>
>>> *From: *yuzhang <sh...@163.com>
>>> *Reply-To: *"dev@kylin.apache.org" <de...@kylin.apache.org>
>>> *Date: *Friday, March 8, 2019 at 11:26 AM
>>> *To: *"user@kylin.apache.org" <us...@kylin.apache.org>
>>> *Cc: *"dev@kylin.apache.org" <de...@kylin.apache.org>
>>> *Subject: *Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
>>>
>>>
>>>
>>> Agree[image:
>>> cid:2a92ddc2$1$1695b55d9ca$Coremail$shifengdefannao$163.com]!
>>> Downloading Spark binary when pack kylin has ever made me confuse.
>>>
>>>
>>>
>>> [image: Image removed by sender.]
>>>
>>> *yuzhang*
>>>
>>> shifengdefannao@163.com
>>>
>>> 签名由 网易邮箱大师
>>> <https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.163.com%2Fdashi%2Fdlpro.html%3Ffrom%3Dmail81&data=02%7C01%7Cyangzhong%40ebay.com%7Cbe6d858c116248a3109208d6a375caf8%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636876123644628778&sdata=5MRLjA%2FQkPUZMrkN52kX%2F3p1NzxjI9JObQupZR7%2BeFg%3D&reserved=0> 定制
>>>
>>>
>>> On 3/8/2019 10:42，ShaoFeng Shi<sh...@apache.org>
>>> <sh...@apache.org> wrote：
>>>
>>> Hello,
>>>
>>>
>>>
>>> As we know Kylin ships a Spark in its binary package; The total package
>>> becomes bigger and bigger as the version grows; the latest version (v2.6.1)
>>> is bigger than 350MB, which was rejected by Apache SVN server when trying
>>> to upload the new package. Among the 350MB, more than 200MB is Spark, while
>>> Spark is not mandatory for Kylin.
>>>
>>>
>>>
>>> So I would propose to exclude Spark from Kylin's binary package, from
>>> the current v2.6.1; the user just needs to point SPARK_HOME to any a folder
>>> of the expected spark version, or manually download and then put it to
>>> KYLIN_HOME/spark. All other behaviors are not impacted.
>>>
>>>
>>>
>>> Just share your comments if any.
>>>
>>>
>>> Best regards,
>>>
>>>
>>>
>>> Shaofeng Shi 史少锋
>>>
>>> Apache Kylin PMC
>>>
>>> Email: shaofengshi@apache.org
>>>
>>>
>>>
>>> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
>>> <https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fkylin.apache.org%2Fdocs%2Fgettingstarted%2Ffaq.html&data=02%7C01%7Cyangzhong%40ebay.com%7Cbe6d858c116248a3109208d6a375caf8%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636876123644628778&sdata=SYVlGSyXD%2FpuIKgemh7Gk%2FnrzTE9U%2Fw18bTjTMIoj%2FY%3D&reserved=0>
>>>
>>> Join Kylin user mail group: user-subscribe@kylin.apache.org
>>>
>>> Join Kylin dev mail group: dev-subscribe@kylin.apache.org
>>>
>>>
>>>
>>>
>>>
>>>
Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
Posted by Li Yang <li...@apache.org>.
+1 makes sense to me
On Fri, Mar 8, 2019 at 5:55 PM Luke Han <lu...@gmail.com> wrote:
> +1
>
> Best Regards!
> ---------------------
>
> Luke Han
>
>
> On Fri, Mar 8, 2019 at 3:34 PM Billy Liu <bi...@apache.org> wrote:
>
>> +1
>>
>> With Warm regards
>>
>> Billy Liu
>>
>>
>> Zhong, Yanghong <ya...@ebay.com> 于2019年3月8日周五 上午11:27写道：
>>
>>> Agree to exclude spark binary.
>>>
>>>
>>>
>>> --
>>>
>>> Best regards,
>>>
>>> Yanghong Zhong
>>>
>>>
>>>
>>> *From: *yuzhang <sh...@163.com>
>>> *Reply-To: *"dev@kylin.apache.org" <de...@kylin.apache.org>
>>> *Date: *Friday, March 8, 2019 at 11:26 AM
>>> *To: *"user@kylin.apache.org" <us...@kylin.apache.org>
>>> *Cc: *"dev@kylin.apache.org" <de...@kylin.apache.org>
>>> *Subject: *Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
>>>
>>>
>>>
>>> Agree[image:
>>> cid:2a92ddc2$1$1695b55d9ca$Coremail$shifengdefannao$163.com]!
>>> Downloading Spark binary when pack kylin has ever made me confuse.
>>>
>>>
>>>
>>> [image: Image removed by sender.]
>>>
>>> *yuzhang*
>>>
>>> shifengdefannao@163.com
>>>
>>> 签名由 网易邮箱大师
>>> <https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.163.com%2Fdashi%2Fdlpro.html%3Ffrom%3Dmail81&data=02%7C01%7Cyangzhong%40ebay.com%7Cbe6d858c116248a3109208d6a375caf8%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636876123644628778&sdata=5MRLjA%2FQkPUZMrkN52kX%2F3p1NzxjI9JObQupZR7%2BeFg%3D&reserved=0> 定制
>>>
>>>
>>> On 3/8/2019 10:42，ShaoFeng Shi<sh...@apache.org>
>>> <sh...@apache.org> wrote：
>>>
>>> Hello,
>>>
>>>
>>>
>>> As we know Kylin ships a Spark in its binary package; The total package
>>> becomes bigger and bigger as the version grows; the latest version (v2.6.1)
>>> is bigger than 350MB, which was rejected by Apache SVN server when trying
>>> to upload the new package. Among the 350MB, more than 200MB is Spark, while
>>> Spark is not mandatory for Kylin.
>>>
>>>
>>>
>>> So I would propose to exclude Spark from Kylin's binary package, from
>>> the current v2.6.1; the user just needs to point SPARK_HOME to any a folder
>>> of the expected spark version, or manually download and then put it to
>>> KYLIN_HOME/spark. All other behaviors are not impacted.
>>>
>>>
>>>
>>> Just share your comments if any.
>>>
>>>
>>> Best regards,
>>>
>>>
>>>
>>> Shaofeng Shi 史少锋
>>>
>>> Apache Kylin PMC
>>>
>>> Email: shaofengshi@apache.org
>>>
>>>
>>>
>>> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
>>> <https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fkylin.apache.org%2Fdocs%2Fgettingstarted%2Ffaq.html&data=02%7C01%7Cyangzhong%40ebay.com%7Cbe6d858c116248a3109208d6a375caf8%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636876123644628778&sdata=SYVlGSyXD%2FpuIKgemh7Gk%2FnrzTE9U%2Fw18bTjTMIoj%2FY%3D&reserved=0>
>>>
>>> Join Kylin user mail group: user-subscribe@kylin.apache.org
>>>
>>> Join Kylin dev mail group: dev-subscribe@kylin.apache.org
>>>
>>>
>>>
>>>
>>>
>>>
Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
Posted by Luke Han <lu...@gmail.com>.
+1
Best Regards!
---------------------
Luke Han
On Fri, Mar 8, 2019 at 3:34 PM Billy Liu <bi...@apache.org> wrote:
> +1
>
> With Warm regards
>
> Billy Liu
>
>
> Zhong, Yanghong <ya...@ebay.com> 于2019年3月8日周五 上午11:27写道：
>
>> Agree to exclude spark binary.
>>
>>
>>
>> --
>>
>> Best regards,
>>
>> Yanghong Zhong
>>
>>
>>
>> *From: *yuzhang <sh...@163.com>
>> *Reply-To: *"dev@kylin.apache.org" <de...@kylin.apache.org>
>> *Date: *Friday, March 8, 2019 at 11:26 AM
>> *To: *"user@kylin.apache.org" <us...@kylin.apache.org>
>> *Cc: *"dev@kylin.apache.org" <de...@kylin.apache.org>
>> *Subject: *Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
>>
>>
>>
>> Agree[image: cid:2a92ddc2$1$1695b55d9ca$Coremail$shifengdefannao$163.com]!
>> Downloading Spark binary when pack kylin has ever made me confuse.
>>
>>
>>
>> [image: Image removed by sender.]
>>
>> *yuzhang*
>>
>> shifengdefannao@163.com
>>
>> 签名由 网易邮箱大师
>> <https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.163.com%2Fdashi%2Fdlpro.html%3Ffrom%3Dmail81&data=02%7C01%7Cyangzhong%40ebay.com%7Cbe6d858c116248a3109208d6a375caf8%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636876123644628778&sdata=5MRLjA%2FQkPUZMrkN52kX%2F3p1NzxjI9JObQupZR7%2BeFg%3D&reserved=0> 定制
>>
>>
>> On 3/8/2019 10:42，ShaoFeng Shi<sh...@apache.org>
>> <sh...@apache.org> wrote：
>>
>> Hello,
>>
>>
>>
>> As we know Kylin ships a Spark in its binary package; The total package
>> becomes bigger and bigger as the version grows; the latest version (v2.6.1)
>> is bigger than 350MB, which was rejected by Apache SVN server when trying
>> to upload the new package. Among the 350MB, more than 200MB is Spark, while
>> Spark is not mandatory for Kylin.
>>
>>
>>
>> So I would propose to exclude Spark from Kylin's binary package, from the
>> current v2.6.1; the user just needs to point SPARK_HOME to any a folder of
>> the expected spark version, or manually download and then put it to
>> KYLIN_HOME/spark. All other behaviors are not impacted.
>>
>>
>>
>> Just share your comments if any.
>>
>>
>> Best regards,
>>
>>
>>
>> Shaofeng Shi 史少锋
>>
>> Apache Kylin PMC
>>
>> Email: shaofengshi@apache.org
>>
>>
>>
>> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
>> <https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fkylin.apache.org%2Fdocs%2Fgettingstarted%2Ffaq.html&data=02%7C01%7Cyangzhong%40ebay.com%7Cbe6d858c116248a3109208d6a375caf8%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636876123644628778&sdata=SYVlGSyXD%2FpuIKgemh7Gk%2FnrzTE9U%2Fw18bTjTMIoj%2FY%3D&reserved=0>
>>
>> Join Kylin user mail group: user-subscribe@kylin.apache.org
>>
>> Join Kylin dev mail group: dev-subscribe@kylin.apache.org
>>
>>
>>
>>
>>
>>
Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
Posted by Luke Han <lu...@gmail.com>.
+1
Best Regards!
---------------------
Luke Han
On Fri, Mar 8, 2019 at 3:34 PM Billy Liu <bi...@apache.org> wrote:
> +1
>
> With Warm regards
>
> Billy Liu
>
>
> Zhong, Yanghong <ya...@ebay.com> 于2019年3月8日周五 上午11:27写道：
>
>> Agree to exclude spark binary.
>>
>>
>>
>> --
>>
>> Best regards,
>>
>> Yanghong Zhong
>>
>>
>>
>> *From: *yuzhang <sh...@163.com>
>> *Reply-To: *"dev@kylin.apache.org" <de...@kylin.apache.org>
>> *Date: *Friday, March 8, 2019 at 11:26 AM
>> *To: *"user@kylin.apache.org" <us...@kylin.apache.org>
>> *Cc: *"dev@kylin.apache.org" <de...@kylin.apache.org>
>> *Subject: *Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
>>
>>
>>
>> Agree[image: cid:2a92ddc2$1$1695b55d9ca$Coremail$shifengdefannao$163.com]!
>> Downloading Spark binary when pack kylin has ever made me confuse.
>>
>>
>>
>> [image: Image removed by sender.]
>>
>> *yuzhang*
>>
>> shifengdefannao@163.com
>>
>> 签名由 网易邮箱大师
>> <https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.163.com%2Fdashi%2Fdlpro.html%3Ffrom%3Dmail81&data=02%7C01%7Cyangzhong%40ebay.com%7Cbe6d858c116248a3109208d6a375caf8%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636876123644628778&sdata=5MRLjA%2FQkPUZMrkN52kX%2F3p1NzxjI9JObQupZR7%2BeFg%3D&reserved=0> 定制
>>
>>
>> On 3/8/2019 10:42，ShaoFeng Shi<sh...@apache.org>
>> <sh...@apache.org> wrote：
>>
>> Hello,
>>
>>
>>
>> As we know Kylin ships a Spark in its binary package; The total package
>> becomes bigger and bigger as the version grows; the latest version (v2.6.1)
>> is bigger than 350MB, which was rejected by Apache SVN server when trying
>> to upload the new package. Among the 350MB, more than 200MB is Spark, while
>> Spark is not mandatory for Kylin.
>>
>>
>>
>> So I would propose to exclude Spark from Kylin's binary package, from the
>> current v2.6.1; the user just needs to point SPARK_HOME to any a folder of
>> the expected spark version, or manually download and then put it to
>> KYLIN_HOME/spark. All other behaviors are not impacted.
>>
>>
>>
>> Just share your comments if any.
>>
>>
>> Best regards,
>>
>>
>>
>> Shaofeng Shi 史少锋
>>
>> Apache Kylin PMC
>>
>> Email: shaofengshi@apache.org
>>
>>
>>
>> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
>> <https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fkylin.apache.org%2Fdocs%2Fgettingstarted%2Ffaq.html&data=02%7C01%7Cyangzhong%40ebay.com%7Cbe6d858c116248a3109208d6a375caf8%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636876123644628778&sdata=SYVlGSyXD%2FpuIKgemh7Gk%2FnrzTE9U%2Fw18bTjTMIoj%2FY%3D&reserved=0>
>>
>> Join Kylin user mail group: user-subscribe@kylin.apache.org
>>
>> Join Kylin dev mail group: dev-subscribe@kylin.apache.org
>>
>>
>>
>>
>>
>>
Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
Posted by Billy Liu <bi...@apache.org>.
+1
With Warm regards
Billy Liu
Zhong, Yanghong <ya...@ebay.com> 于2019年3月8日周五 上午11:27写道：
> Agree to exclude spark binary.
>
>
>
> --
>
> Best regards,
>
> Yanghong Zhong
>
>
>
> *From: *yuzhang <sh...@163.com>
> *Reply-To: *"dev@kylin.apache.org" <de...@kylin.apache.org>
> *Date: *Friday, March 8, 2019 at 11:26 AM
> *To: *"user@kylin.apache.org" <us...@kylin.apache.org>
> *Cc: *"dev@kylin.apache.org" <de...@kylin.apache.org>
> *Subject: *Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
>
>
>
> Agree[image: cid:2a92ddc2$1$1695b55d9ca$Coremail$shifengdefannao$163.com]!
> Downloading Spark binary when pack kylin has ever made me confuse.
>
>
>
> [image: Image removed by sender.]
>
> *yuzhang*
>
> shifengdefannao@163.com
>
> 签名由 网易邮箱大师
> <https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.163.com%2Fdashi%2Fdlpro.html%3Ffrom%3Dmail81&data=02%7C01%7Cyangzhong%40ebay.com%7Cbe6d858c116248a3109208d6a375caf8%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636876123644628778&sdata=5MRLjA%2FQkPUZMrkN52kX%2F3p1NzxjI9JObQupZR7%2BeFg%3D&reserved=0> 定制
>
>
> On 3/8/2019 10:42，ShaoFeng Shi<sh...@apache.org>
> <sh...@apache.org> wrote：
>
> Hello,
>
>
>
> As we know Kylin ships a Spark in its binary package; The total package
> becomes bigger and bigger as the version grows; the latest version (v2.6.1)
> is bigger than 350MB, which was rejected by Apache SVN server when trying
> to upload the new package. Among the 350MB, more than 200MB is Spark, while
> Spark is not mandatory for Kylin.
>
>
>
> So I would propose to exclude Spark from Kylin's binary package, from the
> current v2.6.1; the user just needs to point SPARK_HOME to any a folder of
> the expected spark version, or manually download and then put it to
> KYLIN_HOME/spark. All other behaviors are not impacted.
>
>
>
> Just share your comments if any.
>
>
> Best regards,
>
>
>
> Shaofeng Shi 史少锋
>
> Apache Kylin PMC
>
> Email: shaofengshi@apache.org
>
>
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> <https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fkylin.apache.org%2Fdocs%2Fgettingstarted%2Ffaq.html&data=02%7C01%7Cyangzhong%40ebay.com%7Cbe6d858c116248a3109208d6a375caf8%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636876123644628778&sdata=SYVlGSyXD%2FpuIKgemh7Gk%2FnrzTE9U%2Fw18bTjTMIoj%2FY%3D&reserved=0>
>
> Join Kylin user mail group: user-subscribe@kylin.apache.org
>
> Join Kylin dev mail group: dev-subscribe@kylin.apache.org
>
>
>
>
>
>
Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
Posted by Billy Liu <bi...@apache.org>.
+1
With Warm regards
Billy Liu
Zhong, Yanghong <ya...@ebay.com> 于2019年3月8日周五 上午11:27写道：
> Agree to exclude spark binary.
>
>
>
> --
>
> Best regards,
>
> Yanghong Zhong
>
>
>
> *From: *yuzhang <sh...@163.com>
> *Reply-To: *"dev@kylin.apache.org" <de...@kylin.apache.org>
> *Date: *Friday, March 8, 2019 at 11:26 AM
> *To: *"user@kylin.apache.org" <us...@kylin.apache.org>
> *Cc: *"dev@kylin.apache.org" <de...@kylin.apache.org>
> *Subject: *Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
>
>
>
> Agree[image: cid:2a92ddc2$1$1695b55d9ca$Coremail$shifengdefannao$163.com]!
> Downloading Spark binary when pack kylin has ever made me confuse.
>
>
>
> [image: Image removed by sender.]
>
> *yuzhang*
>
> shifengdefannao@163.com
>
> 签名由 网易邮箱大师
> <https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.163.com%2Fdashi%2Fdlpro.html%3Ffrom%3Dmail81&data=02%7C01%7Cyangzhong%40ebay.com%7Cbe6d858c116248a3109208d6a375caf8%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636876123644628778&sdata=5MRLjA%2FQkPUZMrkN52kX%2F3p1NzxjI9JObQupZR7%2BeFg%3D&reserved=0> 定制
>
>
> On 3/8/2019 10:42，ShaoFeng Shi<sh...@apache.org>
> <sh...@apache.org> wrote：
>
> Hello,
>
>
>
> As we know Kylin ships a Spark in its binary package; The total package
> becomes bigger and bigger as the version grows; the latest version (v2.6.1)
> is bigger than 350MB, which was rejected by Apache SVN server when trying
> to upload the new package. Among the 350MB, more than 200MB is Spark, while
> Spark is not mandatory for Kylin.
>
>
>
> So I would propose to exclude Spark from Kylin's binary package, from the
> current v2.6.1; the user just needs to point SPARK_HOME to any a folder of
> the expected spark version, or manually download and then put it to
> KYLIN_HOME/spark. All other behaviors are not impacted.
>
>
>
> Just share your comments if any.
>
>
> Best regards,
>
>
>
> Shaofeng Shi 史少锋
>
> Apache Kylin PMC
>
> Email: shaofengshi@apache.org
>
>
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> <https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fkylin.apache.org%2Fdocs%2Fgettingstarted%2Ffaq.html&data=02%7C01%7Cyangzhong%40ebay.com%7Cbe6d858c116248a3109208d6a375caf8%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636876123644628778&sdata=SYVlGSyXD%2FpuIKgemh7Gk%2FnrzTE9U%2Fw18bTjTMIoj%2FY%3D&reserved=0>
>
> Join Kylin user mail group: user-subscribe@kylin.apache.org
>
> Join Kylin dev mail group: dev-subscribe@kylin.apache.org
>
>
>
>
>
>
Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
Posted by "Zhong, Yanghong" <ya...@ebay.com.INVALID>.
Agree to exclude spark binary.
--
Best regards,
Yanghong Zhong
From: yuzhang <sh...@163.com>
Reply-To: "dev@kylin.apache.org" <de...@kylin.apache.org>
Date: Friday, March 8, 2019 at 11:26 AM
To: "user@kylin.apache.org" <us...@kylin.apache.org>
Cc: "dev@kylin.apache.org" <de...@kylin.apache.org>
Subject: Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
Agree[cid:2a92ddc2$1$1695b55d9ca$Coremail$shifengdefannao$163.com]! Downloading Spark binary when pack kylin has ever made me confuse.
[Image removed by sender.]
yuzhang
shifengdefannao@163.com
签名由 网易邮箱大师<https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.163.com%2Fdashi%2Fdlpro.html%3Ffrom%3Dmail81&data=02%7C01%7Cyangzhong%40ebay.com%7Cbe6d858c116248a3109208d6a375caf8%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636876123644628778&sdata=5MRLjA%2FQkPUZMrkN52kX%2F3p1NzxjI9JObQupZR7%2BeFg%3D&reserved=0> 定制
On 3/8/2019 10:42，ShaoFeng Shi<sh...@apache.org> wrote：
Hello,
As we know Kylin ships a Spark in its binary package; The total package becomes bigger and bigger as the version grows; the latest version (v2.6.1) is bigger than 350MB, which was rejected by Apache SVN server when trying to upload the new package. Among the 350MB, more than 200MB is Spark, while Spark is not mandatory for Kylin.
So I would propose to exclude Spark from Kylin's binary package, from the current v2.6.1; the user just needs to point SPARK_HOME to any a folder of the expected spark version, or manually download and then put it to KYLIN_HOME/spark. All other behaviors are not impacted.
Just share your comments if any.
Best regards,
Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org<ma...@apache.org>
Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html<https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fkylin.apache.org%2Fdocs%2Fgettingstarted%2Ffaq.html&data=02%7C01%7Cyangzhong%40ebay.com%7Cbe6d858c116248a3109208d6a375caf8%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636876123644628778&sdata=SYVlGSyXD%2FpuIKgemh7Gk%2FnrzTE9U%2Fw18bTjTMIoj%2FY%3D&reserved=0>
Join Kylin user mail group: user-subscribe@kylin.apache.org<ma...@kylin.apache.org>
Join Kylin dev mail group: dev-subscribe@kylin.apache.org<ma...@kylin.apache.org>
Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
Posted by "Zhong, Yanghong" <ya...@ebay.com>.
Agree to exclude spark binary.
--
Best regards,
Yanghong Zhong
From: yuzhang <sh...@163.com>
Reply-To: "dev@kylin.apache.org" <de...@kylin.apache.org>
Date: Friday, March 8, 2019 at 11:26 AM
To: "user@kylin.apache.org" <us...@kylin.apache.org>
Cc: "dev@kylin.apache.org" <de...@kylin.apache.org>
Subject: Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
Agree[cid:2a92ddc2$1$1695b55d9ca$Coremail$shifengdefannao$163.com]! Downloading Spark binary when pack kylin has ever made me confuse.
[Image removed by sender.]
yuzhang
shifengdefannao@163.com
签名由 网易邮箱大师<https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.163.com%2Fdashi%2Fdlpro.html%3Ffrom%3Dmail81&data=02%7C01%7Cyangzhong%40ebay.com%7Cbe6d858c116248a3109208d6a375caf8%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636876123644628778&sdata=5MRLjA%2FQkPUZMrkN52kX%2F3p1NzxjI9JObQupZR7%2BeFg%3D&reserved=0> 定制
On 3/8/2019 10:42，ShaoFeng Shi<sh...@apache.org> wrote：
Hello,
As we know Kylin ships a Spark in its binary package; The total package becomes bigger and bigger as the version grows; the latest version (v2.6.1) is bigger than 350MB, which was rejected by Apache SVN server when trying to upload the new package. Among the 350MB, more than 200MB is Spark, while Spark is not mandatory for Kylin.
So I would propose to exclude Spark from Kylin's binary package, from the current v2.6.1; the user just needs to point SPARK_HOME to any a folder of the expected spark version, or manually download and then put it to KYLIN_HOME/spark. All other behaviors are not impacted.
Just share your comments if any.
Best regards,
Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org<ma...@apache.org>
Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html<https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fkylin.apache.org%2Fdocs%2Fgettingstarted%2Ffaq.html&data=02%7C01%7Cyangzhong%40ebay.com%7Cbe6d858c116248a3109208d6a375caf8%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636876123644628778&sdata=SYVlGSyXD%2FpuIKgemh7Gk%2FnrzTE9U%2Fw18bTjTMIoj%2FY%3D&reserved=0>
Join Kylin user mail group: user-subscribe@kylin.apache.org<ma...@kylin.apache.org>
Join Kylin dev mail group: dev-subscribe@kylin.apache.org<ma...@kylin.apache.org>
Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
Posted by yuzhang <sh...@163.com>.
Agree! Downloading Spark binary when pack kylin has ever made me confuse.
| |
yuzhang
|
|
shifengdefannao@163.com
|
签名由网易邮箱大师定制
On 3/8/2019 10:42，ShaoFeng Shi<sh...@apache.org> wrote：
Hello,
As we know Kylin ships a Spark in its binary package; The total package becomes bigger and bigger as the version grows; the latest version (v2.6.1) is bigger than 350MB, which was rejected by Apache SVN server when trying to upload the new package. Among the 350MB, more than 200MB is Spark, while Spark is not mandatory for Kylin.
So I would propose to exclude Spark from Kylin's binary package, from the current v2.6.1; the user just needs to point SPARK_HOME to any a folder of the expected spark version, or manually download and then put it to KYLIN_HOME/spark. All other behaviors are not impacted.
Just share your comments if any.
Best regards,
Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org
Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org
Join Kylin dev mail group: dev-subscribe@kylin.apache.org
Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
Posted by ShaoFeng Shi <sh...@apache.org>.
Hi Inigo, you're welcome! Thank you for the feedback!
Best regards,
Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org
Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org
Join Kylin dev mail group: dev-subscribe@kylin.apache.org
Iñigo Martínez <im...@telecoming.com> 于2019年3月11日周一 下午4:29写道：
> Cool. This is the most important, I guess. Perfect not to include spark
> binaries if they can be downloaded and installed from third party sources
> and documentation is available.
> We are planning to upgrade from 2.4.1 to 2.6.1 in a few weeks and spark
> for us is mandatory.
>
> Thank you, ShaoFeng!
>
> El sáb., 9 mar. 2019 a las 15:53, ShaoFeng Shi (<sh...@apache.org>)
> escribió:
>
>> Thanks, guys; I have updated the installation guide for this change:
>> https://kylin.apache.org/docs/install/index.html
>>
>> Best regards,
>>
>> Shaofeng Shi 史少锋
>> Apache Kylin PMC
>> Email: shaofengshi@apache.org
>>
>> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
>> Join Kylin user mail group: user-subscribe@kylin.apache.org
>> Join Kylin dev mail group: dev-subscribe@kylin.apache.org
>>
>>
>>
>>
>> JiaTao Tao <ta...@gmail.com> 于2019年3月9日周六 下午9:28写道：
>>
>>> +1
>>>
>>>
>>> --
>>>
>>>
>>> Regards!
>>>
>>> Aron Tao
>>>
>>> ShaoFeng Shi <sh...@apache.org> 于2019年3月8日周五 上午2:43写道：
>>>
>>>> Hello,
>>>>
>>>> As we know Kylin ships a Spark in its binary package; The total package
>>>> becomes bigger and bigger as the version grows; the latest version (v2.6.1)
>>>> is bigger than 350MB, which was rejected by Apache SVN server when trying
>>>> to upload the new package. Among the 350MB, more than 200MB is Spark, while
>>>> Spark is not mandatory for Kylin.
>>>>
>>>> So I would propose to exclude Spark from Kylin's binary package, from
>>>> the current v2.6.1; the user just needs to point SPARK_HOME to any a folder
>>>> of the expected spark version, or manually download and then put it to
>>>> KYLIN_HOME/spark. All other behaviors are not impacted.
>>>>
>>>> Just share your comments if any.
>>>>
>>>> Best regards,
>>>>
>>>> Shaofeng Shi 史少锋
>>>> Apache Kylin PMC
>>>> Email: shaofengshi@apache.org
>>>>
>>>> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
>>>> Join Kylin user mail group: user-subscribe@kylin.apache.org
>>>> Join Kylin dev mail group: dev-subscribe@kylin.apache.org
>>>>
>>>>
>>>>
>
> --
>
>
>
>
> Iñigo Martínez
> Systems Manager
> imartinez@telecoming.com
>
>
>
>
>
>
> [image: Telecoming - Make it digital]
> [image: 5000_empresas]
> [image: 1000_empresas]
>
> Paseo de la Castellana, 95. Torre Europa, pl 16. 28046 Madrid, Spain |
> telecoming.com <http://www.telecoming.com/>
>
>
>
> Este correo electrónico y sus archivos adjuntos están dirigidos
> únicamente a la(s) dirección(es) indicada(s) anteriormente. El carácter
> confidencial, personal e intransferible del mismo está protegido
> legalmente. Cualquier publicación, reproducción, distribución o
> retransmisión no autorizada, ya sea completa o en parte, se encuentra
> prohibida. Si ha recibido este mensaje por equivocación, notifíquelo
> inmediatamente a la persona que lo ha enviado y borre el mensaje original
> junto con sus ficheros anexos sin leerlo ni grabarlo en modo alguno.
>
>
Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
Posted by Iñigo Martínez <im...@telecoming.com>.
Cool. This is the most important, I guess. Perfect not to include spark
binaries if they can be downloaded and installed from third party sources
and documentation is available.
We are planning to upgrade from 2.4.1 to 2.6.1 in a few weeks and spark for
us is mandatory.
Thank you, ShaoFeng!
El sáb., 9 mar. 2019 a las 15:53, ShaoFeng Shi (<sh...@apache.org>)
escribió:
> Thanks, guys; I have updated the installation guide for this change:
> https://kylin.apache.org/docs/install/index.html
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC
> Email: shaofengshi@apache.org
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> Join Kylin user mail group: user-subscribe@kylin.apache.org
> Join Kylin dev mail group: dev-subscribe@kylin.apache.org
>
>
>
>
> JiaTao Tao <ta...@gmail.com> 于2019年3月9日周六 下午9:28写道：
>
>> +1
>>
>>
>> --
>>
>>
>> Regards!
>>
>> Aron Tao
>>
>> ShaoFeng Shi <sh...@apache.org> 于2019年3月8日周五 上午2:43写道：
>>
>>> Hello,
>>>
>>> As we know Kylin ships a Spark in its binary package; The total package
>>> becomes bigger and bigger as the version grows; the latest version (v2.6.1)
>>> is bigger than 350MB, which was rejected by Apache SVN server when trying
>>> to upload the new package. Among the 350MB, more than 200MB is Spark, while
>>> Spark is not mandatory for Kylin.
>>>
>>> So I would propose to exclude Spark from Kylin's binary package, from
>>> the current v2.6.1; the user just needs to point SPARK_HOME to any a folder
>>> of the expected spark version, or manually download and then put it to
>>> KYLIN_HOME/spark. All other behaviors are not impacted.
>>>
>>> Just share your comments if any.
>>>
>>> Best regards,
>>>
>>> Shaofeng Shi 史少锋
>>> Apache Kylin PMC
>>> Email: shaofengshi@apache.org
>>>
>>> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
>>> Join Kylin user mail group: user-subscribe@kylin.apache.org
>>> Join Kylin dev mail group: dev-subscribe@kylin.apache.org
>>>
>>>
>>>
--
Iñigo Martínez
Systems Manager
imartinez@telecoming.com
[image: Telecoming - Make it digital]
[image: 5000_empresas]
[image: 1000_empresas]
Paseo de la Castellana, 95. Torre Europa, pl 16. 28046 Madrid, Spain |
telecoming.com <http://www.telecoming.com/>
Este correo electrónico y sus archivos adjuntos están dirigidos
únicamente a la(s) dirección(es) indicada(s) anteriormente. El carácter
confidencial, personal e intransferible del mismo está protegido
legalmente. Cualquier publicación, reproducción, distribución o
retransmisión no autorizada, ya sea completa o en parte, se encuentra
prohibida. Si ha recibido este mensaje por equivocación, notifíquelo
inmediatamente a la persona que lo ha enviado y borre el mensaje original
junto con sus ficheros anexos sin leerlo ni grabarlo en modo alguno.
Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
Posted by ShaoFeng Shi <sh...@apache.org>.
Thanks, guys; I have updated the installation guide for this change:
https://kylin.apache.org/docs/install/index.html
Best regards,
Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org
Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org
Join Kylin dev mail group: dev-subscribe@kylin.apache.org
JiaTao Tao <ta...@gmail.com> 于2019年3月9日周六 下午9:28写道：
> +1
>
>
> --
>
>
> Regards!
>
> Aron Tao
>
> ShaoFeng Shi <sh...@apache.org> 于2019年3月8日周五 上午2:43写道：
>
>> Hello,
>>
>> As we know Kylin ships a Spark in its binary package; The total package
>> becomes bigger and bigger as the version grows; the latest version (v2.6.1)
>> is bigger than 350MB, which was rejected by Apache SVN server when trying
>> to upload the new package. Among the 350MB, more than 200MB is Spark, while
>> Spark is not mandatory for Kylin.
>>
>> So I would propose to exclude Spark from Kylin's binary package, from the
>> current v2.6.1; the user just needs to point SPARK_HOME to any a folder of
>> the expected spark version, or manually download and then put it to
>> KYLIN_HOME/spark. All other behaviors are not impacted.
>>
>> Just share your comments if any.
>>
>> Best regards,
>>
>> Shaofeng Shi 史少锋
>> Apache Kylin PMC
>> Email: shaofengshi@apache.org
>>
>> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
>> Join Kylin user mail group: user-subscribe@kylin.apache.org
>> Join Kylin dev mail group: dev-subscribe@kylin.apache.org
>>
>>
>>
Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
Posted by ShaoFeng Shi <sh...@apache.org>.
Thanks, guys; I have updated the installation guide for this change:
https://kylin.apache.org/docs/install/index.html
Best regards,
Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org
Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org
Join Kylin dev mail group: dev-subscribe@kylin.apache.org
JiaTao Tao <ta...@gmail.com> 于2019年3月9日周六 下午9:28写道：
> +1
>
>
> --
>
>
> Regards!
>
> Aron Tao
>
> ShaoFeng Shi <sh...@apache.org> 于2019年3月8日周五 上午2:43写道：
>
>> Hello,
>>
>> As we know Kylin ships a Spark in its binary package; The total package
>> becomes bigger and bigger as the version grows; the latest version (v2.6.1)
>> is bigger than 350MB, which was rejected by Apache SVN server when trying
>> to upload the new package. Among the 350MB, more than 200MB is Spark, while
>> Spark is not mandatory for Kylin.
>>
>> So I would propose to exclude Spark from Kylin's binary package, from the
>> current v2.6.1; the user just needs to point SPARK_HOME to any a folder of
>> the expected spark version, or manually download and then put it to
>> KYLIN_HOME/spark. All other behaviors are not impacted.
>>
>> Just share your comments if any.
>>
>> Best regards,
>>
>> Shaofeng Shi 史少锋
>> Apache Kylin PMC
>> Email: shaofengshi@apache.org
>>
>> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
>> Join Kylin user mail group: user-subscribe@kylin.apache.org
>> Join Kylin dev mail group: dev-subscribe@kylin.apache.org
>>
>>
>>
Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
Posted by JiaTao Tao <ta...@gmail.com>.
+1
--
Regards!
Aron Tao
ShaoFeng Shi <sh...@apache.org> 于2019年3月8日周五 上午2:43写道：
> Hello,
>
> As we know Kylin ships a Spark in its binary package; The total package
> becomes bigger and bigger as the version grows; the latest version (v2.6.1)
> is bigger than 350MB, which was rejected by Apache SVN server when trying
> to upload the new package. Among the 350MB, more than 200MB is Spark, while
> Spark is not mandatory for Kylin.
>
> So I would propose to exclude Spark from Kylin's binary package, from the
> current v2.6.1; the user just needs to point SPARK_HOME to any a folder of
> the expected spark version, or manually download and then put it to
> KYLIN_HOME/spark. All other behaviors are not impacted.
>
> Just share your comments if any.
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC
> Email: shaofengshi@apache.org
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> Join Kylin user mail group: user-subscribe@kylin.apache.org
> Join Kylin dev mail group: dev-subscribe@kylin.apache.org
>
>
>
Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
Posted by yuzhang <sh...@163.com>.
Agree! Downloading Spark binary when pack kylin has ever made me confuse.
| |
yuzhang
|
|
shifengdefannao@163.com
|
签名由网易邮箱大师定制
On 3/8/2019 10:42，ShaoFeng Shi<sh...@apache.org> wrote：
Hello,
As we know Kylin ships a Spark in its binary package; The total package becomes bigger and bigger as the version grows; the latest version (v2.6.1) is bigger than 350MB, which was rejected by Apache SVN server when trying to upload the new package. Among the 350MB, more than 200MB is Spark, while Spark is not mandatory for Kylin.
So I would propose to exclude Spark from Kylin's binary package, from the current v2.6.1; the user just needs to point SPARK_HOME to any a folder of the expected spark version, or manually download and then put it to KYLIN_HOME/spark. All other behaviors are not impacted.
Just share your comments if any.
Best regards,
Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org
Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org
Join Kylin dev mail group: dev-subscribe@kylin.apache.org
Re: [Discuss] Won't ship Spark binary in Kylin binary anymore
Posted by JiaTao Tao <ta...@gmail.com>.
+1
--
Regards!
Aron Tao
ShaoFeng Shi <sh...@apache.org> 于2019年3月8日周五 上午2:43写道：
> Hello,
>
> As we know Kylin ships a Spark in its binary package; The total package
> becomes bigger and bigger as the version grows; the latest version (v2.6.1)
> is bigger than 350MB, which was rejected by Apache SVN server when trying
> to upload the new package. Among the 350MB, more than 200MB is Spark, while
> Spark is not mandatory for Kylin.
>
> So I would propose to exclude Spark from Kylin's binary package, from the
> current v2.6.1; the user just needs to point SPARK_HOME to any a folder of
> the expected spark version, or manually download and then put it to
> KYLIN_HOME/spark. All other behaviors are not impacted.
>
> Just share your comments if any.
>
> Best regards,
>
> Shaofeng Shi 史少锋
> Apache Kylin PMC
> Email: shaofengshi@apache.org
>
> Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
> Join Kylin user mail group: user-subscribe@kylin.apache.org
> Join Kylin dev mail group: dev-subscribe@kylin.apache.org
>
>
>