You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@zeppelin.apache.org by Jun HE <ry...@gmail.com> on 2018/05/07 01:25:17 UTC

Regard the default download url for Spark dependencies

Hi,

I'm new to Zeppelin. When I was trying to build Zeppelin with Spark2.2.1,
it failed with message that it cannot find spark-2.2.1.tgz at
http://d3kbcqa49mib13.cloudfront.net/.

Through I can resolve this by setting spark.src.download.url
and spark.bin.download.url, I just curious that why Zeppelin doesn't use
Apache's archive, https://archive.apache.org/dist/spark, for these
dependecies? Is there any historical reason?

Thanks & regards,

Jun

Re: Regard the default download url for Spark dependencies

Posted by Jongyoul Lee <jo...@gmail.com>.

Actually, there's no open issue. But I discussed it with prior issues and
concluded we should find a better way to handle it.

On Mon, May 7, 2018 at 10:04 PM, Jun HE <ry...@gmail.com> wrote:

> Thanks for quick explaination, JL.
> Is there a JIRA to track " replace it to more efficient way"?
>
> 2018-05-07 15:37 GMT+08:00 Jongyoul Lee <jo...@gmail.com>:
>
> > Hi,
> >
> > It has a reason and we are trying to replace it to more efficient way.
> >
> > BTW, you can use a specific version of Spark although you don’t have to
> > build it with a specific version. Just set SPARK_HOME in
> > conf/zeppelin-env.sh.
> >
> > Thanks,
> > JL
> >
> > On Mon, May 7, 2018 at 10:25 Jun HE <ry...@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > I'm new to Zeppelin. When I was trying to build Zeppelin with
> Spark2.2.1,
> > > it failed with message that it cannot find spark-2.2.1.tgz at
> > > http://d3kbcqa49mib13.cloudfront.net/.
> > >
> > > Through I can resolve this by setting spark.src.download.url
> > > and spark.bin.download.url, I just curious that why Zeppelin doesn't
> use
> > > Apache's archive, https://archive.apache.org/dist/spark, for these
> > > dependecies? Is there any historical reason?
> > >
> > > Thanks & regards,
> > >
> > > Jun
> > >
> > --
> > 이종열, Jongyoul Lee, 李宗烈
> > http://madeng.net
> >
>



-- 
이종열, Jongyoul Lee, 李宗烈
http://madeng.net

Re: Regard the default download url for Spark dependencies

Posted by Jun HE <ry...@gmail.com>.

Thanks for quick explaination, JL.
Is there a JIRA to track " replace it to more efficient way"?

2018-05-07 15:37 GMT+08:00 Jongyoul Lee <jo...@gmail.com>:

> Hi,
>
> It has a reason and we are trying to replace it to more efficient way.
>
> BTW, you can use a specific version of Spark although you don’t have to
> build it with a specific version. Just set SPARK_HOME in
> conf/zeppelin-env.sh.
>
> Thanks,
> JL
>
> On Mon, May 7, 2018 at 10:25 Jun HE <ry...@gmail.com> wrote:
>
> > Hi,
> >
> > I'm new to Zeppelin. When I was trying to build Zeppelin with Spark2.2.1,
> > it failed with message that it cannot find spark-2.2.1.tgz at
> > http://d3kbcqa49mib13.cloudfront.net/.
> >
> > Through I can resolve this by setting spark.src.download.url
> > and spark.bin.download.url, I just curious that why Zeppelin doesn't use
> > Apache's archive, https://archive.apache.org/dist/spark, for these
> > dependecies? Is there any historical reason?
> >
> > Thanks & regards,
> >
> > Jun
> >
> --
> 이종열, Jongyoul Lee, 李宗烈
> http://madeng.net
>

Re: Regard the default download url for Spark dependencies

Posted by Jongyoul Lee <jo...@gmail.com>.

Hi,

It has a reason and we are trying to replace it to more efficient way.

BTW, you can use a specific version of Spark although you don’t have to
build it with a specific version. Just set SPARK_HOME in
conf/zeppelin-env.sh.

Thanks,
JL

On Mon, May 7, 2018 at 10:25 Jun HE <ry...@gmail.com> wrote:

> Hi,
>
> I'm new to Zeppelin. When I was trying to build Zeppelin with Spark2.2.1,
> it failed with message that it cannot find spark-2.2.1.tgz at
> http://d3kbcqa49mib13.cloudfront.net/.
>
> Through I can resolve this by setting spark.src.download.url
> and spark.bin.download.url, I just curious that why Zeppelin doesn't use
> Apache's archive, https://archive.apache.org/dist/spark, for these
> dependecies? Is there any historical reason?
>
> Thanks & regards,
>
> Jun
>
-- 
이종열, Jongyoul Lee, 李宗烈
http://madeng.net