You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Jacek Laskowski <ja...@japila.pl> on 2018/01/21 18:13:41 UTC
Nightly Builds in the docs (in spark-nightly/spark-master-bin/latest?
Can't seem to find it)
Hi,
http://spark.apache.org/developer-tools.html#nightly-builds reads:
> Spark nightly packages are available at:
> Latest master build:
https://people.apache.org/~pwendell/spark-nightly/spark-master-bin/latest
but the URL gives 404. Is this intended?
Pozdrawiam,
Jacek Laskowski
----
https://about.me/JacekLaskowski
Mastering Spark SQL https://bit.ly/mastering-spark-sql
Spark Structured Streaming https://bit.ly/spark-structured-streaming
Mastering Kafka Streams https://bit.ly/mastering-kafka-streams
Follow me at https://twitter.com/jaceklaskowski
Re: Nightly Builds in the docs (in
spark-nightly/spark-master-bin/latest? Can't seem to find it)
Posted by Matei Zaharia <ma...@gmail.com>.
If we actually build stuff nightly in Jenkins, it wouldn’t hurt to publish them IMO. It helps more people try master and test it.
> On Aug 31, 2018, at 1:28 PM, Sean Owen <sr...@gmail.com> wrote:
>
> There are some builds there, but they're not recent:
>
> https://people.apache.org/~pwendell/spark-nightly/
>
> We can either get the jobs running again, or just knock this on the head and remove it.
>
> Anyone know how to get it running again and want to? I have a feeling Shane knows if anyone. Or does anyone know if we even need these at this point? if nobody has complained in about a year, unlikely.
>
> On Fri, Aug 31, 2018 at 3:15 PM Cody Koeninger <co...@koeninger.org> wrote:
> Just got a question about this on the user list as well.
>
> Worth removing that link to pwendell's directory from the docs?
>
> On Sun, Jan 21, 2018 at 12:13 PM, Jacek Laskowski <ja...@japila.pl> wrote:
> > Hi,
> >
> > http://spark.apache.org/developer-tools.html#nightly-builds reads:
> >
> >> Spark nightly packages are available at:
> >> Latest master build:
> >> https://people.apache.org/~pwendell/spark-nightly/spark-master-bin/latest
> >
> > but the URL gives 404. Is this intended?
> >
> > Pozdrawiam,
> > Jacek Laskowski
> > ----
> > https://about.me/JacekLaskowski
> > Mastering Spark SQL https://bit.ly/mastering-spark-sql
> > Spark Structured Streaming https://bit.ly/spark-structured-streaming
> > Mastering Kafka Streams https://bit.ly/mastering-kafka-streams
> > Follow me at https://twitter.com/jaceklaskowski
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>
---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
Re: Nightly Builds in the docs (in spark-nightly/spark-master-bin/latest?
Can't seem to find it)
Posted by shane knapp <sk...@berkeley.edu>.
the docs and publishing builds need some attention... i was planning on
looking in to this after the 2.4 cut and ubuntu port is a little further
along.
see:
https://amplab.cs.berkeley.edu/jenkins/label/spark-docs/
https://amplab.cs.berkeley.edu/jenkins/label/spark-packaging/
https://amplab.cs.berkeley.edu/jenkins/label/spark-release/
these are all tied to amp-jenkins-worker-01, and use some ruby packages
that i haven't recreated yet on the ubuntu worker(s). the build configs
are... scary. and fragile. and not set up by myself.
shane
On Fri, Aug 31, 2018 at 1:37 PM, Marcelo Vanzin <vanzin@cloudera.com.invalid
> wrote:
> I think there still might be an active job publishing stuff. Here's a
> pretty recent build from master:
>
> https://dist.apache.org/repos/dist/dev/spark/2.4.0-SNAPSHOT-
> 2018_08_31_12_02-32da87d-docs/_site/index.html
>
> But it seems only docs are being published, which makes me think it's
> those builds that Shane mentioned in a recent e-mail.
>
> On Fri, Aug 31, 2018 at 1:29 PM Sean Owen <sr...@gmail.com> wrote:
> >
> > There are some builds there, but they're not recent:
> >
> > https://people.apache.org/~pwendell/spark-nightly/
> >
> > We can either get the jobs running again, or just knock this on the head
> and remove it.
> >
> > Anyone know how to get it running again and want to? I have a feeling
> Shane knows if anyone. Or does anyone know if we even need these at this
> point? if nobody has complained in about a year, unlikely.
> >
> > On Fri, Aug 31, 2018 at 3:15 PM Cody Koeninger <co...@koeninger.org>
> wrote:
> >>
> >> Just got a question about this on the user list as well.
> >>
> >> Worth removing that link to pwendell's directory from the docs?
> >>
> >> On Sun, Jan 21, 2018 at 12:13 PM, Jacek Laskowski <ja...@japila.pl>
> wrote:
> >> > Hi,
> >> >
> >> > http://spark.apache.org/developer-tools.html#nightly-builds reads:
> >> >
> >> >> Spark nightly packages are available at:
> >> >> Latest master build:
> >> >> https://people.apache.org/~pwendell/spark-nightly/spark-
> master-bin/latest
> >> >
> >> > but the URL gives 404. Is this intended?
> >> >
> >> > Pozdrawiam,
> >> > Jacek Laskowski
> >> > ----
> >> > https://about.me/JacekLaskowski
> >> > Mastering Spark SQL https://bit.ly/mastering-spark-sql
> >> > Spark Structured Streaming https://bit.ly/spark-structured-streaming
> >> > Mastering Kafka Streams https://bit.ly/mastering-kafka-streams
> >> > Follow me at https://twitter.com/jaceklaskowski
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
> >>
>
>
> --
> Marcelo
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>
>
--
Shane Knapp
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu
Re: Nightly Builds in the docs (in spark-nightly/spark-master-bin/latest?
Can't seem to find it)
Posted by Marcelo Vanzin <va...@cloudera.com.INVALID>.
I think there still might be an active job publishing stuff. Here's a
pretty recent build from master:
https://dist.apache.org/repos/dist/dev/spark/2.4.0-SNAPSHOT-2018_08_31_12_02-32da87d-docs/_site/index.html
But it seems only docs are being published, which makes me think it's
those builds that Shane mentioned in a recent e-mail.
On Fri, Aug 31, 2018 at 1:29 PM Sean Owen <sr...@gmail.com> wrote:
>
> There are some builds there, but they're not recent:
>
> https://people.apache.org/~pwendell/spark-nightly/
>
> We can either get the jobs running again, or just knock this on the head and remove it.
>
> Anyone know how to get it running again and want to? I have a feeling Shane knows if anyone. Or does anyone know if we even need these at this point? if nobody has complained in about a year, unlikely.
>
> On Fri, Aug 31, 2018 at 3:15 PM Cody Koeninger <co...@koeninger.org> wrote:
>>
>> Just got a question about this on the user list as well.
>>
>> Worth removing that link to pwendell's directory from the docs?
>>
>> On Sun, Jan 21, 2018 at 12:13 PM, Jacek Laskowski <ja...@japila.pl> wrote:
>> > Hi,
>> >
>> > http://spark.apache.org/developer-tools.html#nightly-builds reads:
>> >
>> >> Spark nightly packages are available at:
>> >> Latest master build:
>> >> https://people.apache.org/~pwendell/spark-nightly/spark-master-bin/latest
>> >
>> > but the URL gives 404. Is this intended?
>> >
>> > Pozdrawiam,
>> > Jacek Laskowski
>> > ----
>> > https://about.me/JacekLaskowski
>> > Mastering Spark SQL https://bit.ly/mastering-spark-sql
>> > Spark Structured Streaming https://bit.ly/spark-structured-streaming
>> > Mastering Kafka Streams https://bit.ly/mastering-kafka-streams
>> > Follow me at https://twitter.com/jaceklaskowski
>>
>> ---------------------------------------------------------------------
>> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>>
--
Marcelo
---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
Re: Nightly Builds in the docs (in spark-nightly/spark-master-bin/latest?
Can't seem to find it)
Posted by Sean Owen <sr...@gmail.com>.
There are some builds there, but they're not recent:
https://people.apache.org/~pwendell/spark-nightly/
We can either get the jobs running again, or just knock this on the head
and remove it.
Anyone know how to get it running again and want to? I have a feeling Shane
knows if anyone. Or does anyone know if we even need these at this point?
if nobody has complained in about a year, unlikely.
On Fri, Aug 31, 2018 at 3:15 PM Cody Koeninger <co...@koeninger.org> wrote:
> Just got a question about this on the user list as well.
>
> Worth removing that link to pwendell's directory from the docs?
>
> On Sun, Jan 21, 2018 at 12:13 PM, Jacek Laskowski <ja...@japila.pl> wrote:
> > Hi,
> >
> > http://spark.apache.org/developer-tools.html#nightly-builds reads:
> >
> >> Spark nightly packages are available at:
> >> Latest master build:
> >>
> https://people.apache.org/~pwendell/spark-nightly/spark-master-bin/latest
> >
> > but the URL gives 404. Is this intended?
> >
> > Pozdrawiam,
> > Jacek Laskowski
> > ----
> > https://about.me/JacekLaskowski
> > Mastering Spark SQL https://bit.ly/mastering-spark-sql
> > Spark Structured Streaming https://bit.ly/spark-structured-streaming
> > Mastering Kafka Streams https://bit.ly/mastering-kafka-streams
> > Follow me at https://twitter.com/jaceklaskowski
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>
>
Re: Nightly Builds in the docs (in spark-nightly/spark-master-bin/latest?
Can't seem to find it)
Posted by Cody Koeninger <co...@koeninger.org>.
Just got a question about this on the user list as well.
Worth removing that link to pwendell's directory from the docs?
On Sun, Jan 21, 2018 at 12:13 PM, Jacek Laskowski <ja...@japila.pl> wrote:
> Hi,
>
> http://spark.apache.org/developer-tools.html#nightly-builds reads:
>
>> Spark nightly packages are available at:
>> Latest master build:
>> https://people.apache.org/~pwendell/spark-nightly/spark-master-bin/latest
>
> but the URL gives 404. Is this intended?
>
> Pozdrawiam,
> Jacek Laskowski
> ----
> https://about.me/JacekLaskowski
> Mastering Spark SQL https://bit.ly/mastering-spark-sql
> Spark Structured Streaming https://bit.ly/spark-structured-streaming
> Mastering Kafka Streams https://bit.ly/mastering-kafka-streams
> Follow me at https://twitter.com/jaceklaskowski
---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org