You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Jacek Laskowski <ja...@japila.pl> on 2018/01/21 18:13:41 UTC

Nightly Builds in the docs (in spark-nightly/spark-master-bin/latest? Can't seem to find it)

Hi,

http://spark.apache.org/developer-tools.html#nightly-builds reads:

> Spark nightly packages are available at:
> Latest master build:
https://people.apache.org/~pwendell/spark-nightly/spark-master-bin/latest

but the URL gives 404. Is this intended?

Pozdrawiam,
Jacek Laskowski
----
https://about.me/JacekLaskowski
Mastering Spark SQL https://bit.ly/mastering-spark-sql
Spark Structured Streaming https://bit.ly/spark-structured-streaming
Mastering Kafka Streams https://bit.ly/mastering-kafka-streams
Follow me at https://twitter.com/jaceklaskowski

Re: Nightly Builds in the docs (in spark-nightly/spark-master-bin/latest? Can't seem to find it)

Posted by Matei Zaharia <ma...@gmail.com>.
If we actually build stuff nightly in Jenkins, it wouldn’t hurt to publish them IMO. It helps more people try master and test it.

> On Aug 31, 2018, at 1:28 PM, Sean Owen <sr...@gmail.com> wrote:
> 
> There are some builds there, but they're not recent:
> 
> https://people.apache.org/~pwendell/spark-nightly/
> 
> We can either get the jobs running again, or just knock this on the head and remove it.
> 
> Anyone know how to get it running again and want to? I have a feeling Shane knows if anyone. Or does anyone know if we even need these at this point? if nobody has complained in about a year, unlikely.
> 
> On Fri, Aug 31, 2018 at 3:15 PM Cody Koeninger <co...@koeninger.org> wrote:
> Just got a question about this on the user list as well.
> 
> Worth removing that link to pwendell's directory from the docs?
> 
> On Sun, Jan 21, 2018 at 12:13 PM, Jacek Laskowski <ja...@japila.pl> wrote:
> > Hi,
> >
> > http://spark.apache.org/developer-tools.html#nightly-builds reads:
> >
> >> Spark nightly packages are available at:
> >> Latest master build:
> >> https://people.apache.org/~pwendell/spark-nightly/spark-master-bin/latest
> >
> > but the URL gives 404. Is this intended?
> >
> > Pozdrawiam,
> > Jacek Laskowski
> > ----
> > https://about.me/JacekLaskowski
> > Mastering Spark SQL https://bit.ly/mastering-spark-sql
> > Spark Structured Streaming https://bit.ly/spark-structured-streaming
> > Mastering Kafka Streams https://bit.ly/mastering-kafka-streams
> > Follow me at https://twitter.com/jaceklaskowski
> 
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
> 


---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org


Re: Nightly Builds in the docs (in spark-nightly/spark-master-bin/latest? Can't seem to find it)

Posted by shane knapp <sk...@berkeley.edu>.
the docs and publishing builds need some attention...  i was planning on
looking in to this after the 2.4 cut and ubuntu port is a little further
along.

see:
https://amplab.cs.berkeley.edu/jenkins/label/spark-docs/
https://amplab.cs.berkeley.edu/jenkins/label/spark-packaging/
https://amplab.cs.berkeley.edu/jenkins/label/spark-release/

these are all tied to amp-jenkins-worker-01, and use some ruby packages
that i haven't recreated yet on the ubuntu worker(s).  the build configs
are...  scary.  and fragile.  and not set up by myself.

shane

On Fri, Aug 31, 2018 at 1:37 PM, Marcelo Vanzin <vanzin@cloudera.com.invalid
> wrote:

> I think there still might be an active job publishing stuff. Here's a
> pretty recent build from master:
>
> https://dist.apache.org/repos/dist/dev/spark/2.4.0-SNAPSHOT-
> 2018_08_31_12_02-32da87d-docs/_site/index.html
>
> But it seems only docs are being published, which makes me think it's
> those builds that Shane mentioned in a recent e-mail.
>
> On Fri, Aug 31, 2018 at 1:29 PM Sean Owen <sr...@gmail.com> wrote:
> >
> > There are some builds there, but they're not recent:
> >
> > https://people.apache.org/~pwendell/spark-nightly/
> >
> > We can either get the jobs running again, or just knock this on the head
> and remove it.
> >
> > Anyone know how to get it running again and want to? I have a feeling
> Shane knows if anyone. Or does anyone know if we even need these at this
> point? if nobody has complained in about a year, unlikely.
> >
> > On Fri, Aug 31, 2018 at 3:15 PM Cody Koeninger <co...@koeninger.org>
> wrote:
> >>
> >> Just got a question about this on the user list as well.
> >>
> >> Worth removing that link to pwendell's directory from the docs?
> >>
> >> On Sun, Jan 21, 2018 at 12:13 PM, Jacek Laskowski <ja...@japila.pl>
> wrote:
> >> > Hi,
> >> >
> >> > http://spark.apache.org/developer-tools.html#nightly-builds reads:
> >> >
> >> >> Spark nightly packages are available at:
> >> >> Latest master build:
> >> >> https://people.apache.org/~pwendell/spark-nightly/spark-
> master-bin/latest
> >> >
> >> > but the URL gives 404. Is this intended?
> >> >
> >> > Pozdrawiam,
> >> > Jacek Laskowski
> >> > ----
> >> > https://about.me/JacekLaskowski
> >> > Mastering Spark SQL https://bit.ly/mastering-spark-sql
> >> > Spark Structured Streaming https://bit.ly/spark-structured-streaming
> >> > Mastering Kafka Streams https://bit.ly/mastering-kafka-streams
> >> > Follow me at https://twitter.com/jaceklaskowski
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
> >>
>
>
> --
> Marcelo
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>
>


-- 
Shane Knapp
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu

Re: Nightly Builds in the docs (in spark-nightly/spark-master-bin/latest? Can't seem to find it)

Posted by Marcelo Vanzin <va...@cloudera.com.INVALID>.
I think there still might be an active job publishing stuff. Here's a
pretty recent build from master:

https://dist.apache.org/repos/dist/dev/spark/2.4.0-SNAPSHOT-2018_08_31_12_02-32da87d-docs/_site/index.html

But it seems only docs are being published, which makes me think it's
those builds that Shane mentioned in a recent e-mail.

On Fri, Aug 31, 2018 at 1:29 PM Sean Owen <sr...@gmail.com> wrote:
>
> There are some builds there, but they're not recent:
>
> https://people.apache.org/~pwendell/spark-nightly/
>
> We can either get the jobs running again, or just knock this on the head and remove it.
>
> Anyone know how to get it running again and want to? I have a feeling Shane knows if anyone. Or does anyone know if we even need these at this point? if nobody has complained in about a year, unlikely.
>
> On Fri, Aug 31, 2018 at 3:15 PM Cody Koeninger <co...@koeninger.org> wrote:
>>
>> Just got a question about this on the user list as well.
>>
>> Worth removing that link to pwendell's directory from the docs?
>>
>> On Sun, Jan 21, 2018 at 12:13 PM, Jacek Laskowski <ja...@japila.pl> wrote:
>> > Hi,
>> >
>> > http://spark.apache.org/developer-tools.html#nightly-builds reads:
>> >
>> >> Spark nightly packages are available at:
>> >> Latest master build:
>> >> https://people.apache.org/~pwendell/spark-nightly/spark-master-bin/latest
>> >
>> > but the URL gives 404. Is this intended?
>> >
>> > Pozdrawiam,
>> > Jacek Laskowski
>> > ----
>> > https://about.me/JacekLaskowski
>> > Mastering Spark SQL https://bit.ly/mastering-spark-sql
>> > Spark Structured Streaming https://bit.ly/spark-structured-streaming
>> > Mastering Kafka Streams https://bit.ly/mastering-kafka-streams
>> > Follow me at https://twitter.com/jaceklaskowski
>>
>> ---------------------------------------------------------------------
>> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>>


-- 
Marcelo

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org


Re: Nightly Builds in the docs (in spark-nightly/spark-master-bin/latest? Can't seem to find it)

Posted by Sean Owen <sr...@gmail.com>.
There are some builds there, but they're not recent:

https://people.apache.org/~pwendell/spark-nightly/

We can either get the jobs running again, or just knock this on the head
and remove it.

Anyone know how to get it running again and want to? I have a feeling Shane
knows if anyone. Or does anyone know if we even need these at this point?
if nobody has complained in about a year, unlikely.

On Fri, Aug 31, 2018 at 3:15 PM Cody Koeninger <co...@koeninger.org> wrote:

> Just got a question about this on the user list as well.
>
> Worth removing that link to pwendell's directory from the docs?
>
> On Sun, Jan 21, 2018 at 12:13 PM, Jacek Laskowski <ja...@japila.pl> wrote:
> > Hi,
> >
> > http://spark.apache.org/developer-tools.html#nightly-builds reads:
> >
> >> Spark nightly packages are available at:
> >> Latest master build:
> >>
> https://people.apache.org/~pwendell/spark-nightly/spark-master-bin/latest
> >
> > but the URL gives 404. Is this intended?
> >
> > Pozdrawiam,
> > Jacek Laskowski
> > ----
> > https://about.me/JacekLaskowski
> > Mastering Spark SQL https://bit.ly/mastering-spark-sql
> > Spark Structured Streaming https://bit.ly/spark-structured-streaming
> > Mastering Kafka Streams https://bit.ly/mastering-kafka-streams
> > Follow me at https://twitter.com/jaceklaskowski
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>
>

Re: Nightly Builds in the docs (in spark-nightly/spark-master-bin/latest? Can't seem to find it)

Posted by Cody Koeninger <co...@koeninger.org>.
Just got a question about this on the user list as well.

Worth removing that link to pwendell's directory from the docs?

On Sun, Jan 21, 2018 at 12:13 PM, Jacek Laskowski <ja...@japila.pl> wrote:
> Hi,
>
> http://spark.apache.org/developer-tools.html#nightly-builds reads:
>
>> Spark nightly packages are available at:
>> Latest master build:
>> https://people.apache.org/~pwendell/spark-nightly/spark-master-bin/latest
>
> but the URL gives 404. Is this intended?
>
> Pozdrawiam,
> Jacek Laskowski
> ----
> https://about.me/JacekLaskowski
> Mastering Spark SQL https://bit.ly/mastering-spark-sql
> Spark Structured Streaming https://bit.ly/spark-structured-streaming
> Mastering Kafka Streams https://bit.ly/mastering-kafka-streams
> Follow me at https://twitter.com/jaceklaskowski

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org