You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Sean Owen <sr...@apache.org> on 2018/11/20 15:06:13 UTC
Can I update the "2.12" PR builder to 2.11?
Shane, on your long list of TODOs, we still need to update the 2.12 PR
builder to instead test 2.11. Is that just a matter of editing Jenkins
configuration that I can see and change? if so I'll just do it.
Sean
---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
Re: Can I update the "2.12" PR builder to 2.11?
Posted by shane knapp <sk...@berkeley.edu>.
rock on! disabling the old/explicit 2.12 build now.
On Tue, Nov 20, 2018 at 10:30 AM Sean Owen <sr...@apache.org> wrote:
> That's the ticket! yes I'll figure out the build error.
> On Tue, Nov 20, 2018 at 11:16 AM shane knapp <sk...@berkeley.edu> wrote:
> >
> > how about this?
> >
> >
> https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.11/
> >
> > (log in w/your jenkins creds and look at the build config)
> >
> > basically, it runs 'dev/change-scala-version.sh 2.11' and builds w/mvn
> and '-Pscala-2.11'
> >
> > i'll also disable the
> spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.12 build.
> >
> > On Tue, Nov 20, 2018 at 8:52 AM Sean Owen <sr...@apache.org> wrote:
> >>
> >> Ah right yes not a PR builder. So would you have to update that? If
> possible to get that in soon it would help detect 2.11 failures.
> >>
> >> On Tue, Nov 20, 2018, 10:23 AM shane knapp <sknapp@berkeley.edu wrote:
> >>>
> >>> oh, the master builds are in the jenkins job builder configs in that
> databricks repo (that's near the top of my TODO list to move in to the main
> spark repo).
> >>>
> >>> and btw, the spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.12 is
> *not* a PR builder... ;)
> >>>
> >>> On Tue, Nov 20, 2018 at 8:20 AM Sean Owen <sr...@apache.org> wrote:
> >>>>
> >>>> The one you set up to test 2.12 separately,
> >>>> spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.12
> >>>> Now master is on 2.12 by default. OK will try to change it.
> >>>> On Tue, Nov 20, 2018 at 10:15 AM shane knapp <sk...@berkeley.edu>
> wrote:
> >>>> >
> >>>> > which build are you referring to as "the 2.12 PR builder"?
> >>>> >
> >>>> > but yes, it should just be a simple dev/change_scala_version.sh
> call in the build step.
> >>>> >
> >>>> > shane
> >>>> >
> >>>> > On Tue, Nov 20, 2018 at 7:06 AM Sean Owen <sr...@apache.org>
> wrote:
> >>>> >>
> >>>> >> Shane, on your long list of TODOs, we still need to update the
> 2.12 PR
> >>>> >> builder to instead test 2.11. Is that just a matter of editing
> Jenkins
> >>>> >> configuration that I can see and change? if so I'll just do it.
> >>>> >>
> >>>> >> Sean
> >>>> >
> >>>> >
> >>>> >
> >>>> > --
> >>>> > Shane Knapp
> >>>> > UC Berkeley EECS Research / RISELab Staff Technical Lead
> >>>> > https://rise.cs.berkeley.edu
> >>>
> >>>
> >>>
> >>> --
> >>> Shane Knapp
> >>> UC Berkeley EECS Research / RISELab Staff Technical Lead
> >>> https://rise.cs.berkeley.edu
> >
> >
> >
> > --
> > Shane Knapp
> > UC Berkeley EECS Research / RISELab Staff Technical Lead
> > https://rise.cs.berkeley.edu
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>
>
--
Shane Knapp
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu
Re: Can I update the "2.12" PR builder to 2.11?
Posted by Sean Owen <sr...@apache.org>.
That's the ticket! yes I'll figure out the build error.
On Tue, Nov 20, 2018 at 11:16 AM shane knapp <sk...@berkeley.edu> wrote:
>
> how about this?
>
> https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.11/
>
> (log in w/your jenkins creds and look at the build config)
>
> basically, it runs 'dev/change-scala-version.sh 2.11' and builds w/mvn and '-Pscala-2.11'
>
> i'll also disable the spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.12 build.
>
> On Tue, Nov 20, 2018 at 8:52 AM Sean Owen <sr...@apache.org> wrote:
>>
>> Ah right yes not a PR builder. So would you have to update that? If possible to get that in soon it would help detect 2.11 failures.
>>
>> On Tue, Nov 20, 2018, 10:23 AM shane knapp <sknapp@berkeley.edu wrote:
>>>
>>> oh, the master builds are in the jenkins job builder configs in that databricks repo (that's near the top of my TODO list to move in to the main spark repo).
>>>
>>> and btw, the spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.12 is *not* a PR builder... ;)
>>>
>>> On Tue, Nov 20, 2018 at 8:20 AM Sean Owen <sr...@apache.org> wrote:
>>>>
>>>> The one you set up to test 2.12 separately,
>>>> spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.12
>>>> Now master is on 2.12 by default. OK will try to change it.
>>>> On Tue, Nov 20, 2018 at 10:15 AM shane knapp <sk...@berkeley.edu> wrote:
>>>> >
>>>> > which build are you referring to as "the 2.12 PR builder"?
>>>> >
>>>> > but yes, it should just be a simple dev/change_scala_version.sh call in the build step.
>>>> >
>>>> > shane
>>>> >
>>>> > On Tue, Nov 20, 2018 at 7:06 AM Sean Owen <sr...@apache.org> wrote:
>>>> >>
>>>> >> Shane, on your long list of TODOs, we still need to update the 2.12 PR
>>>> >> builder to instead test 2.11. Is that just a matter of editing Jenkins
>>>> >> configuration that I can see and change? if so I'll just do it.
>>>> >>
>>>> >> Sean
>>>> >
>>>> >
>>>> >
>>>> > --
>>>> > Shane Knapp
>>>> > UC Berkeley EECS Research / RISELab Staff Technical Lead
>>>> > https://rise.cs.berkeley.edu
>>>
>>>
>>>
>>> --
>>> Shane Knapp
>>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>>> https://rise.cs.berkeley.edu
>
>
>
> --
> Shane Knapp
> UC Berkeley EECS Research / RISELab Staff Technical Lead
> https://rise.cs.berkeley.edu
---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
Re: Can I update the "2.12" PR builder to 2.11?
Posted by shane knapp <sk...@berkeley.edu>.
how about this?
https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.11/
(log in w/your jenkins creds and look at the build config)
basically, it runs 'dev/change-scala-version.sh 2.11' and builds w/mvn and
'-Pscala-2.11'
i'll also disable the spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.12
build.
On Tue, Nov 20, 2018 at 8:52 AM Sean Owen <sr...@apache.org> wrote:
> Ah right yes not a PR builder. So would you have to update that? If
> possible to get that in soon it would help detect 2.11 failures.
>
> On Tue, Nov 20, 2018, 10:23 AM shane knapp <sknapp@berkeley.edu wrote:
>
>> oh, the master builds are in the jenkins job builder configs in that
>> databricks repo (that's near the top of my TODO list to move in to the main
>> spark repo).
>>
>> and btw, the spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.12 is
>> *not* a PR builder... ;)
>>
>> On Tue, Nov 20, 2018 at 8:20 AM Sean Owen <sr...@apache.org> wrote:
>>
>>> The one you set up to test 2.12 separately,
>>> spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.12
>>> Now master is on 2.12 by default. OK will try to change it.
>>> On Tue, Nov 20, 2018 at 10:15 AM shane knapp <sk...@berkeley.edu>
>>> wrote:
>>> >
>>> > which build are you referring to as "the 2.12 PR builder"?
>>> >
>>> > but yes, it should just be a simple dev/change_scala_version.sh call
>>> in the build step.
>>> >
>>> > shane
>>> >
>>> > On Tue, Nov 20, 2018 at 7:06 AM Sean Owen <sr...@apache.org> wrote:
>>> >>
>>> >> Shane, on your long list of TODOs, we still need to update the 2.12 PR
>>> >> builder to instead test 2.11. Is that just a matter of editing Jenkins
>>> >> configuration that I can see and change? if so I'll just do it.
>>> >>
>>> >> Sean
>>> >
>>> >
>>> >
>>> > --
>>> > Shane Knapp
>>> > UC Berkeley EECS Research / RISELab Staff Technical Lead
>>> > https://rise.cs.berkeley.edu
>>>
>>
>>
>> --
>> Shane Knapp
>> UC Berkeley EECS Research / RISELab Staff Technical Lead
>> https://rise.cs.berkeley.edu
>>
>
--
Shane Knapp
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu
Re: Can I update the "2.12" PR builder to 2.11?
Posted by Sean Owen <sr...@apache.org>.
Ah right yes not a PR builder. So would you have to update that? If
possible to get that in soon it would help detect 2.11 failures.
On Tue, Nov 20, 2018, 10:23 AM shane knapp <sknapp@berkeley.edu wrote:
> oh, the master builds are in the jenkins job builder configs in that
> databricks repo (that's near the top of my TODO list to move in to the main
> spark repo).
>
> and btw, the spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.12 is *not*
> a PR builder... ;)
>
> On Tue, Nov 20, 2018 at 8:20 AM Sean Owen <sr...@apache.org> wrote:
>
>> The one you set up to test 2.12 separately,
>> spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.12
>> Now master is on 2.12 by default. OK will try to change it.
>> On Tue, Nov 20, 2018 at 10:15 AM shane knapp <sk...@berkeley.edu> wrote:
>> >
>> > which build are you referring to as "the 2.12 PR builder"?
>> >
>> > but yes, it should just be a simple dev/change_scala_version.sh call in
>> the build step.
>> >
>> > shane
>> >
>> > On Tue, Nov 20, 2018 at 7:06 AM Sean Owen <sr...@apache.org> wrote:
>> >>
>> >> Shane, on your long list of TODOs, we still need to update the 2.12 PR
>> >> builder to instead test 2.11. Is that just a matter of editing Jenkins
>> >> configuration that I can see and change? if so I'll just do it.
>> >>
>> >> Sean
>> >
>> >
>> >
>> > --
>> > Shane Knapp
>> > UC Berkeley EECS Research / RISELab Staff Technical Lead
>> > https://rise.cs.berkeley.edu
>>
>
>
> --
> Shane Knapp
> UC Berkeley EECS Research / RISELab Staff Technical Lead
> https://rise.cs.berkeley.edu
>
Re: Can I update the "2.12" PR builder to 2.11?
Posted by shane knapp <sk...@berkeley.edu>.
oh, the master builds are in the jenkins job builder configs in that
databricks repo (that's near the top of my TODO list to move in to the main
spark repo).
and btw, the spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.12 is *not*
a PR builder... ;)
On Tue, Nov 20, 2018 at 8:20 AM Sean Owen <sr...@apache.org> wrote:
> The one you set up to test 2.12 separately,
> spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.12
> Now master is on 2.12 by default. OK will try to change it.
> On Tue, Nov 20, 2018 at 10:15 AM shane knapp <sk...@berkeley.edu> wrote:
> >
> > which build are you referring to as "the 2.12 PR builder"?
> >
> > but yes, it should just be a simple dev/change_scala_version.sh call in
> the build step.
> >
> > shane
> >
> > On Tue, Nov 20, 2018 at 7:06 AM Sean Owen <sr...@apache.org> wrote:
> >>
> >> Shane, on your long list of TODOs, we still need to update the 2.12 PR
> >> builder to instead test 2.11. Is that just a matter of editing Jenkins
> >> configuration that I can see and change? if so I'll just do it.
> >>
> >> Sean
> >
> >
> >
> > --
> > Shane Knapp
> > UC Berkeley EECS Research / RISELab Staff Technical Lead
> > https://rise.cs.berkeley.edu
>
--
Shane Knapp
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu
Re: Can I update the "2.12" PR builder to 2.11?
Posted by Sean Owen <sr...@apache.org>.
The one you set up to test 2.12 separately,
spark-master-test-maven-hadoop-2.7-ubuntu-scala-2.12
Now master is on 2.12 by default. OK will try to change it.
On Tue, Nov 20, 2018 at 10:15 AM shane knapp <sk...@berkeley.edu> wrote:
>
> which build are you referring to as "the 2.12 PR builder"?
>
> but yes, it should just be a simple dev/change_scala_version.sh call in the build step.
>
> shane
>
> On Tue, Nov 20, 2018 at 7:06 AM Sean Owen <sr...@apache.org> wrote:
>>
>> Shane, on your long list of TODOs, we still need to update the 2.12 PR
>> builder to instead test 2.11. Is that just a matter of editing Jenkins
>> configuration that I can see and change? if so I'll just do it.
>>
>> Sean
>
>
>
> --
> Shane Knapp
> UC Berkeley EECS Research / RISELab Staff Technical Lead
> https://rise.cs.berkeley.edu
---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
Re: Can I update the "2.12" PR builder to 2.11?
Posted by shane knapp <sk...@berkeley.edu>.
which build are you referring to as "the 2.12 PR builder"?
but yes, it should just be a simple dev/change_scala_version.sh call in the
build step.
shane
On Tue, Nov 20, 2018 at 7:06 AM Sean Owen <sr...@apache.org> wrote:
> Shane, on your long list of TODOs, we still need to update the 2.12 PR
> builder to instead test 2.11. Is that just a matter of editing Jenkins
> configuration that I can see and change? if so I'll just do it.
>
> Sean
>
--
Shane Knapp
UC Berkeley EECS Research / RISELab Staff Technical Lead
https://rise.cs.berkeley.edu