You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by shane knapp <sk...@berkeley.edu> on 2016/04/29 21:52:44 UTC
[build system] short downtime monday morning (5-2-16), 7-9am PDT
(copy-pasta of previous message)
another project hosted on our jenkins (e-mission) needs anaconda scipy
upgraded from 0.15.1 to 0.17.0. this will also upgrade a few other
libs, which i've included at the end of this email.
i've spoken w/josh @ databricks and we don't believe that this will
impact the spark builds at all. if this causes serious breakage, i
will roll everything back to pre-update.
i have created a JIRA issue to look in to creating conda environments
for spark builds, something that we should have done long ago:
https://issues.apache.org/jira/browse/SPARK-14905
builds will be paused: ~7am PDT
anaconda package updates: ~8am
jenkins quiet time ends: ~9am at the latest
i do not expect the downtime to last very long, and will update this
thread w/updates as they come.
here's what will be updated under anaconda:
The following NEW packages will be INSTALLED:
libgfortran: 3.0-0
mkl: 11.3.1-0
wheel: 0.29.0-py27_0
The following packages will be UPDATED:
conda: 3.10.1-py27_0 --> 4.0.5-py27_0
conda-env: 2.1.4-py27_0 --> 2.4.5-py27_0
numpy: 1.9.2-py27_0 --> 1.11.0-py27_0
openssl: 1.0.1k-1 --> 1.0.2g-0
pip: 6.1.1-py27_0 --> 8.1.1-py27_1
python: 2.7.9-2 --> 2.7.11-0
pyyaml: 3.11-py27_0 --> 3.11-py27_1
requests: 2.6.0-py27_0 --> 2.9.1-py27_0
scipy: 0.15.1-np19py27_0 --> 0.17.0-np111py27_2
setuptools: 15.0-py27_0 --> 20.7.0-py27_0
sqlite: 3.8.4.1-1 --> 3.9.2-0
yaml: 0.1.4-0 --> 0.1.6-0
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: [build system] short downtime monday morning (5-2-16), 7-9am PDT
Posted by Reynold Xin <rx...@databricks.com>.
Thanks, Shane!
On Monday, May 2, 2016, shane knapp <sk...@berkeley.edu> wrote:
> workers -01 and -04 are back up, is is -06 (as i hit the wrong power
> button by accident). :)
>
> -01 and -04 got hung on shutdown, so i'll investigate them and see
> what exactly happened. regardless, we should be building happily!
>
> On Mon, May 2, 2016 at 8:44 AM, shane knapp <sknapp@berkeley.edu
> <javascript:;>> wrote:
> > hey everyone!
> >
> > looks like two of the workers didn't survive a reboot, so i will need
> > to head to the colo and console in to see what's going on.
> >
> > sadly, one of the workers that didn't come back is -01, which runs the
> > doc builds.
> >
> > anyways, i will post another update within the hour with the status of
> > these two machines. i'm also unpausing builds.
> >
> > On Mon, May 2, 2016 at 8:26 AM, shane knapp <sknapp@berkeley.edu
> <javascript:;>> wrote:
> >> this is happening now.
> >>
> >> On Fri, Apr 29, 2016 at 12:52 PM, shane knapp <sknapp@berkeley.edu
> <javascript:;>> wrote:
> >>> (copy-pasta of previous message)
> >>>
> >>> another project hosted on our jenkins (e-mission) needs anaconda scipy
> >>> upgraded from 0.15.1 to 0.17.0. this will also upgrade a few other
> >>> libs, which i've included at the end of this email.
> >>>
> >>> i've spoken w/josh @ databricks and we don't believe that this will
> >>> impact the spark builds at all. if this causes serious breakage, i
> >>> will roll everything back to pre-update.
> >>>
> >>> i have created a JIRA issue to look in to creating conda environments
> >>> for spark builds, something that we should have done long ago:
> >>>
> >>> https://issues.apache.org/jira/browse/SPARK-14905
> >>>
> >>> builds will be paused: ~7am PDT
> >>> anaconda package updates: ~8am
> >>> jenkins quiet time ends: ~9am at the latest
> >>>
> >>> i do not expect the downtime to last very long, and will update this
> >>> thread w/updates as they come.
> >>>
> >>> here's what will be updated under anaconda:
> >>>
> >>> The following NEW packages will be INSTALLED:
> >>>
> >>> libgfortran: 3.0-0
> >>> mkl: 11.3.1-0
> >>> wheel: 0.29.0-py27_0
> >>>
> >>> The following packages will be UPDATED:
> >>>
> >>> conda: 3.10.1-py27_0 --> 4.0.5-py27_0
> >>> conda-env: 2.1.4-py27_0 --> 2.4.5-py27_0
> >>> numpy: 1.9.2-py27_0 --> 1.11.0-py27_0
> >>> openssl: 1.0.1k-1 --> 1.0.2g-0
> >>> pip: 6.1.1-py27_0 --> 8.1.1-py27_1
> >>> python: 2.7.9-2 --> 2.7.11-0
> >>> pyyaml: 3.11-py27_0 --> 3.11-py27_1
> >>> requests: 2.6.0-py27_0 --> 2.9.1-py27_0
> >>> scipy: 0.15.1-np19py27_0 --> 0.17.0-np111py27_2
> >>> setuptools: 15.0-py27_0 --> 20.7.0-py27_0
> >>> sqlite: 3.8.4.1-1 --> 3.9.2-0
> >>> yaml: 0.1.4-0 --> 0.1.6-0
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org <javascript:;>
> For additional commands, e-mail: dev-help@spark.apache.org <javascript:;>
>
>
Re: [build system] short downtime monday morning (5-2-16), 7-9am PDT
Posted by shane knapp <sk...@berkeley.edu>.
workers -01 and -04 are back up, is is -06 (as i hit the wrong power
button by accident). :)
-01 and -04 got hung on shutdown, so i'll investigate them and see
what exactly happened. regardless, we should be building happily!
On Mon, May 2, 2016 at 8:44 AM, shane knapp <sk...@berkeley.edu> wrote:
> hey everyone!
>
> looks like two of the workers didn't survive a reboot, so i will need
> to head to the colo and console in to see what's going on.
>
> sadly, one of the workers that didn't come back is -01, which runs the
> doc builds.
>
> anyways, i will post another update within the hour with the status of
> these two machines. i'm also unpausing builds.
>
> On Mon, May 2, 2016 at 8:26 AM, shane knapp <sk...@berkeley.edu> wrote:
>> this is happening now.
>>
>> On Fri, Apr 29, 2016 at 12:52 PM, shane knapp <sk...@berkeley.edu> wrote:
>>> (copy-pasta of previous message)
>>>
>>> another project hosted on our jenkins (e-mission) needs anaconda scipy
>>> upgraded from 0.15.1 to 0.17.0. this will also upgrade a few other
>>> libs, which i've included at the end of this email.
>>>
>>> i've spoken w/josh @ databricks and we don't believe that this will
>>> impact the spark builds at all. if this causes serious breakage, i
>>> will roll everything back to pre-update.
>>>
>>> i have created a JIRA issue to look in to creating conda environments
>>> for spark builds, something that we should have done long ago:
>>>
>>> https://issues.apache.org/jira/browse/SPARK-14905
>>>
>>> builds will be paused: ~7am PDT
>>> anaconda package updates: ~8am
>>> jenkins quiet time ends: ~9am at the latest
>>>
>>> i do not expect the downtime to last very long, and will update this
>>> thread w/updates as they come.
>>>
>>> here's what will be updated under anaconda:
>>>
>>> The following NEW packages will be INSTALLED:
>>>
>>> libgfortran: 3.0-0
>>> mkl: 11.3.1-0
>>> wheel: 0.29.0-py27_0
>>>
>>> The following packages will be UPDATED:
>>>
>>> conda: 3.10.1-py27_0 --> 4.0.5-py27_0
>>> conda-env: 2.1.4-py27_0 --> 2.4.5-py27_0
>>> numpy: 1.9.2-py27_0 --> 1.11.0-py27_0
>>> openssl: 1.0.1k-1 --> 1.0.2g-0
>>> pip: 6.1.1-py27_0 --> 8.1.1-py27_1
>>> python: 2.7.9-2 --> 2.7.11-0
>>> pyyaml: 3.11-py27_0 --> 3.11-py27_1
>>> requests: 2.6.0-py27_0 --> 2.9.1-py27_0
>>> scipy: 0.15.1-np19py27_0 --> 0.17.0-np111py27_2
>>> setuptools: 15.0-py27_0 --> 20.7.0-py27_0
>>> sqlite: 3.8.4.1-1 --> 3.9.2-0
>>> yaml: 0.1.4-0 --> 0.1.6-0
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: [build system] short downtime monday morning (5-2-16), 7-9am PDT
Posted by shane knapp <sk...@berkeley.edu>.
hey everyone!
looks like two of the workers didn't survive a reboot, so i will need
to head to the colo and console in to see what's going on.
sadly, one of the workers that didn't come back is -01, which runs the
doc builds.
anyways, i will post another update within the hour with the status of
these two machines. i'm also unpausing builds.
On Mon, May 2, 2016 at 8:26 AM, shane knapp <sk...@berkeley.edu> wrote:
> this is happening now.
>
> On Fri, Apr 29, 2016 at 12:52 PM, shane knapp <sk...@berkeley.edu> wrote:
>> (copy-pasta of previous message)
>>
>> another project hosted on our jenkins (e-mission) needs anaconda scipy
>> upgraded from 0.15.1 to 0.17.0. this will also upgrade a few other
>> libs, which i've included at the end of this email.
>>
>> i've spoken w/josh @ databricks and we don't believe that this will
>> impact the spark builds at all. if this causes serious breakage, i
>> will roll everything back to pre-update.
>>
>> i have created a JIRA issue to look in to creating conda environments
>> for spark builds, something that we should have done long ago:
>>
>> https://issues.apache.org/jira/browse/SPARK-14905
>>
>> builds will be paused: ~7am PDT
>> anaconda package updates: ~8am
>> jenkins quiet time ends: ~9am at the latest
>>
>> i do not expect the downtime to last very long, and will update this
>> thread w/updates as they come.
>>
>> here's what will be updated under anaconda:
>>
>> The following NEW packages will be INSTALLED:
>>
>> libgfortran: 3.0-0
>> mkl: 11.3.1-0
>> wheel: 0.29.0-py27_0
>>
>> The following packages will be UPDATED:
>>
>> conda: 3.10.1-py27_0 --> 4.0.5-py27_0
>> conda-env: 2.1.4-py27_0 --> 2.4.5-py27_0
>> numpy: 1.9.2-py27_0 --> 1.11.0-py27_0
>> openssl: 1.0.1k-1 --> 1.0.2g-0
>> pip: 6.1.1-py27_0 --> 8.1.1-py27_1
>> python: 2.7.9-2 --> 2.7.11-0
>> pyyaml: 3.11-py27_0 --> 3.11-py27_1
>> requests: 2.6.0-py27_0 --> 2.9.1-py27_0
>> scipy: 0.15.1-np19py27_0 --> 0.17.0-np111py27_2
>> setuptools: 15.0-py27_0 --> 20.7.0-py27_0
>> sqlite: 3.8.4.1-1 --> 3.9.2-0
>> yaml: 0.1.4-0 --> 0.1.6-0
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: [build system] short downtime monday morning (5-2-16), 7-9am PDT
Posted by shane knapp <sk...@berkeley.edu>.
this is happening now.
On Fri, Apr 29, 2016 at 12:52 PM, shane knapp <sk...@berkeley.edu> wrote:
> (copy-pasta of previous message)
>
> another project hosted on our jenkins (e-mission) needs anaconda scipy
> upgraded from 0.15.1 to 0.17.0. this will also upgrade a few other
> libs, which i've included at the end of this email.
>
> i've spoken w/josh @ databricks and we don't believe that this will
> impact the spark builds at all. if this causes serious breakage, i
> will roll everything back to pre-update.
>
> i have created a JIRA issue to look in to creating conda environments
> for spark builds, something that we should have done long ago:
>
> https://issues.apache.org/jira/browse/SPARK-14905
>
> builds will be paused: ~7am PDT
> anaconda package updates: ~8am
> jenkins quiet time ends: ~9am at the latest
>
> i do not expect the downtime to last very long, and will update this
> thread w/updates as they come.
>
> here's what will be updated under anaconda:
>
> The following NEW packages will be INSTALLED:
>
> libgfortran: 3.0-0
> mkl: 11.3.1-0
> wheel: 0.29.0-py27_0
>
> The following packages will be UPDATED:
>
> conda: 3.10.1-py27_0 --> 4.0.5-py27_0
> conda-env: 2.1.4-py27_0 --> 2.4.5-py27_0
> numpy: 1.9.2-py27_0 --> 1.11.0-py27_0
> openssl: 1.0.1k-1 --> 1.0.2g-0
> pip: 6.1.1-py27_0 --> 8.1.1-py27_1
> python: 2.7.9-2 --> 2.7.11-0
> pyyaml: 3.11-py27_0 --> 3.11-py27_1
> requests: 2.6.0-py27_0 --> 2.9.1-py27_0
> scipy: 0.15.1-np19py27_0 --> 0.17.0-np111py27_2
> setuptools: 15.0-py27_0 --> 20.7.0-py27_0
> sqlite: 3.8.4.1-1 --> 3.9.2-0
> yaml: 0.1.4-0 --> 0.1.6-0
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org