You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by shane knapp <sk...@berkeley.edu> on 2017/08/25 17:26:01 UTC

[build system] upcoming downtime for next week

greetings, denizens of the aether!

as you are all probably aware, we've been having a lot of issues
w/power in the beautiful little city of berkeley over the summer.

next week, we have two sudden and separate maintenances on both power
to our building (soda hall), and to the datacenter (IST).  these will
be happening on monday and tuesday and will impact jenkins directly.

MONDAY 8-28-17
what's happening:  the datacenter is replacing a faulty panel in the
primary circuit breaker, which means all non-ups machines in the colo
need to be turned off.
time:  830am-noon PDT
impact:  all jenkins workers will be powered off at ~midnight the
night before.  no builds will run until noon monday at the earliest.

TUESDAY 8-29-17
what's happening:  in late june, the city accidentally drilled through
the main power lead to Soda Hall.  they'll be fixing the temp patch,
which will kill power for four buildings.
time:  2am-noon PDT
impact:  amplab.cs.berkeley.edu will be down, so no PRB builds will
trigger.  once power is restored, it will take some time to get all of
the machines and services up...  we're hoping that this will be done
around noon at the latest.  given the scope of the repair, this may
end up taking even longer.  jenkins will still be accessible from
https://hadrian.ist.berkeley.edu/jenkins

i'll post more updates as they come, but here's to hoping things go smoothly!

shane

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org


Re: [build system] upcoming downtime for next week

Posted by shane knapp <sk...@berkeley.edu>.
it's pretty quiet right now, so i'm going to kill the lone job that's
building and power down the cluster.

once we're back up tomorrow, i'll let everyone know.

shane

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org


Re: [build system] upcoming downtime for next week

Posted by shane knapp <sk...@berkeley.edu>.
reminder:  jenkins is coming down tonite ~11pm.

On Fri, Aug 25, 2017 at 10:26 AM, shane knapp <sk...@berkeley.edu> wrote:
> greetings, denizens of the aether!
>
> as you are all probably aware, we've been having a lot of issues
> w/power in the beautiful little city of berkeley over the summer.
>
> next week, we have two sudden and separate maintenances on both power
> to our building (soda hall), and to the datacenter (IST).  these will
> be happening on monday and tuesday and will impact jenkins directly.
>
> MONDAY 8-28-17
> what's happening:  the datacenter is replacing a faulty panel in the
> primary circuit breaker, which means all non-ups machines in the colo
> need to be turned off.
> time:  830am-noon PDT
> impact:  all jenkins workers will be powered off at ~midnight the
> night before.  no builds will run until noon monday at the earliest.
>
> TUESDAY 8-29-17
> what's happening:  in late june, the city accidentally drilled through
> the main power lead to Soda Hall.  they'll be fixing the temp patch,
> which will kill power for four buildings.
> time:  2am-noon PDT
> impact:  amplab.cs.berkeley.edu will be down, so no PRB builds will
> trigger.  once power is restored, it will take some time to get all of
> the machines and services up...  we're hoping that this will be done
> around noon at the latest.  given the scope of the repair, this may
> end up taking even longer.  jenkins will still be accessible from
> https://hadrian.ist.berkeley.edu/jenkins
>
> i'll post more updates as they come, but here's to hoping things go smoothly!
>
> shane

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org