You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hadoop-migrations@infra.apache.org by Gavin McDonald <gm...@apache.org> on 2020/07/16 09:33:07 UTC

[IMPORTANT] - 2 more HADOOP nodes migrated over to ci-hadoop

Hi,

I have moved over 2 more H nodes (H18,H19) making a total of 4 nodes now on
https://ci-hadoop.apache.org. That leaves 14 'HADOOP' labelled nodes on
builds.apache.org.

On Sunday I'm going to move 2 more nodes from builds.apache.org to
ci-hadoop.apache.org.
And I'll keep moving 2 nodes at a time every few days until there are just
two left, which will remain until the turn off date (see below).

The Hadoop project; and all related projects [1] joining Hadoop over at
ci-hadoop.apache.org should be making preparations to move all of their
jobs over and performing tests before then disabling their jobs on
builds.apache.org.

I aim to be turning off builds.apache.org on the *15th August 2020* -
giving you around 4 weeks to migrate all of your jobs.

There is no automatic migration path. There are too many differences
between the systems to even try. So, you must recreate your jobs, find out
what might be missing and file INFRA tickets or discuss on the
hadoop-migrations@infra.apache.org mailing list (You are subscribed right?)

There are over 400 plugins on the current builds.apache.org - most of which
we don't need any more, or are replaced with different plugins on the new
system. I expect there may be some plugins we still need to install to get
you going again, which is why it is vitally important that you start
testing and migrating your jobs over *now*. You should all have auth.

Any questions, feel free to email the hadoop-migrations@apache.org list if
you are one of the projects listed below. The rest of you, not listed, a
similar email to this one will be posted for you shortly on builds@a.o.

Thanks

[1] - Ambari, Avro, Chukwa, HBase, Mahout, Pig, Spark, Submarine, Tez,
ZooKeeper and of course Hadoop itself. Also included is Yetus which is
heavily tied to some of these projects.
Excluded is Hive whom have indicated they are not wanting to be a part of
this move.

-- 

*Gavin McDonald*
Systems Administrator
ASF Infrastructure Team

Fwd: [IMPORTANT] - 2 more HADOOP nodes migrated over to ci-hadoop

Posted by Matt Sicker <bo...@gmail.com>.
Do we need to look into requesting our own CloudBees Managed Master
like the Hadoop one? From what I remember, many of the nodes that can
run our build are these H-nodes which seem to be moving.

---------- Forwarded message ---------
From: Gavin McDonald <gm...@apache.org>
Date: Thu, 16 Jul 2020 at 04:33
Subject: [IMPORTANT] - 2 more HADOOP nodes migrated over to ci-hadoop
To: builds <bu...@apache.org>, <ha...@infra.apache.org>


Hi,

I have moved over 2 more H nodes (H18,H19) making a total of 4 nodes now on
https://ci-hadoop.apache.org. That leaves 14 'HADOOP' labelled nodes on
builds.apache.org.

On Sunday I'm going to move 2 more nodes from builds.apache.org to
ci-hadoop.apache.org.
And I'll keep moving 2 nodes at a time every few days until there are just
two left, which will remain until the turn off date (see below).

The Hadoop project; and all related projects [1] joining Hadoop over at
ci-hadoop.apache.org should be making preparations to move all of their
jobs over and performing tests before then disabling their jobs on
builds.apache.org.

I aim to be turning off builds.apache.org on the *15th August 2020* -
giving you around 4 weeks to migrate all of your jobs.

There is no automatic migration path. There are too many differences
between the systems to even try. So, you must recreate your jobs, find out
what might be missing and file INFRA tickets or discuss on the
hadoop-migrations@infra.apache.org mailing list (You are subscribed right?)

There are over 400 plugins on the current builds.apache.org - most of which
we don't need any more, or are replaced with different plugins on the new
system. I expect there may be some plugins we still need to install to get
you going again, which is why it is vitally important that you start
testing and migrating your jobs over *now*. You should all have auth.

Any questions, feel free to email the hadoop-migrations@apache.org list if
you are one of the projects listed below. The rest of you, not listed, a
similar email to this one will be posted for you shortly on builds@a.o.

Thanks

[1] - Ambari, Avro, Chukwa, HBase, Mahout, Pig, Spark, Submarine, Tez,
ZooKeeper and of course Hadoop itself. Also included is Yetus which is
heavily tied to some of these projects.
Excluded is Hive whom have indicated they are not wanting to be a part of
this move.

--

*Gavin McDonald*
Systems Administrator
ASF Infrastructure Team


-- 
Matt Sicker <bo...@gmail.com>