92 Commits

Author SHA1 Message Date
Ian Wienand
e400865dd0 Retire nb01/02.openstack.org
Remove references to these older builders.  We thank them for their
service.

Change-Id: I1f48f070406bee79ac0d1de61beb44eb7d58d605
2020-05-07 13:06:26 +10:00
Ian Wienand
f204337268 Add nb01/nb02 opendev servers
These are replacements for the nb01/02.openstack.org puppet servers

Change-Id: I376d70ee375289b004fb859751743c6fafa21411
2020-05-07 09:10:26 +10:00
Monty Taylor
711295e918 Remove old etherpad.openstack.org
Once the DNS is swapped over to point at etherpad.opendev.org
we can delete the old stuff.

Change-Id: I626dd22b22a23619fcf460533336f1ddfec615d9
2020-04-19 10:58:46 -05:00
Monty Taylor
b23515c623 Make a new dockerized etherpad.opendev.org
Upstream likes building the settings file into the image, but that's
less exciting, let's bind-mount ours in.

Depends-On: https://review.opendev.org/717491/
Change-Id: Ia1894d884ef2a84e1282345b77fe07bf8898f367
2020-04-07 11:10:57 -05:00
James E. Blair
ecd3ecb4d4 Add meetpad01 to inventory
Change-Id: I3accead9f3a6f429574e03492cfbd4883a42a4bc
2020-03-27 10:02:31 -07:00
Ian Wienand
dcc23be55b Remove static site puppet
Remove the puppet related to the static server

Story: #2006598
Task: #36758

Change-Id: I744da83d811e715ff8049eacf3013cd4831e1c49
2020-03-26 10:36:16 +11:00
Ian Wienand
f55580fbf0 Remove files02.openstack.org and related puppet
All this has moved to static.opendev.org; the server can now be
removed.

Change-Id: I8ca5d7a206e950c28bb8372a85b6a62d6b9ba00c
2020-03-26 10:36:13 +11:00
Ian Wienand
ba5d9547c8 Replace nb01.opendev.org with nb04
We are starting over with the container nodepool host, and also moving
it to "nb04" to avoid any possibility of conflicting with the
short-hostname of nb01.openstack.org.

Story: #2007407
Task: #39064

Depends-On: https://review.opendev.org/713575
Depends-On: https://review.opendev.org/713571

Change-Id: I18ab9834ad4da201774e0abef56f618cd7839d36
2020-03-19 07:41:56 +11:00
Ian Wienand
dbe0bf1ee6 Add nb01.opendev.org
This configures an opendev nodepool-builder

Change-Id: Id8603d9d7caaac0a1ab935e1c7c80d32b02ae23e
Depends-On: https://review.opendev.org/693118
2020-03-11 09:16:31 +11:00
Jeremy Stanley
4cbdc2fc4d Set up inventory and cert for Open Edge mirror
This adds the Open Edge (formerly Fortnebula) CI mirror.

Change-Id: I1ccf2a602f8a41e00bc64a9516a326cc07d9b254
Depends-On: https://review.opendev.org/711787
2020-03-07 00:24:20 +00:00
Jeremy Stanley
43ed9fc297 Moving FortNebula to OpenEdge
Sister change for Ia5caff34d3fafaffc459e7572a4eef6bd94422ea and
removing earlier references to the mirror server in preparation for
building and adding the new one.

Change-Id: I7d506be85326835d5e77a0c9c461f2d457b1dfd3
2020-03-06 20:43:56 +00:00
Zuul
75693aa43b Merge "Remove review-dev01.openstack.org" 2020-02-12 18:12:51 +00:00
Monty Taylor
23b0667c45 Remove review-dev01.openstack.org
We've got a shiny new opendev one of these now, get rid of the
openstack.org one.

Change-Id: I9f5141a6ff23ab035ecedf100a417989453bfc1e
2020-02-12 14:40:46 +00:00
Clark Boylan
0463609584 Add airship-citycloud mirror
This adds a mirror to the new airship citycloud region. Add the host to
the inventory and add necessary host vars for LE setup.

Depends-On: https://review.opendev.org/706573
Change-Id: I33cefe914911b4f5ce5e09e0329ba48e039ede64
2020-02-07 08:55:40 -08:00
Ian Wienand
08707baff2 Replace nb03.openstack.org
Due to persistent, unresolved network issues between the London and US
cloud (that don't appear to happen the other way), we have decided on
a hard Brexit for nb03.o.o and started a new server in the US cloud :)

Change-Id: I6557a9f272351578216bc525b6ddaffcf625f9f3
2020-02-07 15:09:20 +11:00
Monty Taylor
cc619fe589 Add review-dev01.opendev.org
Add a new review-dev server on the opendev domain with LE support
enabled.

Depends-On: https://review.opendev.org/705661
Change-Id: Ie32124cd617e9986602301f230e83bb138524fdf
2020-02-05 09:58:25 -06:00
Ian Wienand
7ce0d0fb32 Add static01.opendev.org
Add this host for serving content from AFS.

The

 _acme-challenge.governance.openstack.org
 _acme-challenge.security.openstack.org

CNAMES should be in place for creating the certificates (added with
Ie1b92f06b71aa6069fe831b26ba1cc272ce4562c).

Also add a cert for the base server (static.opendev.org) since we
added the DNS entries for it.

Change-Id: I55e0ac7487b02f9a816ac486ed01b73f82b391a5
Story: #2006598
Task: #37757
Depends-On: https://review.opendev.org/704469
2020-01-28 11:30:18 +11:00
Clark Boylan
cb00b967f7 Add new xenial status.openstack.org
Change-Id: I1876517992e5ab16b58fe9152458deb49c2ad807
2020-01-27 13:09:02 -08:00
Ian Wienand
9a75422145 Add linaro-us mirror
Change-Id: I4abf249fd385872f8ba56c3e41f99d160a68efcd
Story: #2007195
Task: #38358
Depends-On: https://review.opendev.org/703746
2020-01-22 20:17:53 +11:00
Clark Boylan
43515ef2a6 Replace inap mirror with bigger instance
We are replacing the inap mirror with an bigger instance. The reason for
this is our cinder volume throughput hasn't been quick enough and mgagne
says that we'll get the best performance via local disk. In order to
host the caches we have on local disk we need a bigger root device which
means a bigger flavor.

Change-Id: Id7e641e3b62400f4e1181ef6763a51b9d1e9068c
2019-11-26 10:08:47 -08:00
Ian Wienand
9c7136448a Add mirror01.mtl01.opendev.org
This server is a replacement for the .openstack.org version, which no
longer exists.

Depends-On: https://review.opendev.org/690767
Change-Id: I0d2eeb609219ad96db39d1d59b99ae376419df0e
2019-10-24 11:00:05 +11:00
Jeremy Stanley
df99568f10 Replace wiki-dev02 with wiki-dev03
In order to confirm configuration management is working cleanly for
wiki-dev.openstack.org deployments, a new wiki-dev03 has been built
and the old wiki-dev02 deleted. These are not production hosts so
this change can be merged at any time. DNS has also been updated for
them accordingly.

Change-Id: I61ae138b10d51caef2cdd26ca8adaf9d59728ac8
2019-08-08 17:02:05 +00:00
Ian Wienand
734aaee327 Add vexxhost backup server
This is a new backup server for use with the roles in
I9bf74df351e056791ed817180436617048224d2c

Restrict the puppet group to only the openstack.org servers as this
new server doesn't need puppet.

Depends-On: https://review.opendev.org/674549
Change-Id: Ia8e2e01f579ed9475830c159bf266b63bed52c36
2019-08-05 19:00:29 +10:00
Clark Boylan
4b4eb02f32 Replace the fn mirror again
Networking got weird on the previous host so we rebuilt this one going
back to networking we expect to work (FIPs and all that). This updates
the inventory so that we configure the host properly.

Change-Id: I0dcdbc9efdd330d66b57da0b01d23dd3d747f79b
2019-07-30 15:15:01 -07:00
Jeremy Stanley
2ed6775780 Add gitea07 and gitea08 replacements to inventory
Add new IP addresses to inventory for the rebuilds, but don't
reactivate them in the haproxy pools yet (they're already excluded
from the repository creation task).

Change-Id: I1e3fc1ba56015eeab2c6256b3f90188ecabf23cc
2019-07-29 19:20:26 +00:00
Jeremy Stanley
56a0b08aa5 Swap gitea05 into service and bring down 07 and 08
Add the gitea05.opendev.org server into the haproxy pools now that
it's been seeded with current data. Switch the create repos task
disable list from 05 to 07 and 08, and remove 07 and 08 from the
Ansible inventory and comment them out in the haproxy pools in
preparation for replacement.

To the casual observer it may appear gitea06 is being skipped, but
it was replaced first out of sequence due to filesystem corruption
during the PTG. The increased performance of the 75% of the nodes
which have already been replaced means we can get by doing the final
25% at the same time (so two servers at once).

Change-Id: Ia49157c16582b7ed0dbef3eb9d07bf7f1d4450b9
2019-07-29 16:56:39 +00:00
Zuul
bcb07033f5 Merge "Add gitea05 replacement to inventory" 2019-07-29 14:49:46 +00:00
Jeremy Stanley
b45c672de5 Replace fortnebula mirror
The fortnebula mirror is being rebuilt while the environment there
is under some refactoring. The old mirror isn't reachable any longer
so removing it from our inventory while adding its replacement
should be safe.

Also update the letsencrypt playbooks for the new name.

Change-Id: I789248e4216f4cf059ccc5b071c2a784f9c629e9
2019-07-29 13:08:58 +00:00
Jeremy Stanley
00b814cabb Add gitea05 replacement to inventory
Add new IP addresses to inventory for the rebuild, but don't
reactivate it in the haproxy pools yet (it's already excluded from
the repository creation task).

Change-Id: I36c188992f4787d4e7c5c952eac5fb0bbdc5a627
2019-07-28 21:41:36 +00:00
Jeremy Stanley
79c86cfe3d Swap gitea04 into service and bring down gitea05
Add the gitea04.opendev.org server into the haproxy pools now that
it's been seeded with current data. Switch the create repos task
disable list from 04 to 05, and remove 05 from the Ansible inventory
and comment it out in the haproxy pools in preparation for
replacement.

Change-Id: I4cd1fef399e527771a26efee8a39952694f3ce6b
2019-07-28 12:15:41 +00:00
Jeremy Stanley
a603b4bd38 Add gitea04 replacement to inventory
Add new IP addresses to inventory for the rebuild, but don't
reactivate it in the haproxy pools yet (it's already excluded from
the repository creation task).

Change-Id: I8b43c6f9cb41452c7f64862a2b401dc0d1b7ef3d
2019-07-27 15:28:44 +00:00
Jeremy Stanley
0256ba5219 Swap gitea03 into service and bring down gitea04
Add the gitea03.opendev.org server into the haproxy pools now that
it's been seeded with current data. Switch the create repos task
disable list from 03 to 04, and remove 04 from the Ansible inventory
and comment it out in the haproxy pools in preparation for
replacement.

Change-Id: Id5817f8265996862a7e0810b9fb9e3d78be5d066
2019-07-27 02:07:13 +00:00
Jeremy Stanley
01a97664ea Add gitea03 replacement to inventory
Add new IP addresses to inventory for the rebuild, but don't
reactivate it in the haproxy pools yet (it's already excluded from
the repository creation task).

Change-Id: Id4076e179bee82b03822f59803865eaa60118334
2019-07-26 22:09:18 +00:00
Jeremy Stanley
55f657c68d Swap gitea02 into service and bring down gitea03
Add the gitea02.opendev.org server into the haproxy pools now that
it's been seeded with current data. Switch the create repos task
disable list from 02 to 03, and remove 03 from the Ansible inventory
and comment it out in the haproxy pools in preparation for
replacement.

Change-Id: I4b51291311064c60d4bb2d90bec6e5cb90a54f3c
2019-07-26 18:00:52 +00:00
Jeremy Stanley
9c5e54a89c Add gitea02 replacement to inventory
Add new IP addresses to inventory for the rebuild, but don't
reactivate it in the haproxy pools yet. Also switch the exclusion
for 01 to 02 for the repository creation task.

Change-Id: I6c4a437316627a723e6bb6c15fdce86a5e847042
2019-07-26 15:11:08 +00:00
Clark Boylan
c23ac25264 Remove gitea02 from inventory so we can replace it
The global inventory is used when launching nodes so if we want to
replace a server we have to remove it from the inventory first. This is
that step for replacing gitea02.

Note that when adding it back for the new server there are some edits to
make to the playbooks as noted in the gitea sysadmin docs.

We do also remove this instance from haproxy as well to prevent unwanted
connections while we flip things over.

Change-Id: I53a3f517d46d046cb59e3185ca19ba3df55d8466
2019-07-24 20:12:16 -07:00
Jeremy Stanley
5587c299ea Re-add gitea01 replacement to inventory
Add new IP addresses to inventory for the rebuild, but don't
reactivate it in the haproxy pools yet.

Note this switches the gitea testing to use a host called gitea99 so
that it doesn't conflict with our changes of the production hosts.

Change-Id: I9779e16cca423bcf514dd3a8d9f14e91d43f1ca3
2019-07-23 16:17:41 -07:00
Clark Boylan
a2af942fa3 Remove gitea01 from inventory so we can replace it
The global inventory is used when launching nodes so if we want to
replace a server we have to remove it from the inventory first. This is
that step for replacing gitea01.

Note that when adding it back for the new server there are some edits to
make to the playbooks as noted in the gitea sysadmin docs.

We do also remove this instance from haproxy as well to prevent unwanted
connections while we flip things over.

Change-Id: If32405b1302353f1f262a30b7392533f86fec1e4
2019-07-22 09:20:17 -07:00
Zuul
efc8e17c6e Merge "Add fortnebula ci mirror" 2019-07-03 18:14:48 +00:00
Clark Boylan
95f02c7aa7 Add fortnebula ci mirror
Note we depends on the DNS updates so that LE cert provisioning works
on the first pass.

Depends-On: https://review.opendev.org/668929
Change-Id: I953938b77bfce67be0cb55af5cf4bd64044100f4
2019-07-03 07:53:41 -07:00
Ian Wienand
ece14bbfb0 Add mirror-update01.opendev.org server
Add the new mirror-update server as a follow-on to
I525ac18b55f0e11b0a541b51fa97ee5d6512bf70.

Also ensure that the new mirror server isn't in the puppet groups by
only matching the openstack.org one.

Also remove from the afsadmin group.  This group is only used for
keytabs stored on bridge.o.o.  I don't think that we need group for
the keytabs -- a keytab should only ever be in use on one host at a
time, so we are better off keeping the keytabs in a specific host_var
for the host they are used on, rather than being in a group and
possibly deployed on servers where they are not used.

Depends-On: https://review.opendev.org/668610
Change-Id: Icda92bb234adc00f6718c1c656e8f069ce2704c4
2019-07-02 17:34:09 +10:00
Zuul
b3776ca3b0 Merge "Add OVH GRA1 mirror" 2019-07-01 02:15:40 +00:00
Ian Wienand
7810230408 Add OVH GRA1 mirror
This mirror will be manually configured with kafs (see
https://review.opendev.org/623974).  This should be a nice distant
geographic counterpoint to the IAD RAX server.

This will need to be manually configured with a custom kernel for now,
but fixes are making their way upstream and this host will be
converted when available.

Depends-On: https://review.opendev.org/667529
Change-Id: I6a22933029c096c781c93c33e6edf03bf59223c9
2019-06-27 10:07:44 +10:00
Clark Boylan
3734f000f9 Enroll new gitea06 into ansible inventory
We add the new host so that it will get configured as a gitea backend
server. We exclude this server from the list of gitea hosts to configure
git repos on because we want to recover its DB from one of the other
sibling nodes first. This should preserve the http redirects for us.

Once we have the db recovered we can enable replication from gerrit then
readd this host to the haproxy load balancer.

Change-Id: Ia2a98e5ded43cad044db36ca8d0da5a96277afee
2019-06-25 15:16:59 -07:00
Clark Boylan
263ab148fe Remove gitea06 from our inventory file
Note we don't fully remove it from cacti and hiera and so on because we
are replacing this server and we just want ansible to ignore the old
gitea06 for a bit while we bootstrap the new server.

Change-Id: Iaa89e77c055d8099a7d3d511723782fead43ce74
2019-06-25 14:03:44 -07:00
Ian Wienand
5981df66ea Fix syntax for new mirror hosts
Fix for I0e55d2c575427e404709e78d0c7a10a974117ac4 ... how this passed
gate testing to be determined ...

Change-Id: I834411ef2dee458ae15fb99a3c88b6d2fee4cf1e
2019-06-12 09:34:10 +10:00
Ian Wienand
66495f7a84 Add RAX IAD/ORD opendev.org mirrors
Change-Id: I0e55d2c575427e404709e78d0c7a10a974117ac4
Depends-On: https://review.opendev.org/663849
2019-06-11 09:36:16 +10:00
Zuul
4166abf258 Merge "Remove opendev k8s cluster from inventory" 2019-05-29 15:23:09 +00:00
Clark Boylan
0848e0760b Remove the ask.openstack.org inventory entry
This trusty server has been replaced by xenial ask01.openstack.org.

Change-Id: I33090c9ce45982e19d4ef85c156e76e7583a07af
2019-05-23 12:20:09 -07:00
Clark Boylan
08152aa22f Remove groups configuration
This removes the groups servers from our inventory as well as our
manifests/modules. We don't run the groups service anymore as many
groups migrated to meetup.com independent of us and the others have
transitioned there.

Change-Id: I7cb76611e6d30e7189821923f36a38dec9ea7241
2019-05-23 12:20:04 -07:00