55 Commits

Author SHA1 Message Date
Clark Boylan
217f2e75d2 Remove airship-kna1 from bridge clouds.yaml
We hold off on landing this until we're sure all the cleanup is done
with this cloud provider. Removing it with everything else would make
cleanup more difficult.

Change-Id: I905a37b430cb313b10a239d7d1b843404af06403
2022-03-01 11:54:53 -08:00
Clark Boylan
b7ccc12a6b Remove airship-citycloud resources
We've been told these resources are going away. Trying to remove them
gracefully from nodepool. Once that is done we can remove our configs
here.

Depends-On: https://review.opendev.org/c/openstack/project-config/+/831398
Change-Id: I396ca49ab33c09622dd398012528fe7172c39fe8
2022-03-01 11:39:53 -08:00
Mathieu Gagné
d518f8c02c Introduce iweb cloud configs
INAP mtl01 region is now owned by iWeb. This updates the cloud launcher
to use the new name and instructs the mirror in this cloud to provision
ssl certs for the old inap and new iweb names as well as updating
clouds.yaml files.

Change-Id: I1256a2e24df1c79dea06716ae4dfbcfe119c13f8
2021-08-31 13:42:22 -07:00
Ian Wienand
3af0d3736b nodepool clouds: adds stats prefix
This adds a metrics prefix
(https://review.opendev.org/c/openstack/openstacksdk/+/786814) to each
of our clouds so that we start logging API stats separately again.
See also https://review.opendev.org/c/zuul/nodepool/+/786862

Change-Id: I5910fcbf1b54fa3806a0cc2e539565d47b805d35
2021-05-03 21:48:21 +00:00
Clark Boylan
6b190a4751 Use External inmotion cloud network for zuul nodes
We have limited ipv4 address space in this cloud. Currently we can do
about 6 IP addresses for test nodes after we account for network
infrastructure and the mirror. By switching these instances to using the
external network directly we can clean up some of the neutron network
infrastructure which we think may free up 2 more IP addresses. That
should get us our originally intended max-servers of 8.

Change-Id: I705ff082ff06ae1c97f4c229a22893e6d87d206d
2021-04-22 09:53:19 -07:00
Clark Boylan
f1df36145d Add inmotion cloud to cloud launcher
This adds the new inmotion cloud to clouds.yaml files and the cloud
launcher config. This cloud is running on an openstack as a service
platform so we have quite a bit of freedom to make changes here within
the resource limitations if necessary.

Change-Id: I2aed6dffde4a1d6e3044c4bd8df4ca60065ae1ea
2021-04-21 11:18:40 -07:00
Ian Wienand
255a94f15c OSU OSL : change upload format to RAW
This will help the cloud stop having to copy around .qcow2 images.

Change-Id: I228c62b7b37547c0f7903d1339eeff648f24276b
2021-04-21 07:57:55 +10:00
Ian Wienand
1d9c721a64 OSU OSL : add default network
The public5 network has the most IP addresses available and is
recommended for use.

This cloud also has fixed public IP's, not floating

Change-Id: I7ae1bb0081d3a86149225c3400b53a9561ccffe6
2021-04-15 14:10:45 +10:00
Ian Wienand
f0260567d6 OSU OSL : fix typo in project id
Change-Id: Ibe053a157ae7aa191b7e25e7b1f8c15796453aed
2021-04-15 11:06:33 +10:00
Ian Wienand
efdaa9a12a Add OSU OSL to nodepool configuration
Change-Id: Id97345595a4463617bc1a93675d35e32cfff7d08
2021-04-14 12:34:06 +10:00
Ian Wienand
f705d90166 Fix typo on OSU OSL password template
Change-Id: I738b78321fb855eb84435be9af80a112b39a3aec
2021-04-14 11:09:11 +10:00
Ian Wienand
81db207d33 all-clouds: add OSU OSL project_id as well
Otherwise you get

 BadRequest: Expecting to find domain in project - the server could
 not comply with the request since it is either malformed or otherwise
 incorrect. The client is assumed to be in error.

Change-Id: If8869fe888c9f1e9c0a487405574d59dd3001b65
2021-04-13 13:31:49 +10:00
Ian Wienand
441c40ccf9 all-clouds: correct typo in OSU configuration
Change-Id: I087971f1eb2e4fe83896add8ce4381ec2506ad67
2021-04-13 11:35:24 +10:00
Ian Wienand
28ffbfb12c Add OSUOSL cloud
The Oregon State University Open Source Lab (OSUOSL;
https://osuosl.org/) has kindly donated some ARM64 resources.  Add
initial cloud config.

Change-Id: I43ed7f0cb0b193db52d9908e39c04e351b3887e3
2021-04-12 09:31:51 +10:00
Jeremy Stanley
fd98a1750d Clean up OpenEdge configuration
The OpenEdge cloud has been offline for five months, initially
disabled in I4e46c782a63279d9c18ff4ba2944c15b3027114b, so go ahead
and clean up lingering references. If it is restored later, this can
be reverted fairly easily.

Depends-On: https://review.opendev.org/783989
Depends-On: https://review.opendev.org/783990
Change-Id: I544895003344bc8202363993b52f978e1c07d061
2021-03-31 01:42:36 +00:00
Ian Wienand
da6d1cbd06 Remove linaro-london cloud
This cloud is no longer used

Change-Id: I14ab277b3877f6674ec3172c06a39f383e76a1d0
Depends-On: https://review.opendev.org/728332
2020-05-16 10:14:09 +10:00
Ian Wienand
3a47fb5b8f Remove citycloud
This provider has been retired for now

Change-Id: Ia5cdda34cb50eebb2d7920eb3010db6ab7d89fd6
Depends-On: https://review.opendev.org/727902
2020-05-15 13:11:28 +10:00
Monty Taylor
8af7b47812 Get rid of all-clouds.yaml
We had the clouds split from back when we used the openstack
dynamic inventory plugin. We don't use that anymore, so we don't
need these to be split. Any other usage we have directly references
a cloud.

Change-Id: I5d95bf910fb8e2cbca64f92c6ad4acd3aaeed1a3
2020-04-09 16:44:20 -05:00
Monty Taylor
589521fd18 Remove run_all.sh and ansible cron job
Remove the script and the cronjob on bridge that runs it.

Change-Id: I45e4d9713f3ba4760ba384d13487c6214d068800
2020-04-08 10:46:55 -05:00
Ian Wienand
56681deb80 Switch linaro-us cloud to ipv6 only
There are insufficient ipv4 floating-ips to cover our VM quota; switch
to ipv6 only so all vm's can boot.

Change-Id: I2225fa9ea888bcf167be7139e036a4b5406b1f4f
2020-03-31 11:44:17 +11:00
Monty Taylor
4178296b49 Override RAX block storage endpoint
This is required because RAX have an odd /v2 that isn't listed in the
catalogue but actually exists (but isn't really full /v2/ support).
It became a problem when recent client versions dropped /v1 support,
so now we have to force them to v2 like this.

Depends-On: https://review.opendev.org/714624
Change-Id: I6f139d2b3036ef0ecaddf3a9a225faae3a2b0450
2020-03-25 08:34:46 +11:00
Ian Wienand
dd489067a9 nodepool config: remove builder template, fix base template
Change I9ca77927046e2b2e3cee9a642d0bc566e3871515 updated the
nodepool-builder_opendev group to deploy it's config into
/etc/openstack, but updated the wrong template.

The nodepool_builder_clouds.yaml.j2 file was an old, unreferenced copy
from left-over from Id1161bca8f23129202599dba299c288a6aa29212 when we
wanted to use nodepool to manage control-plane clouds.  That didn't
work out so well and I think we just missed cleaning it up with
I5e72928ec2dec37afa9c8567eff30eb6e9c04f1d.

Remove it now, and port the path changes into the correct config file.

Change-Id: I37af69b342b413df94435e59a7c16bb218183399
2020-03-19 10:20:07 +11:00
Ian Wienand
b967495dc3 nodepool-builder: put container configs in /etc
Currently we deploy the openstacksdk config into ~nodepool/.config on
the container, and then map this directory back to /etc/openstack in
the docker-compose.  The config-file still hard-codes the
limestone.pem file to ~nodepool/.config.

Switch the nodepool-builder_opendev group to install to
/etc/openstack, and update the nodepool config file template to use
the configured directory for the .pem path.

Also update the testing paths.

Story: #2007407
Task: #39015
Change-Id: I9ca77927046e2b2e3cee9a642d0bc566e3871515
2020-03-17 07:37:00 +11:00
Jeremy Stanley
43ed9fc297 Moving FortNebula to OpenEdge
Sister change for Ia5caff34d3fafaffc459e7572a4eef6bd94422ea and
removing earlier references to the mirror server in preparation for
building and adding the new one.

Change-Id: I7d506be85326835d5e77a0c9c461f2d457b1dfd3
2020-03-06 20:43:56 +00:00
Clark Boylan
9166780b54 Add airship CI cloud
This is a new cloud provided via citycloud that will add resources
capable of running Airship jobs. The goal is to use this as a stepping
stone to having Airship jobs run on our generic CI resources. This cloud
will provide both generic and larger resources to support this.

Change-Id: I63fd9023bc11f1382424c8906dc306cee5b3f58d
2020-01-31 14:46:02 -08:00
Clark Boylan
a45278dbb0 Set rax api versions for volume and identity
Rax APIs don't support newer identity v3 or volume v2/v3. Set identity
to v2 so that catalogs can be listed and volume to v1 so that volumes
can be listed.

Change-Id: I6dddf93fb2c7b1a73315629e4a983a2d5a0142cc
2020-01-27 11:33:57 -08:00
Ian Wienand
c3c96d3797 Add Linaro US cloud
Add the credentials for the newly provisioned us.linaro.cloud cloud

Change-Id: I0b81a8eeabec4e0b00258dc4e499c1d449b21681
2020-01-22 06:44:01 +11:00
Zuul
8c75f8137d Merge "Remove arm64ci (3/2)" 2019-11-13 20:27:07 +00:00
James E. Blair
5304165f7d Remove linaro-cn1
This cloud was mostly removed, except for this bit.

Change-Id: Ie37abb4fd3eb3342b66ade52ab65024c420d7264
2019-10-04 09:32:39 -07:00
James E. Blair
b5d37bfaa2 Remove arm64ci (3/2)
This cloud no longer exists.

Change-Id: Iec9d98c7bcf3c4cd3f9853bb059e3ee2efc31e87
Depends-On: https://review.opendev.org/686761
2019-10-04 09:20:33 -07:00
Jens Harbott
7df5981e12 Be explicit about fortnebula networks with nodepool
We don't want nodepool to use floating IPs in the fn cloud as it is an
ipv6 only cloud. We explicitly tell it there is no fip source and that
the tenant network routes ipv6 externally. This config is based on the
limestone configuration which is a similar cloud network wise.

Change-Id: I4a27a22a5beb9c5fc9d3e16cd2ca5b41aecbb46f
2019-07-31 08:36:23 -07:00
Clark Boylan
ffcd1791bf Cleanup nodepool builder clouds.yaml
We ended up running into a problem with nodepool built control plane
images (has to do with boot from volume not allowing us to delete images
that are in use by a nova instance). We have decided to clean this up
and go back to not doing this until we can do it more properly.

Note this isn't a revert because having a group for access to control
plane clouds does seem like a good idea in general and I believe there
have been changes we'd have to resolve in the clouds.yaml files anyway.

Depends-On: https://review.opendev.org/#/c/665012/
Change-Id: I5e72928ec2dec37afa9c8567eff30eb6e9c04f1d
2019-07-22 13:55:29 -07:00
Clark Boylan
c27f0ab838 Use qcow2 images on fortnebula
They upload more quickly and take up less disk space.

Change-Id: Ic6069299ae32d148f7cffbc80db00b728cc6db92
2019-07-02 14:09:12 -07:00
Clark Boylan
3cc931b72d Add clouds.yaml entries for fortnebula cloud
Donnyd has kindly offered us access to fortnebula's test cloud. This
adds clouds.yaml entries to bridge and nodepool so that we can take
advantage of these resources.

Change-Id: I4ebc261c6f548aca0b3f37dc9b60ffac08029e67
2019-06-28 11:17:48 -07:00
Monty Taylor
ff1b8a94c6 Add control plane clouds to nodepool builder clouds.yaml
In order to have nodepool build images and upload them to control
plane clouds, add them to the clouds.yaml on the nodepool-builder
hosts. Keep them out of the launcher configs by splitting the config
templates. So that we can keep our copies of things to a minimum,
create a group called "control-plane-clouds" and put bridge and nb0*
in it.

There are clouds mentions in here that we no longer use, a followup
patch will clean those up.

NOTE: Requires shifting the clouds config dict from
host_vars/bridge.openstack.org.yaml to group_vars/control-plane-clouds.yaml
in the secrets on bridge.

Needed-By: https://review.opendev.org/640044
Change-Id: Id1161bca8f23129202599dba299c288a6aa29212
2019-05-23 14:34:10 -05:00
Clark Boylan
6176978039 Force ipv4 on vexxhost nodepool nodes
Do this in an attempt to mitigate/work around the dns resolution
problems we have had in that cloud. One thoguht is that this could be
ipv6 specific.

Change-Id: I1f9ef4a031749484d06de9427943abac4de33d29
2019-05-14 11:54:43 -07:00
Ian Wienand
9cf66757bc Remove linaro-cn1 region
This region has been retired.  See also
I149e74ff5e788bb860deb4c3cc38d9c8ed5766c6

Change-Id: Ia85587a7bbe52a92d70d6cb96d843ee5f5fc84f6
2019-04-09 11:57:25 +10:00
James E. Blair
7610682b6f Configure .kube/config on bridge
Add the gitea k8s cluster to root's .kube/config file on bridge.

The default context does not exist in order to force us to explicitly
specify a context for all commands (so that we do not inadvertently
deploy something on the wrong k8s cluster).

Change-Id: I53368c76e6f5b3ab45b1982e9a977f9ce9f08581
2019-02-06 15:43:19 -08:00
Monty Taylor
330ffb394b
Update the current-context to valid context
The current-context field needs to reference a defined context. The file
otherwise defines only one "vexxhost-sjc1". Set current-context to that
context.

Change-Id: I1d8991efb5d546f007146fd2fa86ce2b2aeed286
2018-11-30 15:00:08 -06:00
James E. Blair
6368113ec9 Add kube config to nodepool servers
This adds connection information for an experimental kubernetes
cluster hosted in vexxhost-sjc1 to the nodepool servers.

Change-Id: Ie7aad841df1779ddba69315ddd9e0ae96a1c8c53
2018-11-28 16:24:53 -08:00
Ian Wienand
f295b5b44a Update citycloud project details
These names were taken from the citycloud web interface RC file, but
actually match what we already have in
playbooks/templates/clouds/nodepool_clouds.yaml.j2

Testing with this I can authenticate to openstackzuul-citycloud

Change-Id: Ic7aeb5c3a96e5594b8c9c396daaad7e79c1f5c63
2018-11-07 11:48:17 +11:00
Monty Taylor
cad774e65a
interface is not an auth option
interface indicates which of the public, internal or admin endpoints a
user wants to consume.

Change-Id: I061200bbf4477ab53ec6431c71baa8dda6bea6b5
2018-11-06 15:49:23 -06:00
Monty Taylor
20d966a9db
Add Lon1 and Sto2 to openstackzuul cloud entry
These are missing, so cloud launcher is sad.

Change-Id: Ie74259a3e6acc2d6fc6c40ac42e0c80997208f85
2018-11-06 11:19:44 -06:00
Zuul
9679f57225 Merge "Add Arm64 CI cloud" 2018-11-06 01:21:48 +00:00
Gary Perkins
10c8da0e90 Add Arm64 CI cloud
Changes:
  * Set URLs to https://
  * Set new keystone domain
  * Set region to nrt1

Change-Id: Ib96d14008ab3b8b7c12429d7432eaa485c404bb2
2018-11-02 12:22:15 +00:00
Monty Taylor
449158138e
Update clouds.yaml for citycloud with new auth info
citycloud is rolling out per-region keystone. There is a change with an
error in it in the latest openstacksdk, so put the right auth_url into
the files directly while we update it and release it again.

Additionally, Sto2 and Lon1 each have different domain ids. The domain
names are the same though - and that's good, because logical names are
nicer in config files anyway.

Restore the config for those clouds.

Change-Id: If55d27defc164bd38af2ffd1e7739120389422af
2018-10-22 18:57:55 -05:00
Clark Boylan
709e7c09cd Cleanup Citycloud Sto2
This region does not show up in catalog listings anymore and is causing
inventory generation for ansible to fail. This change removes Sto2 from
the management side of things so that we can get ansible and puppet
running again.

This does not cleanup nodepool which we can do in a followup once
ansible and puppet are running again.

Change-Id: Ifeea238592b897aa4cea47b723513d7f38d6374b
2018-10-22 13:47:01 -07:00
Clark Boylan
133a94361a Cleanup Citycloud Lon1
This region does not show up in catalog listings anymore and is causing
inventory generation for ansible to fail. This change removes Lon1 from
the management side of things so that we can get ansible and puppet
running again.

This does not cleanup nodepool which we can do in a followup once
ansible and puppet are running again.

Change-Id: Icf3b19381ebba3498dfc204a48dc1ea52ae9d951
2018-10-15 10:27:44 -07:00
Clark Boylan
36ca17c37b Force identity api version 3 against linaro london
Keystone auth and openstacksdk/openstackclient do not do the correct
thing without this setting set. They try v2 even though the discovery
doc at the root url does not list that version as valid. Force version 3
so that things will work again.

Change-Id: I7e1b0189c842bbf9640e2cd50873c9f7992dc8d3
2018-09-12 12:52:19 -07:00
Ian Wienand
20c0340c3c Add Linaro London cloud
The Linaro London cloud runs as a separate entity to the existing
cloud, so add it separately.

Change-Id: Ia263034de4c8d1ac52f4521d4c82374b06a68e68
2018-09-11 17:04:40 +10:00