1489 Commits

Author SHA1 Message Date
Monty Taylor
bab6fcad3c
Remove base.yaml things from openstack_project::server
Now that we've got base server stuff rewritten in ansible, remove the
old puppet versions.

Depends-On: https://review.openstack.org/588326
Change-Id: I5c82fe6fd25b9ddaa77747db377ffa7e8bf23c7b
2018-08-16 17:25:10 -05:00
Zuul
983fa5269a Merge "Cleanup nodepool.openstack.org to be a zk server" 2018-08-13 23:00:52 +00:00
Zuul
4c3997d948 Merge "Use nodepool-builder.logging.conf from puppet-nodepool" 2018-08-13 22:32:15 +00:00
Zuul
8f8d0ac127 Merge "Remove references to long-gone odsreg.o.o service" 2018-08-13 16:53:51 +00:00
Zuul
06602fbdcf Merge "Remove references to stackalytics.o.o" 2018-08-09 08:50:58 +00:00
Colleen Murphy
46ebeeb4fb Remove references to stackalytics.o.o
stackalytics.openstack.org does not resolve and seems very dead. Remove
its node from site.pp and remove it from the docs to avoid confusion
about what servers we're really managing. We can always add it back when
the time comes to try again.

Change-Id: I733130ebe97ae7e06ca57b3c8e3a8708fcfa069c
2018-08-07 22:12:43 +02:00
Jeremy Stanley
30f3039f1e Remove references to long-gone odsreg.o.o service
The odsreg.openstack.org server was removed from service 2018-01-11,
and should also be cleared from our global site manifest. It was the
only thing utilizing the puppet-odsreg module, so we can take that
out of the modules list as well (that will be retired separately).

Change-Id: Iadfddb3bf57428b928cacaaa672e24c4a1e92058
2018-08-07 19:52:13 +00:00
Ian Wienand
cbff37f82e Cleanup nodepool.openstack.org to be a zk server
This is just a zookeeper server now, so doesn't need all these
passwords, a cloud.yaml file or a launcher-esque deployment.

Change-Id: I3cb20d9c8af150ecdc1fb0a16208a774e3fb530f
2018-07-30 14:12:33 +10:00
David Shrewsbury
10e4c57128 Use nodepool-builder.logging.conf from puppet-nodepool
Generating a openstack-infra specific version of this file was
deprecated with change I6fdc3b622454b069f3ad2cf42da584d8df23a110 when
build logs was moved out of Python logging.

This means (post the depends-on) the file is exactly as kept in
puppet-nodepool.  Remove the system-config template and just use that.

Depends-On: https://review.openstack.org/586231
Change-Id: I2db37868be12c146678f1c8934db80050c788540
2018-07-30 14:07:53 +10:00
James E. Blair
a1163f9952 Fix syntax of gerrit host ssh keys
We need to wrap the hostnames/ips with []s and supply the port numbers
for the files to be effective with paramiko.

Change-Id: Iab12951a828b7c27ef2255137a6bc0b69ca3a770
2018-07-27 14:38:34 -07:00
James E. Blair
6402f98d12 Add opendaylight connection to zuul
This adds a connection to the opendaylight Gerrit server to zuul
so that we can perform cross-community testing.

Change-Id: I846983e873072c2235a4c49e36f602a47d06cfce
2018-07-26 13:56:15 -07:00
Paul Belanger
55b04c9ce9
Bring ze11.o.o online
This brings online our 11th zuul-executor, and opens the required
firewall ports.

Change-Id: If0ee569a2d14caeeb912b7382160f47d460650ab
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-07-20 16:18:37 -04:00
Zuul
0fb4948eb6 Merge "Add git.starlingx.io" 2018-06-27 21:30:28 +00:00
Clark Boylan
8f9db69c81 Don't use snakeoil files with real certs
The refstack puppetry is set up to use snakeoil certs by default which
is great for bootstrapping; however, our production instance has real
certificate issued to it and we shouldn't write that to the snakeoil
cerrt files to avoid confusion.

Specificy refstack specific certificate, key, and intermediate chain
file locations to clean this up and allow us to revert our snakeoil
certs to proper untrusted self signed certs.

Change-Id: Ibbcdd93a2ae38d9063b1f88f90ebdaadcac9b585
2018-06-22 15:38:37 -07:00
Zuul
d8e1ad6b87 Merge "Template credentials for Packet Host/Platform 9" 2018-06-12 16:20:57 +00:00
Jeremy Stanley
acb2e9e6f0 Template credentials for Packet Host/Platform 9
Packet Host and Platform 9 have generously agreed to donate some
compute resources to our testing efforts. Add Nodepool and
Puppetmaster credentials for them.

Change-Id: I705c4204abca060c35a1a417791a67229b78cd02
2018-06-12 00:59:09 +00:00
Clark Boylan
73aadfd49f Apply up to date gerrit host key to zuul servers
Apply the review.o.o ssh rsa host key to all of our active zuul servers.
Update the ip addresses in that host key entry to reflect the current
server's IP addrs too.

Change-Id: I147ff0b9547f2cee36d7c56c8f5352ece8a4ec82
2018-06-07 11:56:48 -07:00
Clark Boylan
8304b9626c Revert "Add opendaylight connection to zuul"
This reverts commit c7bb14bba6ec00fff61879154a3f5f143c98767b.

SSH connectivity isn't quite working yet. Revert until we can get that
sorted out.

Change-Id: If2a88a61ed592f927980c71486ed0b7e3cb848d0
2018-06-07 08:47:19 -07:00
Dean Troyer
6a912d2787 Add git.starlingx.io
Change-Id: Ie54b0cb24a7b91ba64add6177ba6d2c167fdb601
2018-06-06 09:42:51 -05:00
Zuul
f704863313 Merge "Add opendaylight connection to zuul" 2018-06-05 19:21:42 +00:00
Ian Wienand
0b21d2f61a Allow mirror-update.o.o to produce stats
Open the firewall port for mirror-update so we can start logging some
stats about AFS partition and volume usage, initially for a grafana
dashboard.

Change-Id: I361e7213ed4b4ed4d3fcc8fdbee06e2fe677934a
2018-06-01 17:09:48 +10:00
Zuul
eea6c0e468 Merge "This patch impliments the survey spec: I3c389596373b94459a32a4e540d514a2941acbb1" 2018-05-31 19:46:25 +00:00
James E. Blair
c7bb14bba6 Add opendaylight connection to zuul
This adds a connection to the opendaylight Gerrit server to zuul
so that we can perform cross-community testing.

Change-Id: I840b24ebe52c50840180f2dda40a3f8669baa347
2018-05-31 16:43:51 +00:00
Zuul
35655d20d0 Merge "Open port 443 for builder logs" 2018-05-21 08:19:13 +00:00
Ian Wienand
0896b902de Open port 443 for builder logs
Follow-on to Ifd5823ff51de40226c72930c69faf50b677a7dfe to open the
port for SSL.

Change-Id: Iceeb04c473baaf6d90b63aa066bf18ee30c7b119
2018-05-21 17:07:16 +10:00
Zuul
7e8b294d99 Merge "nodepool-builder: use SSL for log and artefact export" 2018-05-21 04:21:35 +00:00
Clark Boylan
6e67f14f56 Pass airshipit cgit config through to git_backend.pp
We need the ssl cert data passed through otherwise httpd refuses to
start.

Change-Id: Icc61860918059216da61f992e472531990e38219
2018-05-20 16:50:15 -07:00
Ian Wienand
779b6c152a nodepool-builder: use SSL for log and artefact export
We want this more for it's transparent-cache busting effects than
security, but we live in a https world.  This starts with self-signed
certificates, which might even be enough as it is really only
developers who are interested in build logs and test images.

Change-Id: Ifd5823ff51de40226c72930c69faf50b677a7dfe
Depends-On: https://review.openstack.org/569007
2018-05-17 14:00:48 +10:00
Jeremy Stanley
229da319f6 Add zuulci.org Web site redirects
Alias the zuulci.org and www.zuulci.org typos to the zuul-ci.org
site, now that we serve the domain for them from our nameservers.
The openstack_project::website class will automatically perform a
permanent redirect to the canonical site name.

Change-Id: I02ff1caf874bb1b922afaf9f60eca53c4f53aee6
2018-05-15 18:22:09 +00:00
Jeremy Stanley
ff0579ad5c Add zuulci.org typo domain
In an effort to thwart egregious typosquatting, host a zuulci.org
domain which will serve as an alias for the canonical zuul-ci.org.

Change-Id: If878ab310acd513d981fd37e954b0abeb7a7ed76
Depends-On: https://review.openstack.org/568661
2018-05-15 18:22:09 +00:00
Anita Kuno
06bbf62fc4 This patch impliments the survey spec:
I3c389596373b94459a32a4e540d514a2941acbb1

Co-Authored-By: Jeremy Stanley <fungi@yuggoth.org>
Change-Id: Iad9e5bde37c467b9930c354f4d0b312b219d05b3
Story: 2000691
Task: 3164
2018-05-11 17:02:29 -04:00
Zuul
5ef7153523 Merge "Remove some testing on ubuntu-trusty" 2018-05-07 03:59:09 +00:00
Paul Belanger
db9478f74b
Remove some testing on ubuntu-trusty
All of these servers have been migrated to ubuntu-xenial.

Change-Id: Ib5f08879ecce5d26bdaed2d34e8b537be54c25c5
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-05-02 18:01:43 -04:00
Paul Belanger
e22ec8aab0
Finish gerrit install for review01.o.o
Now that volumes have been attached to review01.o.o, allow puppet
to finish the gerrit configuration.

Change-Id: I710bb46f0daf5494c7b3f7ccbe5adbb6dcde153d
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-05-01 15:28:28 -04:00
Zuul
881f9a5943 Merge "Stop managing infracloud things" 2018-04-25 22:15:14 +00:00
Colleen Murphy
ac9a031e32 Stop managing infracloud things
Infracloud is sadly deceased. The upside is we can delete a lot of code
we don't need anymore. This patch removes infracloud nodes from
site.pp so that the puppet-apply test no longer bothers to validate
them, removes the infracloud modules from modules.env so that we don't
bother to install those modules in puppet-apply and puppet functional
tests, and removes the infracloud-specific data from the public hiera.
Additionally stop the puppetmaster from trying to run the infracloud
ansible playbook and finally remove the chocolate region from nodepool's
clouds.yaml (vanilla was already done).

This patch leaves the run_infracloud.sh script and the
infracloud-specific ansible playbooks as well as the infracloud
manifests in the openstack_project puppet module. It's possible those
tools could come in handy in the future if we ever have another
infracloud, and leaving those tools in place doesn't add confusion about
which hosts are actually active nor does it leave cruft that gets
unnecessarily tested.

Change-Id: Ic760cc55f8e17fa7f39f2dd0433f5560aa8e2d65
2018-04-24 09:13:40 +02:00
Jeremy Stanley
a9b131346b Override the default_url for StoryBoard servers
In order to provide useful URLs in E-mail notifications, set the
default_url for the openstack_project::storyboard class.

Change-Id: I70cc33e73b3cff6855270d46e1dd40940221b0d1
Depends-On: https://review.openstack.org/555237
2018-04-18 20:47:07 +00:00
Matthew Treinish
0d799489ce
Re-enable the websockets tls port
Since we re-enabled the websockets port in change
Id9bb77ef9a2ac70eec74db4ea64423b5d6351a06 things having quite stable.
Connections to mosquitto over websockets hasn't crashed. Since things
have been stable this commit unblocks the tls websockets port for
firehose.o.o and switches it to the standard 443 for https instead of
the default 8080 we were using before. This should enable websites
trying to use the firehose over websockets from https server.

Change-Id: I1b08eabf22f5345a9b4ebfae5d3dab08270efbf9
2018-04-13 19:36:42 -04:00
Zuul
5d071b7fcc Merge "Create review group for hieradata" 2018-03-29 18:48:54 +00:00
Monty Taylor
369148597a
Pass web settings to zuul::web
The web related settings are relevant to zuul::web, not to zuul. Add
them here.

Change-Id: I7160826b9213f0c629374051f7c7043b553e00ed
Depends-On: https://review.openstack.org/557084
2018-03-27 17:42:30 -05:00
Zuul
ae82941339 Merge "Add git.zuul-ci.org cgit site" 2018-03-27 15:43:17 +00:00
James E. Blair
109a5731c7 Add git.zuul-ci.org cgit site
The referenced key has been added to hiera.

Change-Id: Id94db69498c462cb97c3721e96a645e5192a0b97
Depends-On: https://review.openstack.org/555968
Story: 2001382
Task: 6092
2018-03-26 17:16:31 -07:00
David Moreau Simard
f28c90fad8
Fix permissions for certificate files in nodepool's home directory
It worked the way things were before but it's cleaner to have them
nodepool/nodepool and 0600.

Change-Id: Ieebbd9d6fdc65c04263294c680e64fc5e561d82d
2018-03-24 21:31:23 -04:00
David Moreau Simard
cb48653415
Fix bad path for limestone certificate on nodepool servers
Copy/pasta from puppetmaster.o.o meant that we tried to put and use
the certificate in /etc/openstack/ which is not a thing on nodepool
nodes.

Fix that to be the right location and update the nodepool clouds.yaml.

Change-Id: Ib9c17a58fc2aa9ad5eb9091a6a3fd23ff5825731
2018-03-24 15:33:12 -04:00
Paul Belanger
d3071deb03
Create review group for hieradata
Rather then creating per fqdn hiera entries for secrets, move to use a
group. This avoids the need to duplicate data.

Change-Id: I2208343b5281f70fc0850c0fe4e85038a53ed189
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-03-23 09:56:53 -04:00
Zuul
cec61a61e1 Merge "Add limestone credentials to nodepool's cloud.yaml" 2018-03-23 00:24:31 +00:00
David Moreau Simard
ead85b623f
Add limestone credentials to nodepool's cloud.yaml
This makes the credentials available so nodepool launcher and builder
can use them.
The limestone credentials have been added to hiera for the nodepool
group.

Change-Id: Idb56db19110e6b30f6231869ff278b90caf99f4b
2018-03-22 18:16:30 -04:00
Paul Belanger
a630bec2eb
Add gerrit_configure flag to review01.o.o
This will allow us to bootstrap a server with gerrit users, then
attach the volumes with hold the git repos for gerrit, then we can
remove this flag and properly puppet the rest of the server.

We also create a 2nd node in site.pp as we need both server to be
online for about 2 weeks, this is to give users enough time to make
firewall changes if needed for the new IP address

Related-to: I9159c941ece4f6928204601b9933d7a953baa2dd

Change-Id: I88826298818a690d4c98b60a9fbf444fba48cef6
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-03-22 11:35:10 -04:00
Paul Belanger
bc6f1d388b
Finish gerrit install for review-dev01.o.o
Now that volumes have been attached to review-dev01.o.o, allow puppet
to finish the gerrit configuration.

Change-Id: I392b26fcb3a787dc1a3022b0c3a6d0f9758526f6
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-03-21 16:47:34 -04:00
Paul Belanger
01899d7ab8
Add gerrit_configure flag to review-dev01.o.o
This will allow us to bootstrap a server with gerrit users, then
attach the volumes with hold the git repos for gerrit, then we can
remove this flag and properly puppet the rest of the server.

Change-Id: I9159c941ece4f6928204601b9933d7a953baa2dd
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-03-20 15:35:05 -04:00