2020 Commits

Author SHA1 Message Date
Ian Wienand
270daa1b1a Serve meetings.opendev.org
This site replaces eavesdrop.openstack.org.  I think this name makes
more sense.

That is/was being published by jobs directly pushing this onto the
eavesdrop server.  Instead, the publishing jobs for irc-meetings now
publish to /afs/openstack.org/project/meetings.opendev.org.  This
makes the site available via the static server.

This is actually a production no-op; nothing has changed for the
current publishing.  It is still todo to figure out the correct
redirects to keep things working from the existing
eavesdrop.openstack.org and stop the old publishing method.

Depends-On: https://review.opendev.org/c/opendev/zone-opendev.org/+/794085
Change-Id: Ia582c4cee1f074e78cee32626be86fd5eb1d81bd
2021-06-02 13:56:19 +10:00
Ian Wienand
35ae5368c6 bridge: upgrade to Ansible 4.0.0
This is Ansible-core <2.12,>2.11.0 with community collections, which
includes debug plugin callsbacks, etc.

Change-Id: I13f72fc02549a84c01b901c58d7be18992c281bd
2021-06-02 06:33:51 +10:00
Ian Wienand
2dd1f176ce Add ARA artifact
The ara-report role used to add this but it hasn't been updated for
the latest ARA (I008b35562994f1205a4f66e53f93b9885a6b8754).  Add it
back here.

Change-Id: I2d56e7cde32cd7adabb359a35ecdaa9f0880f7d5
2021-06-02 05:58:11 +10:00
Zuul
bfa7e72f0d Merge "Update ARA" 2021-06-01 02:58:27 +00:00
David Moreau Simard
fb8a5145df Update ARA
ARA's master branch now has static site generation, so we can move
away from the stable branch and get the new reports.

In the mean time ARA upstream has moved to github, so this updates the
references for the -devel job.

Depends-On: https://review.opendev.org/c/openstack/project-config/+/793530
Change-Id: I008b35562994f1205a4f66e53f93b9885a6b8754
2021-06-01 09:38:32 +10:00
James E. Blair
fe2aa71eaf Run accessbot role before running accessbot
This will cause the config files to be updated (among several
other things we don't care about).

Change-Id: If1c1622eacbe820d5c7bdbb9681e673acbf88f98
2021-05-29 13:06:27 -07:00
Clark Boylan
0116b2d025 Assort IRC TODOs
We're moving to OFTC and this tries to capture the various types of
updates for bots and docs we'll need to do. I don't expect this to
be complete, but adds some good reminder for a few things we don't
want to miss.

Change-Id: I09f4c7aa1a2eb8cd167439d58ab4222f5e63a4b1
2021-05-29 17:18:55 +00:00
Jeremy Stanley
f691057b5b Update accessbot config to use OFTC
Now that accessbot has been altered to work with OFTC and its
channels list adjusted accordingly, switch the server parameter in
its configuration as well. The credentials have already been updated
in our private hostvars.

Change-Id: I84a6cfbaeed785f53c6f443b949ca53ef2d2494b
2021-05-28 18:37:33 +00:00
Zuul
addd3d3c53 Merge "Provision LE certs for openstackid.org" 2021-05-27 17:37:06 +00:00
Zuul
fce07e7602 Merge "Install pbr in pip3 role to fix issue xenial" 2021-05-27 16:39:06 +00:00
Jens Harbott
88139ef622 Install pbr in pip3 role to fix issue xenial
When installing bots on eavesdrop with py27/py35, there is a
regression with the latest pbr release. The workaround is to
have pbr preinstalled in the pip3 role.

Change-Id: I5ea790a50e180df36b480dcbb13530a80f398b5e
2021-05-27 12:35:25 +02:00
Zuul
f0560e1d6e Merge "Update certcheck additional domains" 2021-05-26 23:34:50 +00:00
Clark Boylan
7a0ab6c94e Provision LE certs for openstackid.org
This will provision LE certs for openstackid.org. If we are happy with
the results then the child change can be merged to to swap apache over
to using the new cert.

Change-Id: Icc9fdd8a39630323916d1f33d9867f93fc6f2b85
2021-05-26 13:28:27 -07:00
Clark Boylan
acea074df4 Update certcheck additional domains
* ask.o.o has been converted to LE
 * ethercalc.o.o has been converted to LE
 * storyboard.o.o has been converted to LE
 * translate.o.o has been converted to LE
 * openstackid-dev.o.o is fine without a valid cert

Change-Id: Ic7639f0e62d5269e35a5d909d67318cd74d0233e
2021-05-26 07:51:52 -07:00
Zuul
715dda2c8d Merge "ask.openstack.org static site" 2021-05-26 01:05:14 +00:00
Zuul
7a350a864a Merge "Provision LE cert for translate.openstack.org" 2021-05-25 23:09:13 +00:00
Zuul
c504339aa7 Merge "Provision LE cert for storyboard.openstack.org" 2021-05-25 19:43:47 +00:00
Zuul
14d99f9ae2 Merge "Provision ethercalc LE cert" 2021-05-25 18:06:54 +00:00
Ian Wienand
1fbd156697 ask.openstack.org static site
We have decided to decommision the ask.openstack.org server as it is
running EOL Xenial, and its manually purchased certiface is about to
expire.  Although it has been deprecated for some time, we feel like
it has been around long-enough as a resource that it is best if we
replace it with a place-holder.  The links included here are the same
as the currently shown header explaining the site is read-only.

There's nowhere particularly relevant to redirect the site, so we add
a static file here, and some minimal Ansible to put it in the right
place in a generic way in-case we want to do the same for another
service.

Change-Id: I8a31f8fcf9b3064c0ae58e463a6014dc14b518a7
2021-05-25 16:09:52 +10:00
Zuul
28094f7300 Merge "Symlink python3 to python for gerrit image build" 2021-05-25 06:09:01 +00:00
Clark Boylan
06d021e6e6 Provision LE cert for translate.openstack.org
This provisions the cert then when we are happy with the results we can
land the child change to swap the cert over in apache.

Change-Id: Id8e66102cf26a3b9819d4638b7589f44f6400634
2021-05-24 12:45:15 -07:00
Clark Boylan
ff99f21404 Provision LE cert for storyboard.openstack.org
This provisions the cert but doesn't switch apache to it. When we are
happy with the new cert we can land the child change which will flip
apache over to the new cert.

Change-Id: I9cffd26a51317ea569b078b89cc30dc34c7e7747
2021-05-24 12:35:09 -07:00
Clark Boylan
46edf8aeb0 Provision ethercalc LE cert
This runs the LE ansible alongside the ethercalc puppetry to get an LE
cert provision for this service. Once we are happy with the new cert we
can land the followup change to switch to the LE cert.

Note we don't add an altname for the host because that will require
extra DNS records in rax DNS.

Change-Id: I04c062eb994f672283aa30ffcc0c4d45fc8c50f6
2021-05-24 08:25:39 -07:00
Clark Boylan
6e04e500fd Remove system-config-legacy-logstash-filters job
We're trying to phase out the ELK systems. While we have agreed to not
immediately turn anything off we probably don't need to keep running the
system-config-legacy-logstash-filters job as ELK should remain fairly
fixed unless someone rewrites config management for it and modernizes
it. And if that happens they will want new modern testing too.

Depends-On: https://review.opendev.org/c/openstack/project-config/+/792710
Change-Id: I9ac6f12ec3245e3c1be0471d5ed17caec976334f
2021-05-21 17:03:32 -07:00
Clark Boylan
309ae73b8a Fixup openstack mailman template perms
We are using synchronize to copy the openstack mailman templates which
preserved the ownership and group and permissions of the source files on
bridge. This isn't a major problem but it is ugly so we fix it.

To fix it we set rsync_opts for synchronize to set a usermap and a
groupmap to map the bridge info to the data we want on the remote.

Change-Id: I209345cbe9e27beb18d1ba31e6715bf850bc022b
2021-05-19 12:21:14 -07:00
Zuul
9fbd1ccf2c Merge "Ansible mailman configs" 2021-05-19 15:55:09 +00:00
Monty Taylor
696b3671fb Symlink python3 to python for gerrit image build
Gerrit's bazel rules are looking for python which doesn't exist on our
images. Add a python symlink to python3 until
https://gerrit-review.googlesource.com/c/gerrit/+/298903 is in a release,
which seems likely to be 3.5.

Change-Id: I1c15cceac1c9bbf435ed23bed7c1e3fe868f05ff
2021-05-18 14:47:10 -05:00
Ian Wienand
51e3976273 Run haproxy as root user
The usptream haproxy image switched to running as a user, rather than
as root.  This means it can not bind to 80/443 and instantly dies.

I've added a comment with some discussion, but for now, use the root
user.

[1] 82ff028a25

Change-Id: Ic9b04cdd09f73d9df015bcb173871cff1ae58835
2021-05-17 14:28:37 +10:00
Jeremy Stanley
4189add2f7 Temporarily pin haproxy image to 2.3
The haproxy 2.4 images aren't working for us, docker-compose
perpetually reports the container in a "restarting" state. Pin back
from latest to 2.3 until we can sort out what needs to change in how
we integrate this on the server.

Change-Id: I01ae11a31eb8eaeb9e570692d5ec268395f69a97
2021-05-15 12:19:48 +00:00
Clark Boylan
d4176aff5b Sync zuul status json backup list with current tenants
This removes the kata-containers tenant backup entry as that tenant no
longer exists. We also add status json backups for the opendev,
vexxhost, zuul, pyca, and pypa tenants. This gets us in sync with the
current tenant list.

Change-Id: I8527676dda67915e6ebe0d1c5fde7a57a7ac2e5b
2021-05-14 10:32:07 -07:00
Clark Boylan
39f10b5fe5 Fixup small issues on new zuul scheduler
This fixes the zuul debug log's logrotate filename. We also increase the
rotation count to 30 daily logs for all zuul scheduler zuul processes
(this matches the old server).

We also create a /var/lib/zuul/backup dir so that status.json backups
have a location they can write to. We do this in the base zuul role
which means all zuul servers will get this dir. It doesn't currently
conflict with any of the cluster members' /var/lib/zuul contents so
should be fine.

Change-Id: I4709e3c7e542781a65ae24c1f05a32444026fd26
2021-05-14 08:20:56 -07:00
Clark Boylan
c743b7e484 Clean up zuul01 from inventory
This cleans up zuul01 as it should no longer be used at this point. We
also make the inventory groups a bit more clear that all zuul servers
are under the opendev.org domain now.

Depends-On: https://review.opendev.org/c/opendev/zone-opendev.org/+/790483
Change-Id: I7885fe60028fbd87688f3ae920a24bce4d1a3acd
2021-05-13 06:58:36 -07:00
Clark Boylan
533594d959 Add zuul02 to inventory
This zuul02 instance will replace zuul01. There are a few items to
coordinate when doing an actual switch so we haven't removed zuul01 from
inventory here. In particular we need to update gearman server config
values in the zuul cluster and we need to save queues, shutdown zuul01,
then start zuul02's scheduler and restore queues there.

I believe landing this change is safe as we don't appear to start zuul
on new instances by default. Reviewers should double check this.

Depends-On: https://review.opendev.org/c/opendev/zone-opendev.org/+/791039
Change-Id: I524b456e494124d8293fbe8e1468de40f3800772
2021-05-13 06:58:30 -07:00
Clark Boylan
4c4e27cb3a Ansible mailman configs
This converts our existing puppeted mailman configuration into a set of
ansible roles and a new playbook. We don't try to do anything new and
instead do our best to map from puppet to ansible as closely as
possible. This helps reduce churn and will help us find problems more
quickly if they happen.

Followups will further cleanup the puppetry.

Change-Id: If8cdb1164c9000438d1977d8965a92ca8eebe4df
2021-05-11 08:40:01 -07:00
Zuul
712bd77e62 Merge "Remove some unnecessary debug: statements" 2021-05-07 03:03:35 +00:00
Ian Wienand
984580f96d Remove some unnecessary debug: statements
With the roles now in production, these debug statements are more
noise than help.

Change-Id: I3da4ac0ae1f8ea8b64ab8d6ba75ccb110787db2e
2021-05-07 11:11:56 +10:00
Ian Wienand
320bd0406c certcheck: cleanup letsencrypt domains
Several of these domains have migrated to be deployed via our
letsencrypt roles and thus no-longer need special casing in the
certcheck list as they are automatically added now.

Change-Id: Id417db6af09f3ba96bb6da09d8cbf28dd8ddf276
2021-05-07 11:01:38 +10:00
Zuul
b87ed55db3 Merge "reprepro: mirror Ubuntu UCA Xena" 2021-05-06 02:02:09 +00:00
Zuul
2cf61a5aee Merge "Add support for Xenial ESM repos to our base roles" 2021-05-05 19:54:34 +00:00
Marcin Juszkiewicz
8c90c2a611 reprepro: mirror Ubuntu UCA Xena
Change-Id: I918baf8bc9f4c7bb28c471875c04e4ff2ff2c508
2021-05-05 17:44:48 +02:00
Zuul
fec37d6534 Merge "Deprovision Limesurvey config management and docs" 2021-05-05 00:37:39 +00:00
Zuul
8faf9a8a49 Merge "nodepool clouds: adds stats prefix" 2021-05-04 20:28:00 +00:00
Clark Boylan
bf658dacda Add support for Xenial ESM repos to our base roles
This will run the ua tool to attach an UA token and to enable the
esm-infra repos. We also update unattended upgrades to auto pull
security updates from the ESM repos.

Change-Id: Ifb487d12df7b799d5fd2973d56741e0757bc4d4f
2021-05-04 08:46:06 -07:00
Ian Wienand
58ba847c07 gerrit: enable plugin reload in dev mode
With a pure javascript plugin, dropping a new file in the plugins/
directory and reloading the page is sufficient to see changes.
However, with .jar plugins (as zuul-summary-plugin now is) you need to
actually issue a reload, which requires the included permissions.

Enable it dev mode, which is where you'll very likely be trying to
iterate development with a change to a plugin.  I don't think it's
really that dangerous for production, but traditionally it's been off
there so let's leave it like that.

While we're here, write out a little script to help you quickly deploy
a new .jar of the plugin when we're testing.

Change-Id: I57fa18755f8a8168da12c48f1f38d272da1c6599
2021-05-03 22:37:55 +00:00
Ian Wienand
3af0d3736b nodepool clouds: adds stats prefix
This adds a metrics prefix
(https://review.opendev.org/c/openstack/openstacksdk/+/786814) to each
of our clouds so that we start logging API stats separately again.
See also https://review.opendev.org/c/zuul/nodepool/+/786862

Change-Id: I5910fcbf1b54fa3806a0cc2e539565d47b805d35
2021-05-03 21:48:21 +00:00
Jeremy Stanley
1df1001cb4 Deprovision Limesurvey config management and docs
The Limesurvey service hosted at survey.openstack.org was a beta
which saw limited use. The platform it runs on, Xenial, is now EOL
from Ubuntu/Canonical and in order to upgrade to a newer
distribution release we would need to rewrite all the configuration
management (the version of Puppet supported by newer Ubuntu is not
backward-compatible with what we've been running).

If a similar service becomes interesting to users of our
collaboratory in the future, it will need to be reintroduced with
freshly written configuration management anyway. The old configs and
documentation remain in our Git history should anyone wish to use
them as inspiration.

Change-Id: I59b419cf112d32f20084ab93eb6f2417a7f93fdb
2021-05-01 15:12:00 +00:00
Clark Boylan
71b0526a44 Fix the zk peer listing to match myid values
We were using a loop index which meant for our cluster size of three we
would always assign server.1 through server.3. Unfortunately, as we
replace servers we may add notes with a myid value >3 which breaks when
we try to assign serverids in this way.

Fix it by using the calculation for myid in the peer listing.

Change-Id: Icf770c75cf3a84420116f47ad691d9f06191fb65
2021-04-27 10:16:08 -07:00
Zuul
82435b279a Merge "Add zk04.opendev.org" 2021-04-27 16:33:02 +00:00
Zuul
ad0f061b7f Merge "Cleanup mirror01.iad3.inmotion" 2021-04-23 20:35:22 +00:00
Zuul
f77dfc4f14 Merge "Add mirror02 to inmotion" 2021-04-23 18:12:33 +00:00