17566 Commits

Author SHA1 Message Date
Zuul
4a118cf402 Merge "Retry acme.sh cloning" 2021-11-09 20:22:57 +00:00
James E. Blair
1a48e06b54 Purge ZK snapshots more frequently
It looks like 6 hours is too infrequent and is enough time for the
disk to fill up when we're busy.  Instead, purge old snapshots every
2 hours, which looks like it should give us plenty of headroom with
our current usage pattern.

Change-Id: Ieb92d052e633e9326c41367442f036cc333c40f2
2021-11-08 07:34:46 -08:00
Zuul
28243caa7f Merge "Adjust RefStack build for osf->openinfra rename" 2021-11-08 02:20:52 +00:00
Zuul
be2a12808e Merge "refstack: don't chown db directory" 2021-11-08 02:00:10 +00:00
Zuul
14919559c7 Merge "Add LE config for zuul01" 2021-11-08 00:51:26 +00:00
James E. Blair
1f88e74169 Add LE config for zuul01
The service-zuul playbook isn't happy without it.

Change-Id: I46bc43b2a7daa0a17dfbb6de664df1a38f344e75
2021-11-05 14:07:49 -07:00
Zuul
7ef6520aad Merge "Update zookeeper-statsd to python3.9 on bullseye" 2021-11-05 20:46:07 +00:00
Zuul
a4cf92bb56 Merge "Run zookeeper-statsd as the zookeeper user" 2021-11-05 20:46:04 +00:00
Zuul
268665dc18 Merge "Run haproxy-statsd as uid 1000" 2021-11-05 19:28:31 +00:00
Zuul
2f77c9d76f Merge "Update haproxy-statsd to bullseye and python3.9" 2021-11-05 18:12:15 +00:00
Clark Boylan
2828a51ef9 Run haproxy-statsd as uid 1000
This aligns it with what we have done for zookeeper-statsd.

Change-Id: Ida0e3c3e7dbcaf915119f7e2677edf95c7550eea
2021-11-05 16:45:32 +00:00
Zuul
3da6615b36 Merge "gerrit: don't chown mariadb container directory" 2021-11-05 09:25:17 +00:00
Clark Boylan
0f51ccf87f Update zookeeper-statsd to python3.9 on bullseye
We're currently on python3.9 on buster.

Change-Id: Ib8be56d44c89850cd63d700694cda174aa2efa4f
2021-11-04 16:49:04 -07:00
Clark Boylan
47cbfbf96a Run zookeeper-statsd as the zookeeper user
We may as well align it with the other processes running on this system.

Change-Id: I6de0e5463b3dc66eae46a771d70d1d741527a35e
2021-11-04 16:48:59 -07:00
Clark Boylan
d1eaa07918 Don't set lodgeit db dir perms
The mariadb container is overriding these and we can race ansible
setting them back to root and the mariadb container starting up
resulting in a sad database.

Change-Id: Ib88f6aec83e73baf95a660165d13839f7baeed3d
2021-11-04 16:06:49 -07:00
Clark Boylan
fd0aba7445 Update haproxy-statsd to bullseye and python3.9
We should generally try to keep these things up to date so do it now.

Change-Id: I59c21959094a87eb5a1e6f80e0a72be47370c072
2021-11-04 15:53:35 -07:00
Ian Wienand
88c984694e refstack: don't chown db directory
See I8d8ce5c62c660875d5c6eed54c686996576ec9df; mariadb containers
chown this to their internal user, we don't want to reset it.

Change-Id: If33a26438c6aa63d0ef0e02bdad6a643070be922
2021-11-05 09:39:29 +11:00
Ian Wienand
5f1c603b3d gerrit: don't chown mariadb container directory
We are currently re-chowning the running db directories back to root,
causing havoc for the db.  Drop the explicit permissions to avoid
this.

Change-Id: I8d8ce5c62c660875d5c6eed54c686996576ec9df
2021-11-05 08:26:56 +11:00
Zuul
4e84d29e38 Merge "gerrit: update theme to javascript plugin" 2021-11-04 19:54:01 +00:00
Ian Wienand
6e232716e7 gerrit: update theme to javascript plugin
Gerrit 3.4 deprecates HTML-based plugins, so the old theme doesn't
work.  I have reworked this into a javascript plugin.

This should look the same, although I've achieved things in different
ways.

This doesn't register light and dark variants; since
background-primary-color is white, by setting the
header-background-color to this we get white behind the header bar,
and it correctly switches to the default black(ish) when in dark mode
(currently its seems the header doesn't obey dark mode, so this is an
improvement).

I'm not sure what's going on with the extant header-border-image which
is a linear gradient all of the same color.  I modified this down to
1px (same as default) and made it fade in-and-out of the logo colour,
just for fun.

Change-Id: Ia2e32731c1cfe97639de2ec0e7660c7ed583e045
2021-11-04 18:45:18 +11:00
Zuul
aee7d04b19 Merge "Add Fedora 35 mirror" 2021-11-03 23:42:35 +00:00
Ian Wienand
b9d98cca21 borg-backup: skip .checkpoint archives
We may see an archive with ".checkpoint" on the end, as described in
[1]; the short version is this that borg stamps this every 30 minutes
and may appear if a long backup is interrupted.  Skip this when making
the list of archives to prune.

We noticed this on wiki-test; for clarity the list of archives looks
like

...
 wiki-upgrade-test-filesystem-2021-02-16T02:56:09.checkpoint Tue, 2021-02-16 02:56:11 [c444a0765e5791f3f68f08624d1efd80bf8a3ebc96bb225f08e4013befa2b460]
 wiki-upgrade-test-filesystem-2021-02-16T17:45:04 Tue, 2021-02-16 17:45:06 [b901b55ac3bf9abecba024caebad5ba7cd1a966e3f00b366f6cff45feba7bdff]
 wiki-upgrade-test-mysql-2021-02-16T18:35:09 Tue, 2021-02-16 18:35:11 [1d38cd3b4b1b3927b543e4ccc6c794cd3a513a70979ff025bbf303e1fe5e490f]
 wiki-upgrade-test-filesystem-2021-02-17T17:45:05 Wed, 2021-02-17 17:45:07 [f665e275c0014a21b82efaece5d36525a4ce6cb423253d5bd0b1323b230fa53a]
...

[1] https://borgbackup.readthedocs.io/en/stable/faq.html#if-a-backup-stops-mid-way-does-the-already-backed-up-data-stay-there

Change-Id: Ia33f46305ef8f541efb7c7150d4bb2e977b01d46
2021-11-03 12:39:10 +11:00
Ian Wienand
3918e15295 Add Fedora 35 mirror
Change-Id: I8dda96f4f23b331122b294329888698d1a4c7cd5
2021-11-03 08:08:54 +11:00
Ian Wienand
0b1a1ac099 Drop Fedora 33 mirror
Change-Id: Iee0f242ca155ea6ef254192cbbd7961f23e1c93e
2021-11-03 08:06:19 +11:00
Clark Boylan
04d60e25bf Rebuild gerrit images
Get the latest and greated gerrit and openjdk stuff.

Change-Id: I540d4d12fc4387e3912c191413aa77ce8ed60207
2021-11-01 13:18:47 -07:00
Zuul
66571449a3 Merge "reprepro: add note on removing components" 2021-10-29 23:41:08 +00:00
James E. Blair
879f37419c Add zuul01 to inventory
Change-Id: I7f43c51279847b1e28aa28d5232a3717f818ff51
2021-10-29 10:43:13 -07:00
Jeremy Stanley
25dc84fecf Update launch-node's default from bionic to focal
We only use Ubuntu 20.04 LTS (Focal) for new servers now.

Change-Id: I357a8c35ff608e43031bef64a58eefca3cd651e4
2021-10-29 16:42:48 +00:00
Ian Wienand
26d955f344 reprepro: add note on removing components
Change-Id: Ia50861042bb159a9e351321b2503f193eca4e576
2021-10-29 18:04:42 +11:00
Zuul
c7398abb4c Merge "Reduce htcachclean limit on our mirrors" 2021-10-29 04:50:46 +00:00
Ian Wienand
458a06da8f reprepro: stop mirroring ubuntu-ports Xenial
We are no longer building or supporting ARM64 Xenial so do not need
this in the mirror.

Change-Id: Ifdaf07e6572e8c5cb2482c988acf0b6f93859782
2021-10-29 09:16:43 +11:00
Zuul
b11ea07415 Merge "Upgrade to gitea 1.15.6" 2021-10-28 20:11:34 +00:00
Clark Boylan
9bec46ed2c Reduce htcachclean limit on our mirrors
We previously set the limit to 70200M on a ~98GB filesystem.
Unfortunately we are able to jump from the ~70GB limit to a full
filesystem before htcachclean happens to run again. Reduce the limit to
60000M to give us more headroom and hopefully avoid filling the fs
between cache clean runs.

Change-Id: I8aa45eb0c396b54dbb3ec84e5ba8fd4ec7da9e27
2021-10-28 11:29:17 -07:00
Clark Boylan
f2cd358b70 Upgrade to gitea 1.15.6
Another bug fix release. We upgrade to keep up and not fall behind.
Release notes can be found at:

  https://github.com/go-gitea/gitea/blob/v1.15.6/CHANGELOG.md

Change-Id: I44874476d6fd09f3333205b3036ed12000560cba
2021-10-28 08:37:04 -07:00
Zuul
b73a99bc1e Merge "Limit zuul stop/start playbooks to zuul02" 2021-10-27 22:51:13 +00:00
Zuul
5c08804102 Merge "Better swap alignment" 2021-10-27 22:20:30 +00:00
James E. Blair
cc74e674db Limit zuul stop/start playbooks to zuul02
Rather than restarting the whole scheduler group, just restart
zuul02, which is our only production scheduler.  That will allow us
to boot zuul01 as a secondary scheduler and manually add/remove it
for testing.

Once we can reliably run two schedulers, we can revert this change.

Change-Id: I5518ea1d3a6a1d48460b0436d4d1eaf9d52b7ddb
2021-10-27 15:00:03 -07:00
Jeremy Stanley
738f42760a Update artifact signing key management process
Now that the SKS keyserver network is no more, and there's no
convenient way to share third-party key signatures, we need to
adjust our key management and rollover process accordingly.

Change-Id: I7008706aae06b6e4a16db2dd85a8c7f91530cd50
2021-10-26 19:41:28 +00:00
Jeremy Stanley
e9f281d3b8 Adjust RefStack build for osf->openinfra rename
All the osf/ namespace Git repositories have moved into a new and
more appropriate openinfra/ namespace, so make the necessary
adjustments to RefStack's image build and operations document.

Change-Id: I01c8d153321a617fbc78c2d3c99102185b03243d
Depends-On: https://review.opendev.org/808479
2021-10-26 18:00:02 +00:00
Zuul
867675d13d Merge "Upgrade gitea to 1.15.5" 2021-10-25 18:00:14 +00:00
Zuul
ba66fa0c5c Merge "Document Zuul's SIGUSR2 handler" 2021-10-25 16:03:57 +00:00
Clark Boylan
cc41e880eb Upgrade gitea to 1.15.5
Changelog at:

  https://github.com/go-gitea/gitea/blob/v1.15.5/CHANGELOG.md

Change-Id: I4948aaa6d26364ce8f9de66ce83d1b40c763e132
2021-10-25 08:22:03 -07:00
Clark Boylan
f8b1d914aa Document Zuul's SIGUSR2 handler
This is more zuul debugging documentation.

Change-Id: I5298f62658cd68f2bd19ec02fb2c1970d855bf84
2021-10-22 13:03:23 -07:00
Zuul
f2384b8b91 Merge "Fixup some details in the zuul doc" 2021-10-22 16:48:02 +00:00
Zuul
9c29fd8324 Merge "Remove the gerrit group in favor of the review group" 2021-10-22 16:15:56 +00:00
Dr. Jens Harbott
6961f380d1 Fixup some details in the zuul doc
Mostly just formatting and punctuation, plus some outdated bits.

Signed-off-by: Dr. Jens Harbott <harbott@osism.tech>
Change-Id: I641beb5d65f87173d50c74a4e1f0dba48d006231
2021-10-22 10:05:20 +02:00
Zuul
d5a738ebf1 Merge "Always update gitea repo meta data" 2021-10-21 23:45:06 +00:00
Clark Boylan
2f7089d33e Make logging zuul restarts less optional
This is followon to feedback for earlier docs updates. Basically we
should always log these restarts so make that more clear that it isn't
optional.

Change-Id: Ib0fa05b2075d6c82199e6e043724aeedaf04e49c
2021-10-21 13:24:28 -07:00
Clark Boylan
f18e575a50 Update zuul secrets decryption docs
Zuul has changed has it stores secret keys and they are in zookeeper
now. This means our old docs on decrypting things are no longer correct.
Update them with a new set of instructions that matches the modern
setup.

Change-Id: I7484a8c02e005fadc41e22a4158b3dcb8434ec5d
2021-10-21 10:39:47 -07:00
Clark Boylan
a6d4d81ee2 Add zuul debugging documentation
Try to provide some hints for debugging unexpected zuul behaviors in our
documentation.

Change-Id: I937df9d8d71ae4984991aa9f327dd1351d539284
2021-10-21 10:39:47 -07:00