1348 Commits

Author SHA1 Message Date
James E. Blair
1f88e74169 Add LE config for zuul01
The service-zuul playbook isn't happy without it.

Change-Id: I46bc43b2a7daa0a17dfbb6de664df1a38f344e75
2021-11-05 14:07:49 -07:00
Zuul
268665dc18 Merge "Run haproxy-statsd as uid 1000" 2021-11-05 19:28:31 +00:00
Clark Boylan
2828a51ef9 Run haproxy-statsd as uid 1000
This aligns it with what we have done for zookeeper-statsd.

Change-Id: Ida0e3c3e7dbcaf915119f7e2677edf95c7550eea
2021-11-05 16:45:32 +00:00
Zuul
3da6615b36 Merge "gerrit: don't chown mariadb container directory" 2021-11-05 09:25:17 +00:00
Clark Boylan
d1eaa07918 Don't set lodgeit db dir perms
The mariadb container is overriding these and we can race ansible
setting them back to root and the mariadb container starting up
resulting in a sad database.

Change-Id: Ib88f6aec83e73baf95a660165d13839f7baeed3d
2021-11-04 16:06:49 -07:00
Ian Wienand
5f1c603b3d gerrit: don't chown mariadb container directory
We are currently re-chowning the running db directories back to root,
causing havoc for the db.  Drop the explicit permissions to avoid
this.

Change-Id: I8d8ce5c62c660875d5c6eed54c686996576ec9df
2021-11-05 08:26:56 +11:00
Zuul
aee7d04b19 Merge "Add Fedora 35 mirror" 2021-11-03 23:42:35 +00:00
Ian Wienand
b9d98cca21 borg-backup: skip .checkpoint archives
We may see an archive with ".checkpoint" on the end, as described in
[1]; the short version is this that borg stamps this every 30 minutes
and may appear if a long backup is interrupted.  Skip this when making
the list of archives to prune.

We noticed this on wiki-test; for clarity the list of archives looks
like

...
 wiki-upgrade-test-filesystem-2021-02-16T02:56:09.checkpoint Tue, 2021-02-16 02:56:11 [c444a0765e5791f3f68f08624d1efd80bf8a3ebc96bb225f08e4013befa2b460]
 wiki-upgrade-test-filesystem-2021-02-16T17:45:04 Tue, 2021-02-16 17:45:06 [b901b55ac3bf9abecba024caebad5ba7cd1a966e3f00b366f6cff45feba7bdff]
 wiki-upgrade-test-mysql-2021-02-16T18:35:09 Tue, 2021-02-16 18:35:11 [1d38cd3b4b1b3927b543e4ccc6c794cd3a513a70979ff025bbf303e1fe5e490f]
 wiki-upgrade-test-filesystem-2021-02-17T17:45:05 Wed, 2021-02-17 17:45:07 [f665e275c0014a21b82efaece5d36525a4ce6cb423253d5bd0b1323b230fa53a]
...

[1] https://borgbackup.readthedocs.io/en/stable/faq.html#if-a-backup-stops-mid-way-does-the-already-backed-up-data-stay-there

Change-Id: Ia33f46305ef8f541efb7c7150d4bb2e977b01d46
2021-11-03 12:39:10 +11:00
Ian Wienand
3918e15295 Add Fedora 35 mirror
Change-Id: I8dda96f4f23b331122b294329888698d1a4c7cd5
2021-11-03 08:08:54 +11:00
Ian Wienand
0b1a1ac099 Drop Fedora 33 mirror
Change-Id: Iee0f242ca155ea6ef254192cbbd7961f23e1c93e
2021-11-03 08:06:19 +11:00
Zuul
c7398abb4c Merge "Reduce htcachclean limit on our mirrors" 2021-10-29 04:50:46 +00:00
Ian Wienand
458a06da8f reprepro: stop mirroring ubuntu-ports Xenial
We are no longer building or supporting ARM64 Xenial so do not need
this in the mirror.

Change-Id: Ifdaf07e6572e8c5cb2482c988acf0b6f93859782
2021-10-29 09:16:43 +11:00
Clark Boylan
9bec46ed2c Reduce htcachclean limit on our mirrors
We previously set the limit to 70200M on a ~98GB filesystem.
Unfortunately we are able to jump from the ~70GB limit to a full
filesystem before htcachclean happens to run again. Reduce the limit to
60000M to give us more headroom and hopefully avoid filling the fs
between cache clean runs.

Change-Id: I8aa45eb0c396b54dbb3ec84e5ba8fd4ec7da9e27
2021-10-28 11:29:17 -07:00
Zuul
9c29fd8324 Merge "Remove the gerrit group in favor of the review group" 2021-10-22 16:15:56 +00:00
Zuul
d5a738ebf1 Merge "Always update gitea repo meta data" 2021-10-21 23:45:06 +00:00
Zuul
52c729e6b7 Merge "Clean up our gerrit config" 2021-10-18 16:18:40 +00:00
Clark Boylan
e3963317ab Always update gitea repo meta data
Last week when we were attempting to only update the subset of projects
that were renamed in gitea we accidentally updated all projects. The
good news is this didn't take significant amounts of time (just a few
minutes).

We should be able to enforce the metadata for all projects given the
cost is now much lower than it was in the past. This will keep things up
to date after renames but also generally if projects update descriptions
or bug tracking locations.

Change-Id: Ief2bb1eb2b11a13fafbe52650317d54d6a0fc824
2021-10-18 08:56:57 -07:00
Clark Boylan
fb1b82f3aa Revert "Allow gitea_create_repos always_update to be list"
This reverts commit a39a939e0352741d0b2c43e96e660f52eac22245.

Turns out that ansible module args don't get typed the way we expect
them. This means having a Boolean or List type argument just ends up in
confusion and always_update being truthy every which way. Revert until
we can fix this properly.

Change-Id: I596fe6883098ba636b1cad5196d1fdd76ff19076
2021-10-15 13:03:59 -07:00
Zuul
dd03cdedc3 Merge "Allow gitea_create_repos always_update to be list" 2021-10-15 15:32:20 +00:00
Jeremy Stanley
a39a939e03 Allow gitea_create_repos always_update to be list
Setting the gitea_always_update var for the gitea-git-repos role to
a list will filter metadata updates to only the project names
included in the supplied list. False and True still have their prior
meanings of do no metadata updates or force metadata updates for
every project we host.

Add testing for this, and also actually test that the rename
playbook renamed something.

Get rid of the git clone in the playbook since it's no longer
relevant to how we run things anyway, we'll instead want to rely on
the Zuul supplied projects.yaml path.

Change-Id: Id8238b232caffc242c6bda9fe39eb7e65fe5e059
2021-10-14 21:47:37 +00:00
Zuul
b1e65bf085 Merge "Switch test gerrit hostname to review99.opendev.org" 2021-10-13 17:47:53 +00:00
Clark Boylan
37d8c8b772 Clean up our gerrit config
This removes the old config to choose the old change screen by default
as everything is polygerrit now.

We remove the pre plugin melody config as melody now ships as a plugin
and has separate configuration.

We remove old theming information as that is supplied via external files
now.

We remove anonymous git download config because we don't set
gerrit.canonicalGitUrl which is required for this to work. We don't set
that because we don't have a git:// server anymore.

Bump the lucene thread count from 4 to 8 as we have more cores on the
system we run on.

Finally add some comments to help make sense of config that is left in
place.

Change-Id: Ie0b48e544191839067e66647d2ea32f74ce19ed3
2021-10-12 16:36:36 -07:00
Zuul
cced838bf0 Merge "borg-backup-server: wait for lock in verify" 2021-10-12 20:11:07 +00:00
Clark Boylan
cf91bc0971 Remove the gerrit group in favor of the review group
Having two groups here was confusing. We seem to use the review group
for most ansible stuff so we prefer that one. We move contents of the
gerrit group_vars into the review group_vars and then clean up the use
of the old group vars file.

Change-Id: I7fa7467f703f5cec075e8e60472868c60ac031f7
2021-10-12 09:48:53 -07:00
Clark Boylan
63f5674e6f Switch test gerrit hostname to review99.opendev.org
Previously we had set up the test gerrit instance to use the same
hostname as production: review02.opendev.org. This causes some confusion
as we have to override settings specifically for testing like a reduced
heap size, but then also copy settings from the prod host vars as we
override the host vars entirely. Using a new hostname allows us to use a
different set of host vars with unique values reducing confusion.

Change-Id: I4b95bbe1bde29228164a66f2d3b648062423e294
2021-10-12 09:48:53 -07:00
Ian Wienand
fee2aba4cd gerrit: Update quotes for 3.3
The gerrit config diff after the 3.3 ugprade [1] seems to remove some
quotes.  We also quote the bug URL, because it seems to think the
trailing # is a comment now.

[1] https://etherpad.opendev.org/p/gerrit-upgrade-3.3

Change-Id: I3ca0ec925a0e6da33a1cbe2333c118b1baa7257c
2021-10-11 08:33:46 +11:00
Zuul
fed8ec476b Merge "Upgrade Gerrit to 3.3" 2021-10-10 20:45:48 +00:00
Zuul
a0953f063f Merge "Update gerritbot-matrix version to include change number in notifications" 2021-10-08 01:14:38 +00:00
Jeremy Stanley
a5c1feef0f Add ptgbot serveralias for redirecting PTG site
While under development, the subdomain for the PTG site was
originally written as ptgbot.opendev.org and this is what was
communicated to event organizers. Mass communications subsequently
went out including this for URLs to the service. In order to make
the content from those announcements viable, add the additional name
to our configuration so we can redirect from it to the name we
eventually settled on.

While we're adjusting vhost metadata, make the ServerAdmin
directives between the HTTP and HTTPS vhosts for the service
consistent.

Change-Id: I726069f83b792fa31d92b759adc5c1214ca087fa
2021-10-07 19:34:16 +00:00
Jeremy Stanley
ba7d3d59c3 Turn on mod_rewrite for PTG vhost
In order to use Rewrite* directives, mod_rewrite must be activated
in the vhost via RewriteEngine.

Change-Id: I495ee5e9fd3b1d489122d6e282d3a91d1035c126
2021-10-07 19:34:16 +00:00
Jeremy Stanley
6df026852e Update ptgbot jobs to use #opendev-sandbox channel
The default channel name in the ptgbot role defaults did not
correctly specify a starting hash which it requires, but also the
test jobs seem to need it set in the eavesdrop group vars specific
to testing.

Change-Id: I16cdeac4f7af50e2cac36c80d78f3a87f482e4aa
2021-10-07 19:34:15 +00:00
Clark Boylan
e47dccdc34 Upgrade Gerrit to 3.3
This bumps the gerrit image up to our 3.3 image. Followup changes will
shift upgrade testing to test 3.3 to 3.4 upgrades, clean up no longer
needed 3.2 images, and start building 3.4 images.

Change-Id: Id0f544846946d4c50737a54ceb909a0a686a594e
2021-10-07 11:54:46 -07:00
Tristan Cacqueray
ce7aef9b4f Update gerritbot-matrix version to include change number in notifications
… as suggested by @clarkb

Change-Id: I3ce9507423b7c609e88ee5b19b70ae197a9e29ec
2021-10-07 15:01:00 +00:00
Zuul
3cd5d95d14 Merge "ptgbot: Add ServerAlias for ptg.openstack.org" 2021-10-07 00:48:47 +00:00
Zuul
7b943ed04a Merge "ptgbot: rename site to ptg.opendev.org" 2021-10-07 00:48:45 +00:00
Ian Wienand
d1c1e0dc02 ptgbot: Add ServerAlias for ptg.openstack.org
Ensure the old site redirects to the new site

Change-Id: I85a9616db3b0c8c443db927f751da8c2c418c318
2021-10-07 10:35:01 +11:00
Zuul
5b987ea6bc Merge "ptgbot: fix servername on http side" 2021-10-06 22:47:22 +00:00
Zuul
d108da5785 Merge "Upgrade gitea to 1.15.3" 2021-10-06 22:47:20 +00:00
Ian Wienand
67c08d52ad ptgbot: rename site to ptg.opendev.org
To remain consistent with "ptg.openstack.org", we are dropping the
"bot"

Depends-On: https://review.opendev.org/c/opendev/zone-opendev.org/+/812757
Change-Id: I5f06ee08241a286178fcb1be5c19fee6b6086d6f
2021-10-07 09:43:39 +11:00
Ian Wienand
347a9314ed ptgbot: fix servername on http side
Change-Id: I2c5883b7723fed1ed0b83f71507e50d3f85d5841
2021-10-07 08:38:00 +11:00
Zuul
b1bb5b782d Merge "Finish ptgbot configuration" 2021-10-06 20:22:50 +00:00
Zuul
455f56c676 Merge "ptgbot: setup web interface" 2021-10-06 19:51:51 +00:00
Jeremy Stanley
ad16067ae8 Finish ptgbot configuration
Set the channel we want ptgbot joining in production with a group
var, like we do for statusbot's channel list. Correct the password
var name to match what's used in the template for production (and
matches the override set in our private hostvars on the bastion).
Clean up the unnecessary auth nicks list which was copied from the
statusbot config but is entirely unused. Also get rid of some
unnecessary empty lines in the defaults as they really don't make
the file any more readable.

Change-Id: Id026b89d642eae13feba374e4f3ec610b543e530
2021-10-06 19:06:39 +00:00
Clark Boylan
4346570a0b Fix letsencrypt_self_generate_tokens defaults
We set the letsencrypt_self_generate_tokens value to True in testing
which means the variable is valid and exists in testing. However, in
production this variable isn't set and doesn't ahve a default so we get:

  The task includes an option with an undefined variable. The error was:
  'letsencrypt_self_generate_tokens' is undefined

Fix this by setting the default value for this var to False. Also, add
it to the README of letsencrypt-request-certs as this is where it is
primarily used.

Change-Id: I862df6ea3ff7f3a1df2a088b04d230bb618aaa85
2021-10-06 08:40:43 -07:00
Zuul
50c5727d42 Merge "Setting Up Ansible For ptgbot" 2021-10-06 14:18:36 +00:00
Zuul
6972d3c7b6 Merge "Setup Letsencrypt for ptgbot site" 2021-10-06 13:00:40 +00:00
Zuul
f80175b66a Merge "letsencrypt : don't use staging in the gate" 2021-10-06 12:59:58 +00:00
Ian Wienand
86b7f75b25 ptgbot: setup web interface
The dependent change exports the ptgbot website on port 8000 in the
container.  Proxy this through apache.

Depends-On: https://review.opendev.org/c/openstack/ptgbot/+/812417
Change-Id: Idf9e9f5ffad981427d24a3476c0c1f244721d917
2021-10-06 15:39:25 +11:00
Kendall Nelson
62e30e52de Setting Up Ansible For ptgbot
Heavily taken from statusbot, but removed wiki and twitter defaults.

Change-Id: I7b1958dbe37e5d25b8fde746235c88a4d6763ffd
2021-10-06 15:39:25 +11:00
Kendall Nelson
a24310c17f Setup Letsencrypt for ptgbot site
Depends-on: https://review.opendev.org/c/opendev/zone-opendev.org/+/804790

Change-Id: I8812628a3b021180e7c5d33ccd0cd5c2f0cc4745
2021-10-06 15:39:25 +11:00