88 Commits

Author SHA1 Message Date
Clark Boylan
12d4355385 Fork the maxking/docker-mailman images
These images have a number of issues we've identified and worked
around. The current iteration of this change is essentially
identical to upstream but with a minor tweak to allow the latest
mailman version, and adjusts the paths for hyperkitty and postorius
URLs to match those in the upstream mailman-web codebase, but
doesn't try to address the other items. However, we should consider
moving our fixes from ansible into the docker images where possible
and upstream those updates.

Unfortunately upstream hasn't been super responsive so far hence this
fork. For tracking purposes here are the issues/PRs we've already filed
upstream:

  https://github.com/maxking/docker-mailman/pull/552
  https://github.com/maxking/docker-mailman/issues/548
  https://github.com/maxking/docker-mailman/issues/549
  https://github.com/maxking/docker-mailman/issues/550

Change-Id: I3314037d46c2ef2086a06dea0321d9f8cdd35c73
2022-11-21 16:51:02 +00:00
Clark Boylan
1da5615477 Add Gerrit 3.6 jobs
This adds Gerrit 3.6 image build jobs as well as CI testing for this
version of Gerrit. Once we've got images that build and function
generally we'll reenable the upgrade job and work through that.

Change-Id: I494a21911a2279228e57ff8d2b731b06a1573438
2022-06-21 16:54:36 -07:00
Clark Boylan
063ec0f5a7 Remove Gerrit 3.4 jobs
This removes our Gerrit 3.4 image builds as well as testing. We should
land this after an appropriate amount of time has passed since the 3.5
upgrade that we are unlikely to revert.

Depends-On: https://review.opendev.org/c/openstack/project-config/+/847057
Change-Id: Iefa7cc1157311f0239794b15bea7c93f0c625a93
2022-06-21 16:27:46 -07:00
Clark Boylan
819d3ce480 Update Gerrit images to 3.4.5 and 3.5.2
3.4.5 is a fairly minor update. Some bugs are fixed and jgit is updated.

3.4.5 release notes:
  https://www.gerritcodereview.com/3.4.html#345

3.5.2 is a bigger update and important adds support for being able to
upgrade to 3.6.0 later. There is a new copy-approvals command that must
be run offline on 3.5.2 before upgrading to 3.6.0. This copies approvals
in the notedb in a way that 3.6.0 can handle them apparently. The
release notes indicate this may take some time to run. We don't need to
run it now though and instead need to make note of it when we prepare
for the 3.6.0 upgrade.

3.5.2 release notes:
  https://www.gerritcodereview.com/3.5.html#352

For now don't overthink things and instead just get up to date with our
images.

Change-Id: I837c2cbb09e9a4ff934973f6fc115142d459ae0f
2022-05-25 08:37:33 -07:00
Clark Boylan
183f2a9c9c Update Gerrit build checkouts
This will ensure we rebuild our gerrit images on the latest content from
upstream.

Change-Id: Ibcb1d076d897d9e24d7351dae156b37142ad0f34
2022-04-25 11:14:40 -07:00
Zuul
4de58bd423 Merge "Add Bullseye Python 3.10 base images" 2022-04-20 23:21:06 +00:00
Zuul
42d51e4d2d Merge "Remove python3.7-bullseye docker images" 2022-04-20 22:33:00 +00:00
Zuul
7efc08e7b4 Merge "Remove our buster python images" 2022-04-20 16:42:06 +00:00
Clark Boylan
90effa2af0 Add Bullseye Python 3.10 base images
Now that we've cleaned up the old unused images we can look forward to
new Python. Add Python 3.10 base images based on Bullseye.

As part of this process we update the default var values in our
Dockerfiles to set Bullseye and Python3.10 as our defaults as these
should be valid for some time. We also tidy up some yaml anchor names to
make future copy and paste for new versions of images easier to perform
text replacement on.

Change-Id: I4943a9178334c4bdf10ee5601e39004d6783b34c
2022-04-20 08:39:52 -07:00
Clark Boylan
2d43f9322b Remove python3.7-bullseye docker images
Everything is running on 3.8 or newer which should allow us to remove
the 3.7 images. This reduces the total set before we add python3.10
images and acts as good cleanup.

Change-Id: I2cc02fd681485f35a1b0bf1c089a12a4c5438df3
2022-04-18 13:42:30 -07:00
Clark Boylan
78999b020e Remove our buster python images
We've moved onto bullseye for just about everything at this point. It is
possible there are stragglers and the removal of these jobs should flag
them if their dependencies and requirements are set properly. Otherwise
they'll continue to pull the historical builds on docker hub. Either way
we'll either shake them out or they will continue until they can move to
bullseye.

We remove these in preparation for adding python3.10 images which don't
make sense for buster and our total image catalog is getting large
enough that successfully building and promoting this entire set is
getting problematic. A bit of spring cleaning on what we can commit to
before we commit to some new stuff.

Depends-On: https://review.opendev.org/c/opendev/gear/+/838402
Depends-On: https://review.opendev.org/c/opendev/storyboard/+/838403
Change-Id: I58c4d314ca4f4be3f1e17ec267a4c324cabf0c2a
2022-04-18 13:42:03 -07:00
Clark Boylan
dfcbcd1808 Switch Refstack image over to python3.9
Refstack is running python3.9 jobs now and they appear to be passing.
Update our image to python3.9 so that we are consistently using
python3.9 in as many locations as possible. Maybe one day we can drop
the 3.7 and 3.8 image builds too.

Change-Id: Iadb84f8f3756fe717ab6bcda0303bc23ff69ad6d
2022-04-18 13:23:39 -07:00
Clark Boylan
3381b58fbd Use deb-docker mirror for upload image too
Upload is based on build, since it builds and uploads for the
gate. This means we need to add the mirror here too, so that we're
installing docker from the deb mirror.

We convert to https at the same time for both jobs.

Change-Id: Ie1ff253e6cfc3e666a4e6be919a08f3a5d041319
2022-03-15 16:05:47 -07:00
Clark Boylan
47c242ff21 Pull gerrit/plugins/gitiles from stable branch not tag
This plugin was updated to accomodate the ${hash} substition in gerrit
gitweb weblinks. We now need this updated version to build Gerrit
successfully but there is no tag for it yet. Just use the branch to
address this.

Change-Id: I4b0fd4ac845cc4289f78aacfa536db4185f12d38
2022-03-03 10:48:03 -08:00
Clark Boylan
a3cc983502 Add Gerrit 3.5 image builds and testing
This will build gerrit 3.5 images and run it through our standard Gerrit
testing. Upgrade testing from 3.4 to 3.5 to follow in followup changes.

Change-Id: I76d0389d1455e62b242aad1926b3a09830301801
2022-02-03 08:09:14 -08:00
Zuul
fd3cd75f7c Merge "Stop building Gerrit 3.3 images" 2022-02-03 05:50:59 +00:00
Zuul
f339b7cdab Merge "Better organize gerrit plugins in job defs" 2022-02-02 23:51:23 +00:00
Clark Boylan
4e9da3c255 Stop building Gerrit 3.3 images
We've upgraded to 3.4 and don't appear to be reverting. Remove the 3.3
images as they are no longer needed.

Note we comment out the review upgrade testing jobs until we have 3.5
images building.

Depends-On: https://review.opendev.org/c/openstack/project-config/+/827562
Change-Id: I0e3cb81b790ab06c690ed0245526e4f47911c584
2022-02-02 14:03:28 -08:00
James E. Blair
1492f22faa Use grafyaml container image
Instead of building a local grafana image with grafyaml installed,
use the plain upstream grafana image along with the newly created
separate opendev grafyaml image to run the dashboards.

Depends-On: https://review.opendev.org/780119
Change-Id: If0d584f848f213aeea385885e3decfaee6303de5
2022-01-20 09:25:00 +11:00
Zuul
4fdb4907fd Merge "Update Gerrit images to 3.3.9 and 3.4.3" 2022-01-18 17:39:11 +00:00
Zuul
d2016bcba0 Merge "Update refstack image to bullseye" 2022-01-12 17:50:17 +00:00
Clark Boylan
7f5f0bd4df Update refstack image to bullseye
Some spring cleaning now that bullseye is available. While we are at it
we fix up the job requires and provides for the related image building
and service testing jobs too.

Change-Id: I8a392e06df66b2e0c85157e61e529bb649d8ad58
2022-01-10 11:20:24 -08:00
Clark Boylan
de10234b9b Better organize gerrit plugins in job defs
The comments around the organization of these plugins wasn't accurate.
Instead of grouping them by git repo state group them by what
functionality they affect.

Change-Id: I6a21574e7079b7ddda520f727bef5562e5999126
2022-01-10 09:17:42 -08:00
Clark Boylan
3fdec9d20f Update Gerrit images to 3.3.9 and 3.4.3
This includes the fixes for right to left unicode that we've already
picked up, but now in an official release. It also updates Elasticsearch
support to prevent use with elasticsearch versions that are vulnerable
to log4shell. We don't use elasticsearch with Gerrit so this doesn't
affect us.

Change-Id: Ifbba7391bd16bc20c003293030a71e0ea787d0c7
2021-12-27 11:41:56 -08:00
Zuul
a1885ef992 Merge "Update limboria ircbot to bullseye" 2021-12-15 22:27:33 +00:00
Zuul
29fbc1f078 Merge "Update matrix-eavesdrop image to bullseye" 2021-12-15 17:46:36 +00:00
Zuul
57d5e116a0 Merge "Update the accessbot image to bullseye" 2021-12-14 23:40:39 +00:00
Zuul
63fb188aa3 Merge "Update the hound image to bullseye" 2021-12-13 22:08:29 +00:00
Clark Boylan
22957c6549 Update limboria ircbot to bullseye
Spring cleaning updates of our docker images now that bullseye is out.

Change-Id: I5e4b84edd2c5a8e196659e4815c5b349c0226393
2021-12-13 09:22:17 -08:00
Clark Boylan
ed0526cd8b Update the accessbot image to bullseye
This is general spring cleaning that we are going to try and do for our
images now that bullseye is out.

Change-Id: Iad8f5b76896b88a6aafbfba0c38d0749b9d5c88f
2021-12-13 09:18:56 -08:00
Clark Boylan
b07d5eca37 Update matrix-eavesdrop image to bullseye
Just some spring cleaning now that bullseye is released.

Change-Id: I9641dae9ee7679fb45bef93e770f69d9673d75bf
2021-12-13 09:12:10 -08:00
Clark Boylan
8530ed39a1 Update the hound image to bullseye
Just some spring cleaning now that bullseye has released.

Change-Id: I1202400932860a04841d376b9f10beb89acc175c
2021-12-13 09:04:20 -08:00
Clark Boylan
999edcc88b Remove melody
We don't need this plugin right now

Change-Id: I7b2f0d831579076d890ef8dd3bbe6e14fa1371bc
2021-12-10 10:00:41 -08:00
Clark Boylan
4285b40928 Upgrade to gerrit 3.3.8
There are new gerrit releases. This change updates our production 3.3
image to 3.3.8. We also update Our 3.4 image to 3.4.2 to keep up there.

Release notes for both:

  https://www.gerritcodereview.com/3.3.html#338
  https://www.gerritcodereview.com/3.4.html#342

Seems to largely be bugfixes and reindexing improvements.

Change-Id: Iae8aa403b4001937320767d4166a6af2bc89a2ea
2021-11-29 16:18:15 -08:00
Zuul
7ef6520aad Merge "Update zookeeper-statsd to python3.9 on bullseye" 2021-11-05 20:46:07 +00:00
Clark Boylan
0f51ccf87f Update zookeeper-statsd to python3.9 on bullseye
We're currently on python3.9 on buster.

Change-Id: Ib8be56d44c89850cd63d700694cda174aa2efa4f
2021-11-04 16:49:04 -07:00
Clark Boylan
fd0aba7445 Update haproxy-statsd to bullseye and python3.9
We should generally try to keep these things up to date so do it now.

Change-Id: I59c21959094a87eb5a1e6f80e0a72be47370c072
2021-11-04 15:53:35 -07:00
Clark Boylan
2f11da87b0 Build Gerrit 3.3.7 images
This updates our Gerrit 3.3 images to the new 3.3.7 release.

Change-Id: Ib676be49bcc9cd4633dbe6fe87dd6e3a32185a55
2021-10-14 11:46:44 -07:00
Zuul
da1bd39a2a Merge "Remove Gerrit 3.2 images" 2021-10-12 20:59:11 +00:00
Zuul
39285a57e4 Merge "Start building gerrit 3.4" 2021-10-10 22:30:40 +00:00
Clark Boylan
46faa6626b Remove Gerrit 3.2 images
This should be merged after we are on 3.3 and happy with the state of
things.

Depends-On: https://review.opendev.org/c/openstack/project-config/+/813081
Change-Id: I4173df5e4ae38af6423402be0299470323762da2
2021-10-07 20:07:38 +00:00
Monty Taylor
d49f399b17 Start building gerrit 3.4
Change-Id: I9cd8c9e1fb837dae91057da9bc80a3f15e566a59
2021-10-07 11:54:50 -07:00
Clark Boylan
c42099717b Fix gerrit image dep in zuul config
When we moved gerrit to bullseye images we failed to update this
depedency in zuul. Fix that.

Change-Id: I2cc4f8ca8137c4b78d437ab695e8ff831178e1f5
2021-10-07 11:50:13 -07:00
Zuul
91c6b2ae84 Merge "Build our gerrit images on Bullseye" 2021-10-07 00:12:30 +00:00
Clark Boylan
88a6a202e9 Build our gerrit images on Bullseye
This is a bit of spring cleaning. Previously we based on images on
Buster but Bullseye exists now so give it a go.

Change-Id: Icc3d79b361e41df2f2f063993fd206ab7d992f75
2021-09-15 13:45:31 -07:00
Clark Boylan
17ba858b19 Update our gitea images to bullseye
To do this we also update jinja-init to bullseye and gitea seems to be
the only user of this image. The impact of this should be fairly self
contained to gitea.

Note this update isn't urgent, but good hygiene. We should coordinate
this update with the 1.15.x gitea upgrade and do them in such a sequence
that we can identify problems easily if they pop up.

Change-Id: Ia0075416a1d8a067cfecd26c03f8db9641cbcb89
2021-09-15 10:49:42 -07:00
Ian Wienand
e772abaf96 gitea: use assets bundle
This uses the opendev assets bundle image created with
I3166679bde6d771276289b9d32e7e4407957b2f8.

The mount options require using BuildKit, hence the Dockerfile update.

Otherwise conceptually it's fairly simple; copy in the files from the
opendevorg/assets image rather than the file-system.

Change-Id: I36bdc76471eec5380a676ebcdd885a88d3985976
2021-09-06 15:07:36 +10:00
Ian Wienand
25cdc97950 Add assets and a related docker image/bundle
Move some common assets into a top-level assets/ directory.  Services
can reference these assets via

 https://opendev.org/opendev/system-config/raw/branch/master/assets/<file>

in <img> tags, etc.

Some services want to embed these into their images, but we wish to
only keep one canonical copy.  For this, add a Dockerfile and jobs
that creates a simple bundle of assets in opendevorg/assets.  This can
be referenced in other builds; the new BuildKit bind-mount is
particularly useful for this
(c.f. I36bdc76471eec5380a676ebcdd885a88d3985976).

Change-Id: I3931566eb86a0618705d276445fa0a5f659692ea
2021-09-01 06:15:43 +10:00
Monty Taylor
8dbf0a3d82 Produce both buster and bullseye container images
This will allow us to roll out consumption forward in a
methodical manner.

This reverts commit 45caec4d43900bc66fb0b8c219c6dcc3180ca8aa.

Note the weird ARG definitions are there for a reason:
https://docs.docker.com/engine/reference/builder/#understand-how-arg-and-from-interact

Change-Id: I81174ac035164695f1c27c9662f25335b78c2e64
2021-08-28 16:46:29 -07:00
Clark Boylan
f4c1735dfb Update Gerrit images to most recent releases
There are new releases of Gerrit. Let's update our 3.2 and 3.3 images to
match.

Change-Id: Id06cbb5eb2c7e6af30d579327b4a4c89b92e6d8d
2021-08-20 15:55:53 -07:00