17517 Commits

Author SHA1 Message Date
Zuul
d5a738ebf1 Merge "Always update gitea repo meta data" 2021-10-21 23:45:06 +00:00
Clark Boylan
2f7089d33e Make logging zuul restarts less optional
This is followon to feedback for earlier docs updates. Basically we
should always log these restarts so make that more clear that it isn't
optional.

Change-Id: Ib0fa05b2075d6c82199e6e043724aeedaf04e49c
2021-10-21 13:24:28 -07:00
Clark Boylan
f18e575a50 Update zuul secrets decryption docs
Zuul has changed has it stores secret keys and they are in zookeeper
now. This means our old docs on decrypting things are no longer correct.
Update them with a new set of instructions that matches the modern
setup.

Change-Id: I7484a8c02e005fadc41e22a4158b3dcb8434ec5d
2021-10-21 10:39:47 -07:00
Clark Boylan
a6d4d81ee2 Add zuul debugging documentation
Try to provide some hints for debugging unexpected zuul behaviors in our
documentation.

Change-Id: I937df9d8d71ae4984991aa9f327dd1351d539284
2021-10-21 10:39:47 -07:00
Clark Boylan
7eff5b5af2 Update zuul restart documentation
It was recently pointed out that our restart process for zuul is a bit
stale. Document the new modern process that deals with ansible playbooks
and docker containers.

Change-Id: I52812e87ed73e6ed538f94a86c1b62ce3de57c37
2021-10-21 10:39:42 -07:00
Zuul
2c1a449a42 Merge "Build Gerrit 3.3.7 images" 2021-10-18 17:43:35 +00:00
Zuul
52c729e6b7 Merge "Clean up our gerrit config" 2021-10-18 16:18:40 +00:00
Clark Boylan
e3963317ab Always update gitea repo meta data
Last week when we were attempting to only update the subset of projects
that were renamed in gitea we accidentally updated all projects. The
good news is this didn't take significant amounts of time (just a few
minutes).

We should be able to enforce the metadata for all projects given the
cost is now much lower than it was in the past. This will keep things up
to date after renames but also generally if projects update descriptions
or bug tracking locations.

Change-Id: Ief2bb1eb2b11a13fafbe52650317d54d6a0fc824
2021-10-18 08:56:57 -07:00
Clark Boylan
fb1b82f3aa Revert "Allow gitea_create_repos always_update to be list"
This reverts commit a39a939e0352741d0b2c43e96e660f52eac22245.

Turns out that ansible module args don't get typed the way we expect
them. This means having a Boolean or List type argument just ends up in
confusion and always_update being truthy every which way. Revert until
we can fix this properly.

Change-Id: I596fe6883098ba636b1cad5196d1fdd76ff19076
2021-10-15 13:03:59 -07:00
Zuul
dd03cdedc3 Merge "Allow gitea_create_repos always_update to be list" 2021-10-15 15:32:20 +00:00
Jeremy Stanley
a39a939e03 Allow gitea_create_repos always_update to be list
Setting the gitea_always_update var for the gitea-git-repos role to
a list will filter metadata updates to only the project names
included in the supplied list. False and True still have their prior
meanings of do no metadata updates or force metadata updates for
every project we host.

Add testing for this, and also actually test that the rename
playbook renamed something.

Get rid of the git clone in the playbook since it's no longer
relevant to how we run things anyway, we'll instead want to rely on
the Zuul supplied projects.yaml path.

Change-Id: Id8238b232caffc242c6bda9fe39eb7e65fe5e059
2021-10-14 21:47:37 +00:00
Clark Boylan
2f11da87b0 Build Gerrit 3.3.7 images
This updates our Gerrit 3.3 images to the new 3.3.7 release.

Change-Id: Ib676be49bcc9cd4633dbe6fe87dd6e3a32185a55
2021-10-14 11:46:44 -07:00
Zuul
e2fdcc73fd Merge "More yaml.safe_load() in testinfra/conftest.py" 2021-10-13 23:46:14 +00:00
Jeremy Stanley
d76fb17fba More yaml.safe_load() in testinfra/conftest.py
Previous change If91f79a4648920999de8e6bf6e0c9fec82fde233 replaced
one of the instances of yaml.load() in this file with safe_load() in
order to silence what were then warnings. Now they're errors with
current PyYAML, so go ahead and update the other one.

Change-Id: If9f839f60cd71be8be141423ef2b93884d8aeba7
2021-10-13 21:58:41 +00:00
Zuul
b1e65bf085 Merge "Switch test gerrit hostname to review99.opendev.org" 2021-10-13 17:47:53 +00:00
Zuul
0017bdc468 Merge "Replace testing group vars with host vars for review02" 2021-10-13 17:16:31 +00:00
Clark Boylan
37d8c8b772 Clean up our gerrit config
This removes the old config to choose the old change screen by default
as everything is polygerrit now.

We remove the pre plugin melody config as melody now ships as a plugin
and has separate configuration.

We remove old theming information as that is supplied via external files
now.

We remove anonymous git download config because we don't set
gerrit.canonicalGitUrl which is required for this to work. We don't set
that because we don't have a git:// server anymore.

Bump the lucene thread count from 4 to 8 as we have more cores on the
system we run on.

Finally add some comments to help make sense of config that is left in
place.

Change-Id: Ie0b48e544191839067e66647d2ea32f74ce19ed3
2021-10-12 16:36:36 -07:00
Zuul
da1bd39a2a Merge "Remove Gerrit 3.2 images" 2021-10-12 20:59:11 +00:00
Zuul
cced838bf0 Merge "borg-backup-server: wait for lock in verify" 2021-10-12 20:11:07 +00:00
Clark Boylan
63f5674e6f Switch test gerrit hostname to review99.opendev.org
Previously we had set up the test gerrit instance to use the same
hostname as production: review02.opendev.org. This causes some confusion
as we have to override settings specifically for testing like a reduced
heap size, but then also copy settings from the prod host vars as we
override the host vars entirely. Using a new hostname allows us to use a
different set of host vars with unique values reducing confusion.

Change-Id: I4b95bbe1bde29228164a66f2d3b648062423e294
2021-10-12 09:48:53 -07:00
Clark Boylan
76baae4e3f Replace testing group vars with host vars for review02
Previously we had a test specific group vars file for the review Ansible
group. This provided junk secrets to our test installations of Gerrit
then we relied on the review02.opendev.org production host vars file to
set values that are public.

Unfortunately, this meant we were using the production heapLimit value
which is far too large for our test instances leading to the occasionaly
failure:

  There is insufficient memory for the Java Runtime Environment to continue.
  Native memory allocation (mmap) failed to map 9596567552 bytes for committing reserved memory.

We cannot set the heapLimit in the group var file because the hostvar
file overrides those values. To fix this we need to replace the test
specific group var contents with a test specific host var file instead.
To avoid repeating ourselves we also create a new review.yaml group_vars
file to capture common settings between testing and prod. Note we should
look at combining this new file with the gerrit.yaml group_vars.

On the testing side of things we set the heapLimit to 6GB, we change the
serverid value to prevent any unexpected notedb confusion, and we remove
replication config.

Change-Id: Id8ec5cae967cc38acf79ecf18d3a0faac3a9c4b3
2021-10-12 09:48:45 -07:00
Zuul
721b832b16 Merge "letsencrypt: avoid running on handler changes" 2021-10-11 23:35:39 +00:00
Zuul
e4acafc36a Merge "Rename Gerrit Non-Interactive Users to Service Users" 2021-10-11 23:35:36 +00:00
Zuul
b75da802ca Merge "Test upgrade from Gerrit 3.3 to 3.4" 2021-10-11 23:35:34 +00:00
Zuul
3f92dbf8b8 Merge "gerrit: Update quotes for 3.3" 2021-10-11 22:20:15 +00:00
Zuul
4a557023db Merge "Test ansible-devel with an ubuntu-focal bridge.o.o" 2021-10-11 20:13:36 +00:00
Zuul
0d476f0479 Merge "gerrit: diff config files on upgrade" 2021-10-11 19:36:32 +00:00
Zuul
6b05c7db38 Merge "Force gerrit image build to tag 3.4" 2021-10-11 17:50:53 +00:00
Zuul
aa288ba52a Merge "Update gitea to 1.15.4" 2021-10-11 17:40:34 +00:00
Clark Boylan
dce8b2b4a6 Rename Gerrit Non-Interactive Users to Service Users
This is just a documentation update but reflect the change upstream
Gerrit made in versions 3.3 renaming this group.

Change-Id: I5458afd2683c2a7c4616f4894884e3d3ce03bbaf
2021-10-11 08:53:59 -07:00
Clark Boylan
9eebd3d0fc Force gerrit image build to tag 3.4
We added 3.4 jobs but they aren't running because we haven't tagged 3.4
images on dockerhub successfully.

Change-Id: I1fce44fe562a994c5513ceeb96270a4d5f7c40c3
2021-10-11 08:31:01 -07:00
Ian Wienand
432a995184 gerrit: diff config files on upgrade
This ensures we don't miss things gerrit might update in config files

Change-Id: I28cd18f7a180d9f8968441b35642f74cb0c42e34
2021-10-11 18:29:06 +11:00
Zuul
39285a57e4 Merge "Start building gerrit 3.4" 2021-10-10 22:30:40 +00:00
Ian Wienand
fee2aba4cd gerrit: Update quotes for 3.3
The gerrit config diff after the 3.3 ugprade [1] seems to remove some
quotes.  We also quote the bug URL, because it seems to think the
trailing # is a comment now.

[1] https://etherpad.opendev.org/p/gerrit-upgrade-3.3

Change-Id: I3ca0ec925a0e6da33a1cbe2333c118b1baa7257c
2021-10-11 08:33:46 +11:00
Zuul
fed8ec476b Merge "Upgrade Gerrit to 3.3" 2021-10-10 20:45:48 +00:00
Clark Boylan
b6d121627c Update gitea to 1.15.4
They just released a 1.15.4 version with a number of bugfixes.

Changelog at:

  https://github.com/go-gitea/gitea/blob/v1.15.4/CHANGELOG.md

Change-Id: Idf5f5a0b2d7bc5acbe79fb38753671d21c71e288
2021-10-08 12:13:22 -07:00
Zuul
a0953f063f Merge "Update gerritbot-matrix version to include change number in notifications" 2021-10-08 01:14:38 +00:00
Zuul
5f96f2abe3 Merge "Update ICLA to reference OpenInfra" 2021-10-08 01:14:34 +00:00
Zuul
896f168038 Merge "Update management documentation for ptgbot service" 2021-10-07 22:21:45 +00:00
Zuul
a7e824db47 Merge "Add ptgbot serveralias for redirecting PTG site" 2021-10-07 22:21:42 +00:00
Zuul
fb368adb34 Merge "Turn on mod_rewrite for PTG vhost" 2021-10-07 21:35:29 +00:00
Zuul
d26fcd6630 Merge "Update ptgbot jobs to use #opendev-sandbox channel" 2021-10-07 21:35:24 +00:00
Wes Wilson
bdb6e7b8f8 Update ICLA to reference OpenInfra
Change-Id: Ifc9feaefcd64bb2e6ca060b5bd3aac5ed6345f9c
2021-10-07 13:17:12 -07:00
Clark Boylan
46faa6626b Remove Gerrit 3.2 images
This should be merged after we are on 3.3 and happy with the state of
things.

Depends-On: https://review.opendev.org/c/openstack/project-config/+/813081
Change-Id: I4173df5e4ae38af6423402be0299470323762da2
2021-10-07 20:07:38 +00:00
Jeremy Stanley
7685bf0708 Update management documentation for ptgbot service
Since ptgbot has updated config management and deployment
orchestration now, update our operational docs to reflect that.

Change-Id: Iad4eb23616ac8ad44d8456268dca730a9754acce
2021-10-07 19:34:16 +00:00
Jeremy Stanley
a5c1feef0f Add ptgbot serveralias for redirecting PTG site
While under development, the subdomain for the PTG site was
originally written as ptgbot.opendev.org and this is what was
communicated to event organizers. Mass communications subsequently
went out including this for URLs to the service. In order to make
the content from those announcements viable, add the additional name
to our configuration so we can redirect from it to the name we
eventually settled on.

While we're adjusting vhost metadata, make the ServerAdmin
directives between the HTTP and HTTPS vhosts for the service
consistent.

Change-Id: I726069f83b792fa31d92b759adc5c1214ca087fa
2021-10-07 19:34:16 +00:00
Jeremy Stanley
ba7d3d59c3 Turn on mod_rewrite for PTG vhost
In order to use Rewrite* directives, mod_rewrite must be activated
in the vhost via RewriteEngine.

Change-Id: I495ee5e9fd3b1d489122d6e282d3a91d1035c126
2021-10-07 19:34:16 +00:00
Jeremy Stanley
6df026852e Update ptgbot jobs to use #opendev-sandbox channel
The default channel name in the ptgbot role defaults did not
correctly specify a starting hash which it requires, but also the
test jobs seem to need it set in the eavesdrop group vars specific
to testing.

Change-Id: I16cdeac4f7af50e2cac36c80d78f3a87f482e4aa
2021-10-07 19:34:15 +00:00
Clark Boylan
0f6c29c0ee Test upgrade from Gerrit 3.3 to 3.4
This shifts our Gerrit upgrade testing ahead to testing 3.3 to 3.4
upgrades as we have upgraded to 3.3 at this point.

Change-Id: Ibb45113dd50f294a2692c65f19f63f83c96a3c11
2021-10-07 11:57:04 -07:00
Monty Taylor
d49f399b17 Start building gerrit 3.4
Change-Id: I9cd8c9e1fb837dae91057da9bc80a3f15e566a59
2021-10-07 11:54:50 -07:00