89 Commits

Author SHA1 Message Date
James E. Blair
67cda2c7df Deploy gitea with docker-compose
This deploys a shared-nothing gitea server using docker-compose.
It includes a mariadb server.

Change-Id: I58aff016c7108c69dfc5f2ebd46667c4117ba5da
2019-02-18 08:46:40 -08:00
Monty Taylor
07edd9d297 Add opendev kubernetes nodes to ansible inventory
We want our base ansible roles to run on these nodes. However,
k8s-on-openstack manages firewall rules via openstack security
groups, so we don't want to run those there.

There was a discussion about making a minimal set of roles that
are run by default and then a group containing servers that got
the full set ... but that would require a duplicate entry for 99%
of our servers in the inventory, while the "only run a subset" is
the exception case.

Change-Id: I2cbf364305f758cecf11df41398d3d2c05222fda
2019-02-08 16:49:01 +00:00
Zuul
1604ac6325 Merge "Run a docker registry for CI" 2019-02-04 22:11:13 +00:00
Zuul
2a9136366a Merge "Remove old storyboard-dev from inventory" 2019-02-04 20:37:34 +00:00
Zuul
f783c89497 Merge "Put OpenStackID servers in inventory host groups" 2019-02-04 20:37:32 +00:00
Zuul
b9fe525914 Merge "Update etherpad-dev.o.o to puppet 4" 2019-02-03 10:42:51 +00:00
Jeremy Stanley
3b14256328 Put OpenStackID servers in inventory host groups
In order to support different instance names for the OpenStackID
servers, create Ansible inventory host groups for them. Add the
group name for the production server to the Puppet global site
manifest like was already done for the dev server. Also adjust the
production server node name regex and globs to support an enumerated
naming pattern in the openstack.org domain. Finally, fix a benign
missing backslash in the openstackid-dev node name regex for
consistency.

Change-Id: Iaa30f2fa2c196ad84a8ac18b48b7390b1f4905b9
2019-02-03 00:54:27 +00:00
Colleen Murphy
7c44ab4919 Update etherpad-dev.o.o to puppet 4
Use etherpad-dev as a canary to ensure the upgrade plumbing works.

Change-Id: Iaebe00a7b7a43142d96e6ca8fc36f1de95fbe2a6
2019-02-02 17:38:46 +01:00
James E. Blair
12709a1c8b Run a docker registry for CI
Change-Id: If9669bb3286e25bb16ab09373e823b914b645f26
2019-02-01 10:12:51 -08:00
Jeremy Stanley
ce58c67b6e Remove old storyboard-dev from inventory
The old Trusty-based storyboard-dev.openstack.org server has been
replaced by a new Xenial-based storyboard-dev01.opendev.org
instance. As the original is being deleted, remove it from the
inventory and tighten up our hostname match patterns accordingly.

Change-Id: I9805381ebd640c8d5aeb3012e9ebe8448eaf5a3b
2019-01-27 17:08:36 +00:00
Jeremy Stanley
5a75bc9c96 Flexible instance naming for openstackid-dev
Use group variables and a node name pattern to divorce the
openstackid-dev service from the instance name of the server which
provides it. Also update the inventory matches to be consistent with
the pattern in the global site manifest.

Change-Id: I335f7ebaa5a446a83a4725bbcc0240f91cd14341
2019-01-23 18:40:32 +00:00
Clark Boylan
b8b1fdde75 Nameservers are now managed with ansible
Remove the puppetry for managing nameservers as we now use ansible
configured name servers without puppet.

We will need to follow this up with deletion of the existing
ns*.openstack.org and adns1.openstack.org servers.

Change-Id: Id7ec8fa58c9e37ce94ec71e4562607914e5c3ea4
2019-01-08 16:16:49 -08:00
Colleen Murphy
95a4a1690b Fix glob for lists.o.o
Change-Id: If5ee4ff09eb3c1cfc9185aed5266216f31fa345c
2019-01-04 08:08:52 -08:00
Colleen Murphy
edc0571d66 Fix glob for lists.katacontainers.io
Change-Id: I000146f0ea048ea1c82a766875ce536f63b7d940
2019-01-04 08:08:52 -08:00
Colleen Murphy
815485425b Turn on the future parser for zuul.openstack.org
Change-Id: I63c265529e8b3629a077c2a6a5a6dd5db05ff5a6
2019-01-04 08:08:52 -08:00
Colleen Murphy
b69be5e42a Turn on the future parser for all zuul mergers
Change-Id: I14c03542ccf1e1fcb682cd690d9aa8f468b494c5
2019-01-04 08:08:52 -08:00
Colleen Murphy
151cc49b9c Turn on the future parser for one zuul merger
Change-Id: Idb9985a502f4c4031daaba6c9666152e0e1dc107
2019-01-04 08:08:52 -08:00
Colleen Murphy
224b167d94 Turn on future parser for all zuul executors
Change-Id: Id3fcd132d49a0df104fc36020f45959587143eb6
2019-01-04 08:08:52 -08:00
Colleen Murphy
2f766f2cb5 Turn on future parser for one zuul executor
Change-Id: I8e5b0da658ebc85a7182341b5ac9e135f633bb42
2019-01-04 08:08:52 -08:00
Colleen Murphy
cb6a169dfc Turn on future parser for all nodepool builders
Change-Id: I72c529efd5936f8f2b594027d174cd6601d16ab7
2019-01-04 08:08:52 -08:00
Colleen Murphy
09d854e899 Turn on future parser for one nodepool builder
Change-Id: I92ad4527653ee2024f938b50e7e8062396824af3
2019-01-04 08:08:52 -08:00
Colleen Murphy
541e2896fc Turn on future parser for all nodepool launchers
Change-Id: Iec5714d263bc386ce493d05ca547cad83b729d73
2019-01-04 08:08:52 -08:00
Colleen Murphy
dadcd7688c Turn on future parser for one nodepool launcher
Change-Id: I27314e05877e1f0f42c44ab74d4d0a925994ed3e
2019-01-04 08:08:52 -08:00
Colleen Murphy
289520bd3b Turn on the future parser for master nameserver
Change-Id: I30a42d01453f48fd4edc3b3e71b0b4218ba1cfa2
2019-01-04 08:08:47 -08:00
Colleen Murphy
27114ff450 Turn on the future parser for all nameservers
Change-Id: I83c44b9515b6f3923897f3fbb50298bf841d47ea
2019-01-04 08:25:59 +01:00
Colleen Murphy
ceeb99f533 Turn on the future parser for one nameserver
Change-Id: I67c31cce4edf04c2f9ab5b467395c81d6b99a720
2019-01-04 08:25:36 +01:00
Colleen Murphy
66fb899cd6 Turn on future parser for all zookeeper instances
Change-Id: I090d8a033c273e9f17f614ace5ef1f625e0053c2
2019-01-03 11:45:01 +01:00
Colleen Murphy
7d51319e4f Turn on future parser for one zookeeper instance
Change-Id: Id0f4131fdc3a540c318895b7ba1e9c63a7d7cbb9
2019-01-03 11:36:01 +01:00
Colleen Murphy
12004e7b11 Turn on the future parser for files.openstack.org
Change-Id: I516ffb5e763dd9962a618bc4e34e031d8e9d75e3
2019-01-03 11:35:30 +01:00
Colleen Murphy
7b34d3cc5a Turn on the future parser for all mirrors
Change-Id: Id0de8127f66d896b8020f981ce5611ed887c205f
2019-01-03 11:35:04 +01:00
Colleen Murphy
5a62b117cc Turn on the future parser for rax mirror
Change-Id: I0666fbb024f4fa8b5510081dfabd1f017ccb89f9
2019-01-03 11:34:27 +01:00
Colleen Murphy
bf9b7b0e88 Turn on future parser for mirror-update.o.o
Change-Id: I2b23099b832a771233b96753cbed6cd8d1508d00
2019-01-03 11:33:55 +01:00
Colleen Murphy
b814465c3b Turn on future parser for git load balancer
Change-Id: I3a0d2b66218d83eca7c89567f2f8d46d257e9d82
2019-01-03 11:33:05 +01:00
Colleen Murphy
9c8be03281 Turn on future parser for all git workers
Change-Id: If9ffe551758b1a16a2ee6643d8034c1c1e454e72
2019-01-03 11:32:35 +01:00
Colleen Murphy
2bed97e4ef Turn on future parser for one git worker
Change-Id: Icd811556cf11a7f1482c61d04cbbee2ac8c0e6b2
2019-01-03 11:32:08 +01:00
Jeremy Stanley
e84bb89d98 Use domain-generic regexes/globs for hostnames
In preparation for rebuilding openstack.org servers in the
opendev.org domain, switch to Ansible inventory hostgroup glob and
Puppetmaster global site manifest regular expression patterns which
match both domains.

Change-Id: I0408a4452b5dcd5be2ad7ef73790eb1bf33b39b3
2018-12-20 17:47:11 +00:00
Colleen Murphy
100173dfe2 Turn on the future parser for elasticsearch.openstack.org
Change-Id: I91b5a7d15fa29ad1e604a5cf3a1bd32dfa5fa892
2018-12-13 15:26:12 -08:00
Colleen Murphy
7313bd0bb2 Turn on the future parser for subunit workers
Change-Id: I3308b015e99442c48f8a044a30ba50989eb9647c
2018-12-13 15:26:04 -08:00
Colleen Murphy
c5901672fa Turn on the future parser for logstash.openstack.org
Change-Id: I9f8056b91acf413f1d541b89aea5b98ca0cdfd1e
2018-12-13 15:25:59 -08:00
Colleen Murphy
8498fb0988 Turn on the future parser for wiki.openstack.org
Change-Id: Ie6de2e78b4f8292e9837f628f75ae229637d4c91
2018-11-06 21:27:11 +01:00
Colleen Murphy
f3a73fa03f Turn on the future parser for wiki-dev.openstack.org
Change-Id: Id78b81c24b9ac57af27082771146aca7072c0eb6
2018-11-05 22:21:39 +01:00
Colleen Murphy
e9bcd65a5b Turn on the future parser for lists.openstack.org
Change-Id: I9481f1b7cbd0eb1a266e2c0d9ba9d3c784bab737
2018-11-05 22:20:48 +01:00
Colleen Murphy
b45e642f97 Turn on future parser for lists.katacontainers.io
The mailman puppet module is tested and seems to be working on puppet
4[1]. Turn on the future parser for lists.katacontainers.io, which hosts
fewer mailing lists than lists.openstack.org does.

[1] https://review.openstack.org/601464

Change-Id: Iea7fbabf7cee579dcd19d4deb4d7537ed1b13bd9
Depends-On: https://review.openstack.org/601831
2018-11-05 22:18:26 +01:00
Colleen Murphy
e9576c0677 Turn on the future parser for eavesdrop.o.o
eavesdrop.o.o runs a number of different sites and bots, so on the one
hand it is a slightly complex service, but on the other hand these
modules are quite simple and similar to each other. Meetbot, accessbot,
and statusbot have tests and seem to work fine on puppet 4. Ptgbot does
not have tests, but that's why we should try this out sooner rather than
later so we have time to correct any issues before the PTG.

Change-Id: Id1af4b3ebf04f34c381eab5f818815734a296f7b
2018-11-05 22:18:22 +01:00
James E. Blair
90e6088881 Configure adns1.opendev.org server via ansible
Change-Id: Ib4d3cd7501a276bff62e3bc0998d93c41f3ab185
2018-11-02 13:49:38 -07:00
Clark Boylan
ab5c1944cc Simplify elasticsearch cluster groups.yaml membership
We run a cluster of elasticsearch nodes which may have additional
servers added to it or old servers replaced. Make this slightly easier
by matching them with a glob in groups.yaml so that we don't have to
edit this file to add new servers.

Change-Id: I8ce3e38f67c545642d561b2afdd6dbbfa677e67f
2018-11-02 12:20:20 -07:00
Clark Boylan
47bf937f8d Simplify git backend server groups.yaml membership
We run many git server backend nodes which may be replaced with new
servers. To simplify the process of adding or replacing git0* servers
stop explicitly listing them in groups.yaml and instead match them on a
glob.

Change-Id: I3dbf814122bbfc508b2a90a5f5a533226fa0bf8f
2018-11-02 12:20:20 -07:00
Clark Boylan
7427cc7a98 Simplify zookeeper groups.yaml membership
We run a cluster of zookeeper nodes. Lets match them with globs in
groups.yaml so that we don't have to edit groups.yaml if expanding the
size ofthe cluster or replacing nodes in the cluster.

Change-Id: Iff9048a9bc15e4f888e7caab54abb4d4a9d340d7
2018-11-02 12:20:20 -07:00
Clark Boylan
b53a03df68 Simplify nodepool groups.yaml membership
Replace all the explicit listings of nb01, nl01, etc with globs so that
we can launch new nodepool builders and nodepool launchers without
editing the groups file.

Change-Id: I3c32fb604109a3c65b2145b733fc0e2545e21045
2018-11-02 12:20:20 -07:00
Clark Boylan
9beb96838b Simplify mirror node listings in groups.yaml
Match the mirrors with a glob so that we can boot new mirrors in new
regions or replacements in existing regions without needing to
explicitly add them to groups.yaml first.

Change-Id: I3e7bf04a2d3a7602e46710840b0cec42c238c6c1
2018-11-02 12:20:20 -07:00