1647 Commits

Author SHA1 Message Date
Monty Taylor
3e4d99b6fd Remove global variables from manifest/site.pp
We have one global variable that is used in two places.
By removing it, we can more easily split site.pp into
per-service manifest files, and ultimately we should be
deriving this from groups['elasticsearch'] anyway.

Change-Id: I1d794b269847da85778f71e816359953af9b31e0
2020-04-19 10:59:25 -05:00
Monty Taylor
711295e918 Remove old etherpad.openstack.org
Once the DNS is swapped over to point at etherpad.opendev.org
we can delete the old stuff.

Change-Id: I626dd22b22a23619fcf460533336f1ddfec615d9
2020-04-19 10:58:46 -05:00
James E. Blair
42574b2b37 Run ZK from containers
Migration plan:
* add zk* to emergency
* copy data files on each node to a safe place for DR backup
* make a json data backup: zk-shell localhost:2181 --run-once 'mirror / json://!tmp!zookeeper-backup.json/'
* manually run a modified playbook to set up the docker infra without starting containers
* rolling restart; for each node:
  * stop zk
  * split data and log files and move them to new locations
  * remove zk packages
  * start zk containers
* remove from emergency; land this change.

Change-Id: Ic06c9cf9604402aa8eb4bb79238021c14c5d9563
2020-04-17 08:43:09 -07:00
Ian Wienand
dcc23be55b Remove static site puppet
Remove the puppet related to the static server

Story: #2006598
Task: #36758

Change-Id: I744da83d811e715ff8049eacf3013cd4831e1c49
2020-03-26 10:36:16 +11:00
Ian Wienand
f55580fbf0 Remove files02.openstack.org and related puppet
All this has moved to static.opendev.org; the server can now be
removed.

Change-Id: I8ca5d7a206e950c28bb8372a85b6a62d6b9ba00c
2020-03-26 10:36:13 +11:00
smarcet
de04c6da67 Added new param to IDP config
Added user_spam_processor_to to dev/production

Change-Id: I36a41bdcd23df9540183da5a087d364778d60b48
Signed-off-by: smarcet <smarcet@gmail.com>
2020-03-25 11:32:17 -03:00
Monty Taylor
d3c8c1077b Switch to running gerrit via ansible+containers
This should be mostly a no-op - but we will need to do a shutdown
in emergency mode.

Tell the gerrit role to not run compose up when run as part of
remote_puppet_git.

Change-Id: Id45376c2697656a12afeacf317b6f26c85c08dad
2020-03-19 17:21:39 -05:00
Clark Boylan
61caec5b77 Use LE cert on review.open*.org
We previously had two manually issued certs (one each for opendev.org
and openstack.org) but now have a single cert with all the appropriate
names in it automatically issued by LE. Use this new cert before the old
one expires.

Change-Id: I635d2bfd820fe138ee951833dd66f157b2b7c097
2020-02-28 08:10:24 -08:00
smarcet
ce6de87ea7 Removed OpenStackID stale config variables
Removed all variables related to Silverstripe
Dependency

Change-Id: Ib5e6834686c4952dd8e7220a31abe71a9278e397
Signed-off-by: smarcet <smarcet@gmail.com>
2020-02-24 14:26:30 -03:00
Clark Boylan
71f952dc93 Switch more puppet testing to xenial
wiki, status, and single node ci should all run on xenial now. Switch
their testing to xenial from trusty.

Change-Id: I3a0c2faa47f2ec17809e3845c7226173188def63
2020-01-29 13:32:06 -08:00
Zuul
12d9a02766 Merge "Switch nodes to xenial" 2020-01-16 20:43:30 +00:00
Monty Taylor
6f3a2792cc Switch to ansible on review-dev
The review-dev service playbook should do everything now that
the puppet did. Update how we're running things.

Change-Id: I70303c48328ea6713c24bf9c6f63d4808d30b95c
2020-01-14 12:04:15 -06:00
Clark Boylan
377d72f1ee Use zuul.opendev.org LE cert
This should only be merged once the cert is confirmed to be in place.

Change-Id: I44476ef5929470e92a9da1ca189bd5236eeb7d11
2020-01-09 11:40:12 -08:00
Clark Boylan
3981c02322 Provision LE cert for zuul.opendev.org
This provisions the cert but does not use it yet. We will do the
switchover once the cert is confirmed to be in place.

Depends-On: https://review.opendev.org/701819
Change-Id: I04fee48b9a79758527d8f9e8128c0fa915cd133e
2020-01-09 11:36:41 -08:00
James E. Blair
447b8513ea Use LE cert for git.zuul-ci.org
The cert has been issued.

This partially reverts commit 42c0d0696c738b701e486c2f7b3fc7069fa724bb.

Change-Id: I5f6c9d648a6fdfc3f9464c01f51d95c5cd72ed49
2020-01-08 16:14:26 -08:00
Clark Boylan
42c0d0696c Fix zuul-ci.org vhost cert paths
We were setting the cert file contents to the paths rather than updating
the paths to point at the new LE certs. Fix this by setting the _file
vars which update the path.

This includes a partial revert of the previous change to not switch
git.zuul-ci.org over to LE as we haven't provisioned an LE cert for it
yet.

Change-Id: I41c2aa1d03afba4ebf6378e9abf8276154666df7
2020-01-08 10:03:05 -08:00
James E. Blair
9fead30442 Use LE certs for zuul-ci.org
This switches the zuul-ci.org/zuulci.org vhost to use newly issued
letsencrypt certs.  It also does the same for git.zuul-ci.org, which
is a different vhost.  Since that vhost is tied into a configuration
which can't accept cert file paths (only content), adjust it to use
the newer "website" manifest pattern which can.

Change-Id: I0cd0407754466327147917390c578da336e61269
2020-01-07 15:25:32 -08:00
Clark Boylan
a08516c488 Switch nodes to xenial
These nodes no longer run on trusty and should be tested on xenial.

Change-Id: Iae4dc7798b43f74c183ca55c3f05d1f3d97f0a9f
2019-12-10 15:59:34 -08:00
Jeremy Stanley
fd3d792c8d Use a wildcard regex for storyboard-dev OAuth/CORS
With the move to object storage, we no longer have predictable
hosting locations for draft builds of opendev/storyboard-webclient
changes. Switch the OAuth and CORS ACLs in the storyboard
configuration on storyboard-dev.openstack.org to allow webclient
builds hosted anywhere, as there should be nothing sensitive we need
to protect in that StoryBoard deployment.

While here, tighten up the same ACLs for production StoryBoard to
just allow its local webclient deployment, reducing the risk of
cross-site scripting attacks.

Depends-On: https://review.opendev.org/691034
Change-Id: Ie4f5eb49a864848cfa95a3e956e6dbfa122fbb1d
2019-10-25 22:09:44 +00:00
James E. Blair
d579b997c4 Add zuul_connection_secrets to mergers and executors
These may need secrets (such as passwords) if they need to perform
git operations over http.

Change-Id: I93501ae27d246c1cccfe18fc555f3f2f4b7814d5
2019-10-04 14:11:26 -07:00
James E. Blair
859e386103 Add web_root option to zuul.conf
This is the base url that will be used for log reporting.

Depends-On: https://review.opendev.org/675655
Change-Id: Ia92a34e9ed506931e0d736ac034f60f4f7c381fc
2019-08-09 16:13:35 +00:00
James E. Blair
3c84c65614 Add tarballs.opendev.org vhost
Change-Id: I6aa85bf92b2d5726d3c86b11b103a87f11953c51
2019-06-05 14:10:19 -07:00
Clark Boylan
08152aa22f Remove groups configuration
This removes the groups servers from our inventory as well as our
manifests/modules. We don't run the groups service anymore as many
groups migrated to meetup.com independent of us and the others have
transitioned there.

Change-Id: I7cb76611e6d30e7189821923f36a38dec9ea7241
2019-05-23 12:20:04 -07:00
Jeremy Stanley
3eaf200196 Revert "Pin skopeo to unbreak skopeo+bubblewrap"
This reverts commit 0d370a285b09bd28c5b1cdfc6b89d2997f67da5d.

Fixed by https://github.com/containers/skopeo/pull/653 so safe to
merge this once a new build appears in the PPA.

Change-Id: I858eee79d084016b6b71eec46a6118d78f68cafa
2019-05-18 13:33:29 +00:00
Monty Taylor
0d370a285b Pin skopeo to unbreak skopeo+bubblewrap
Pin skopeo back to 0.1.36-1~dev~ubuntu16.04.2~ppa14 which is before
the code that changed the required capabilities, breaking the use of
skopeo from inside of bubblewrap.

Change-Id: Ibf3000d87772d02b7325315cfeed078716e0d7bf
2019-05-15 14:16:57 +00:00
Monty Taylor
e69c7b7fb9 Rename review.openstack.org to review.opendev.org
There are many references to review.openstack.org, and while the
redirect should work, we can also go ahead and fix them.

Change-Id: I28f398796a6392a3dffea1d25cfe2ae3a36a3589
2019-05-09 14:38:51 +00:00
Ian Wienand
2acfc176b0 Remove graphite.openstack.org
The server has been removed, remove it from inventory.

While we're here, s/graphite.openstack.org/graphite.opendev.org/'
... it's a CNAME redirect but we might as well clean up.

Change-Id: I36c951c85316cd65dde748b1e50ffa2e058c9a88
2019-05-08 05:55:33 +10:00
smarcet
fa0f5860d2 Update OpenstackId Prod Node Settings
moved from smtp email driver to sendgrid

Change-Id: I719a3fd7e730972b7a0784a9a4857a76672119d0
2019-04-30 14:24:42 -03:00
smarcet
66bf9c5cc4 OpenStackid parametrized urls
updated config to be able to setup registration/lost password
and resend verification link by config

Depends-On: https://review.opendev.org/#/c/656395/
Depends-On: https://review.opendev.org/#/c/656396/
Change-Id: I9df2afbc6a90652030fde5398f8ac28ca3c4c397
2019-04-29 18:41:54 -03:00
Zuul
6d85578b14 Merge "Install socat on zuul executors" 2019-04-23 21:44:44 +00:00
James E. Blair
676bc3cadb Install socat on zuul executors
This is needed for the intermediate registry jobs.

Change-Id: I98652c4cf4ec0688d18e74d39090bb3b22ad8274
2019-04-22 10:16:47 -07:00
Clark Boylan
6e61cbff2e Stop ansipuppeting the old cgit farm
We have replaced the cgit farm with a gitea farm. Stop managing the cgit
farm. This removes testing for centos7 as these were our only centos7
nodes.

Depends-On: https://review.opendev.org/654549
Change-Id: Ia48ff10cb88d51f609e8b28de176c72f7a9ee24f
2019-04-22 15:50:08 +00:00
Monty Taylor
c6d129a108 Update some paths for opendev
There's a bunch in here. This is mostly big-ticket things and test
fixes. Also, change the README to rst - because why is it markdown?

Depends-On: https://review.opendev.org/654005
Change-Id: I21e5017011e1111b4d7a9e4bf0ea6b10f5dd8c1b
2019-04-20 09:31:14 -07:00
James E. Blair
07572767dd Merge "Redirect review.openstack.org to review.opendev.org" 2019-04-20 15:45:28 +00:00
James E. Blair
881c8f590f Update known_hosts for zuul
Add the review.opendev.org hostname to the known_hosts files.

Change-Id: I8b925053adaca7f47c647641466c0762b17776d9
2019-04-19 20:16:57 -07:00
Clark Boylan
16fa372e0c Redirect review.openstack.org to review.opendev.org
This is part of the opendev git hosting transition. We do this on
review.opendev.org/review.openstack.org and not files.openstack.org so
that ssh connections continue to work. This will need to be applied
during the maintenance window.

This also updates the canonical urls and logo.

Change-Id: I5bf4dcd6835e379fcdd2d55393c5a844578074a9
2019-04-17 20:50:20 +00:00
Zuul
498151d7e2 Merge "Update grafana for new archive repo" 2019-04-17 03:38:50 +00:00
Zuul
4f7dd4157e Merge "Added openstackid dev sendgrid support" 2019-04-16 18:08:20 +00:00
Ian Wienand
fb12d2620b Update grafana for new archive repo
Grafana has moved to a new package repo [1] and the apt-get update
step is failing on the current host.

The first version of puppet-grafana that has this update is 6.0.0;
this is two years later than the current version we're using so
... yeah.  It does not work with puppet3, so only run apply test with
puppet4.

It looks like upstream has moved from camptocamp/archive to
voxpupuli/archive so the comment is no longer required.

[1] https://grafana.com/blog/2019/01/05/moving-to-packages.grafana.com/

Change-Id: Ibab0ed6799563ba0f9674ef1ea575c6ac5d60341
2019-04-15 12:05:28 +10:00
smarcet
d6c2d3ab9e Added openstackid dev sendgrid support
updated openstackid dev node configuration
to use sendgrid api key from hiera

Depends-On: https://review.openstack.org/#/c/651794/
Depends-On: https://review.openstack.org/#/c/651798/
Change-Id: I9fc5e9b24886105771a1be93d8d8a6c6e1189c32
2019-04-11 11:49:27 -03:00
Ian Wienand
74e33f362e Pass SSL certs to graphite.opendev.org
This enables the SSL site for graphite.opendev.org

Change-Id: Ifa9e4864a9b2bad4a9e94ad1312f9e1d05b8aef3
Depends-On: https://review.openstack.org/651686
2019-04-11 13:23:41 +10:00
James E. Blair
2ccf1ddb7a Use docs.opendev.org ssl cert
This has been added to bridge hostvars.

Change-Id: Ibd3db857b02558a255c482d8da83564fbc65d7c1
2019-03-26 15:31:50 -07:00
James E. Blair
51dda0881f Serve docs.opendev.org from files.openstack.org
Change-Id: I2d69994b51bef96b7ba9b71b1a65d0a1956f9f73
2019-03-22 15:49:59 -07:00
Zuul
a38f3e5c73 Merge "Set up legacy git redirect sites" 2019-03-20 21:06:10 +00:00
Clark Boylan
8c8b1d9c71 Remove trusty testing flag from nodes that are xenial
We've been upgrading many of our nodes to xenial from trusty. Remove the
manifests/site.pp trusty test flags from nodes that don't run on trusty
any longer.

Change-Id: I2ee9754d8b30f120d375cb6ff554c107f4a750d5
2019-03-13 15:02:47 -07:00
Clark Boylan
1de45463c8 Manage zuul status backups directly
We were previously creating zuul status backups for http and https
endpoints. We really only need them for the https endpoint. Additionally
backup our kata-containers tenant.

Depends-On: https://review.openstack.org/642896
Change-Id: I35a58b2faf3234aa0f3c04e5a682c8f9f9111898
2019-03-12 14:37:54 -07:00
Jeremy Stanley
72e51a8998 Just use openstack.org domain for wiki hosts
Currently there are no plans to integrate the existing wiki services
into OpenDev, so for clarity we're limiting the inventory globbing
and global site manifest node regular expressions to the
openstack.org domain specifically.

Change-Id: Ifdc86f7cc5d6a865e1d5f76828ad8b52f2ee75fe
2019-03-10 14:32:11 +00:00
Jeremy Stanley
73955d55b7 Set up legacy git redirect sites
As part of the move to Gitea, we're creating compatibility redirects
from our old Cgit and Git HTTP backend sites to opendev.org. This
introduces Apache vhosts for each of git.airshipit.org,
git.openstack.org, git.starlingx.io and git.zuul-ci.org which all
serve the same docroot on the files.openstack.org server. This
docroot houses a single .htaccess file with the relevant redirect
rules.

Change-Id: I729fe39bcbe0a0cae237e9036ed8fa980f897e68
Co-Authored-By: James E. Blair <jeblair@redhat.com>
Task: #29705
2019-03-08 23:54:51 +00:00
Clark Boylan
df97b70c00 Test afs nodes on xenial
This is part of the work to upgrade our afs nodes to xenial. We will run
on puppet tests on xenial against the afs node defs.

Change-Id: Ifcfc2d33d600ad8630408c0080a3bde02df3167a
2019-03-06 15:08:17 -08:00
Clark Boylan
bfb2963c20 Cleanup old health server
We have replaced health.openstack.org with health01.openstack.org
(CNAMEd to by health.openstack.org). Remove reference to the old server.
Note that this updates references to health01.openstack.org to use the
full openstack.org to make it clear that this is not an opendev service.

Change-Id: Ifa21dc4a82258974857da2a843f67c5234736c47
2019-02-27 10:32:02 -08:00