1032 Commits

Author SHA1 Message Date
Zuul
497ebb9c2c Merge "Remove ansible-cron role" 2020-04-09 21:15:50 +00:00
Zuul
81c52855ac Merge "Remove run_all.sh and ansible cron job" 2020-04-09 20:34:24 +00:00
Zuul
22d5d3cdcd Merge "Run AFS in zuul" 2020-04-09 20:08:25 +00:00
Zuul
bf025942eb Merge "Add cron jobs that were managed by puppet" 2020-04-09 17:28:58 +00:00
Clark Boylan
62048eecc2 Switch meetpad to the opendev etherpad
The new opendev etherpad is up and running. While not in production yet
(we need to transition the DB from etherpad.openstack.org) it should be
fine to have meetpad start using it now as meetpad isn't in production
either.

Change-Id: Ic1917688cba37c03e45e3bccbce6fc723022b94c
2020-04-09 08:26:25 -07:00
Zuul
098df7d0e1 Merge "Set production NODE_ENV" 2020-04-08 23:08:56 +00:00
Zuul
1b4ae0e7ff Merge "Configure etherpad to use utf8mb4" 2020-04-08 21:16:26 +00:00
Monty Taylor
9e6e57838f Set production NODE_ENV
Without this we run in development mode. The logs indicate this is
less good and production mode is faster/better.

Change-Id: Idc19bdcb84375f29cb973f5271e8c090465c7f5b
2020-04-08 14:04:39 -05:00
Monty Taylor
81a1e235d0 Configure etherpad to use utf8mb4
We need to set this in the settings.json.

While we're there, set the defaults in my.cnf. I don't think that
actually matters, but it also shouldn't hurt.

Change-Id: I52e65136383f6c06d1693dd3d396f527c7e0b377
2020-04-08 14:02:17 -05:00
Monty Taylor
ee67e26b4a Remove ansible-cron role
Once the previous patch has landed and run on system-config
then we can remove the role altogether.

Change-Id: I14fef0e178544d71390a6601915c745647435ab9
2020-04-08 10:46:55 -05:00
Monty Taylor
589521fd18 Remove run_all.sh and ansible cron job
Remove the script and the cronjob on bridge that runs it.

Change-Id: I45e4d9713f3ba4760ba384d13487c6214d068800
2020-04-08 10:46:55 -05:00
Monty Taylor
e7342c7e3e Run AFS in zuul
Change-Id: I5ea46cbf124006e38c045e2f93a19d33a9c3db91
2020-04-08 10:46:32 -05:00
Monty Taylor
1e79b848cd Rename ansible_forks to infra_prod_ansible_forks
ansible_forks is a magic var, so when we try to set it ansible
is overriding it.

Change-Id: I3ae45b28d545571f04b02927c3f6c97f145743bc
2020-04-08 10:45:29 -05:00
Clark Boylan
dd2ba436f9 Become root when fixing bridge logging
We are writing to /var/log/ansible which needs root perms. This was not
done and the writes failed. Fix that.

Change-Id: Ibe93519f2f549e85f0e238a210999c6281f42ce6
2020-04-07 17:07:00 -07:00
Zuul
d708919903 Merge "Only run etherpad playbook on new server" 2020-04-07 22:52:51 +00:00
Zuul
960b9d7bbd Merge "Improving logging of prod playbook jobs" 2020-04-07 22:07:27 +00:00
Monty Taylor
a0a0341b36 Only run etherpad playbook on new server
This doesn't want to run on etherpad.openstack.org.

Change-Id: Ib01a0f57b1d1bd1b3faccb7389c53e7a2835793a
2020-04-07 16:59:37 -05:00
Clark Boylan
c5263d76c9 Improving logging of prod playbook jobs
This updates prod playbook jobs to curate a set of logs on bridge if we
aren't publishing them to zuul. This way we have history on the bastion
server.

Change-Id: I73889754155298a8554ddc17bb413ae7764b9eae
2020-04-07 14:10:32 -07:00
Monty Taylor
b0c0252f55 Remove leftover /var/run dir creation
This was added for a previous unlanded version of a change and
never removed. Oops.

Change-Id: I6006198dafac611c8ae1e2a6efcaddf5b9a60c8d
2020-04-07 13:53:13 -05:00
Zuul
39dbc4f329 Merge "Run zuul-preview in zuul" 2020-04-07 18:06:49 +00:00
Zuul
b3b8391f45 Merge "Make a new dockerized etherpad.opendev.org" 2020-04-07 18:06:48 +00:00
Monty Taylor
b23515c623 Make a new dockerized etherpad.opendev.org
Upstream likes building the settings file into the image, but that's
less exciting, let's bind-mount ours in.

Depends-On: https://review.opendev.org/717491/
Change-Id: Ia1894d884ef2a84e1282345b77fe07bf8898f367
2020-04-07 11:10:57 -05:00
Monty Taylor
544b75ad2f Run puppet on old nb0[1-3] in nodepool playbook
We still need to run puppet here until they're replaced, but
we're triggering service-nodepool on project-config nodepool
changes. So run the puppet.

Change-Id: Ib0bdaeee98e19921b8c4117c12f8a0c05e64af57
2020-04-03 16:15:11 -05:00
Monty Taylor
3b2f87105d Add cron jobs that were managed by puppet
These still exist, because puppet put them there. We should delete
them by hand on the server and then land this.

Change-Id: I7ee0c60fade0b29a52898a7edf64554d1aa61cae
2020-04-03 10:53:30 -05:00
Zuul
6d8409f46e Merge "Grab logs in the case of errors" 2020-04-02 23:14:14 +00:00
Zuul
7ca32aa4d8 Merge "Add zone keys to zuulcd user" 2020-04-02 23:14:01 +00:00
Zuul
9c4c225cbf Merge "Rename bridge.yaml to install-ansible.yaml" 2020-04-02 18:30:20 +00:00
Monty Taylor
ad7b4c149b Run zuul-preview in zuul
Also rename the playbook to service-zuul-preview so that it's not
confusing about what it does.

Change-Id: I7a300ab4078a6473af0339d8cbf4b11e397ed837
2020-04-02 09:43:10 -05:00
Monty Taylor
b099b439b4 Grab logs in the case of errors
More importantly, put the log collection in an always
section of block, otherwise we won't get logs if a
playbook fails, which is pretty much exactly when we
want to get logs.

Change-Id: Ia8e581e522f75a5f5945bc2143eec63b93381a94
2020-04-02 08:19:48 -05:00
Monty Taylor
211a9950f5 Add zone keys to zuulcd user
We want to trigger nameserver updates when we merge patches
to zone files.

The zuul zone repo is currently managed by infra-core. We need to
make an improvement to zuul before we can offload core role there
to the zuul-maint team.

Change-Id: I6192f2499465844ccf2a1f903a8897458814da5d
2020-04-02 08:14:45 -05:00
Radosław Piliszek
cc4c46c2e8 Do not canonicalize URLs to registry.npmjs.org
Kolla Monasca Grafana images are currently not buildable in CI
due to:
404 Not Found - GET http://mirror.bhs1.ovh.openstack.org:8080/registry.npmjs/@types%2fcolor-name

The url-escaped slash gets mangled by Apache on its way to
registry which causes 404.

This patch fixes that.

Change-Id: I5a3a6551536e2d1e87aa074e0de7619a367b1971
2020-04-02 14:29:00 +02:00
Monty Taylor
2e6cf25e5d Rename bridge.yaml to install-ansible.yaml
We have a bridge.yaml and a service-bridge.yaml and it keeps
being confusing. Rename bridge.yaml to install-ansible.yaml to make
it clear what it is that it actually does.

Add a soft-depend on it for manage-projects, because if
something updates with the ansible config, we want it to
happen before running manage-projects.

Change-Id: Ia7c8dd0e32b2c4aaa674061037be5ab66d9a3581
2020-04-01 14:14:55 -05:00
Clark Boylan
77e09bd193 Switch meetpad to etherpad-dev
This is to test if newer etherpad-lite works with jitsi integration
better.

Note that etherpad-dev uses a self signed ssl cert. When testing this
you may have to navigate to https://etherpad-dev.openstack.org and
permanently accept the ssl cert there before using meetpad. Then when
testing is done you can go back and remove the exception to ssl
verification.

Change-Id: Ie5a3db3f3ab762445afff6281cb372f90afc1410
2020-04-01 09:38:55 -07:00
Michal Nasiadka
a1433563d3 Change CentOS 8 upstream mirror
Currently used mirror is not up to date and is not on the list of official
CentOS mirrors.
Changing to a mirror also located somewhere in US,TX - which should be
close-ish to DFW servers.

Change-Id: Id8267bc7e6c8a96ccdfd98c16390d36842f26de3
2020-04-01 16:19:12 +02:00
Zuul
acfffa1384 Merge "Use ansible debug callback plugin" 2020-04-01 05:50:53 +00:00
Zuul
1059cb6121 Merge "Change manage-projects default args" 2020-03-31 23:19:07 +00:00
Zuul
1fd2e226ab Merge "Remove inventory references to <static|files>.openstack.org" 2020-03-31 21:47:47 +00:00
Monty Taylor
5d238b1b57 Use ansible debug callback plugin
The normal callback plugin is unreadable for stdout and stderr things.
Update to use the debug plugin which prints their output nicely in
the way we'd like.

Change-Id: I3a6b31af7d6132a1ee31a280f7f21f3132856273
2020-03-31 15:54:58 -05:00
Ian Wienand
476c3ac6f2 Remove inventory references to <static|files>.openstack.org
These hosts have been removed; remove the old references and
unnecessary groups, add the new host to cacti.

Change-Id: Ibcfd78a37e20e514c190ef801c2d44320c8b3f74
Story: #2006598
2020-04-01 07:49:02 +11:00
Zuul
27ba59f68d Merge "Correct jitsi-meet config file" 2020-03-31 20:32:29 +00:00
Zuul
6c5505a60d Merge "Log manage-projects to stdout" 2020-03-31 18:20:00 +00:00
Monty Taylor
3401c32c62 Change manage-projects default args
Just set them to -v, which we set as an override in the playbook
in the previous change.

Change-Id: Ie18c9bbd7dfa3d274ce283f9152e2c27905d9d08
2020-03-31 12:42:54 -05:00
Monty Taylor
eee201edd3 Don't run the review clone on connection local
connection: local is set on the first play. That means it's using
the local connection to try to clone on review - which just means
a second clone on bridge.

Change-Id: I11ff748617b405448697012759e2dab0314f6857
2020-03-31 09:53:41 -05:00
Ian Wienand
56681deb80 Switch linaro-us cloud to ipv6 only
There are insufficient ipv4 floating-ips to cover our VM quota; switch
to ipv6 only so all vm's can boot.

Change-Id: I2225fa9ea888bcf167be7139e036a4b5406b1f4f
2020-03-31 11:44:17 +11:00
Zuul
41ed9e2b68 Merge "Collect production playbook output" 2020-03-30 21:59:54 +00:00
Zuul
2a2431611d Merge "Remove /tarballs proxy from mirrors" 2020-03-30 21:59:49 +00:00
Monty Taylor
771e401001 Log manage-projects to stdout
If we're gonna run this from zuul instead of from cron, output to
stdout so that the output will be captured in zuul logs.

Change-Id: I7228cacfb47834a32b803031ebe104ba02d09c40
2020-03-30 15:57:50 -05:00
Monty Taylor
179d1a2516 Collect production playbook output
We need to log to a file and then collect it to the log output on
zuul. Default to true to that steady-state reads nicely. When we
add new jobs we should make sure to set to false first so that we
can vett the output before publishing it.

Change-Id: Ia4f759b82a5fff6e36e4284c11281254c0d5627d
2020-03-30 15:56:59 -05:00
Monty Taylor
bde5860f57 Parameterize manage-projects logging output
Change-Id: If4c456957fdce308ccafee0dfad8b627a85ea796
2020-03-30 13:53:39 -05:00
Monty Taylor
b94a2c5b96 Update project-config in manage-projects
If we're going to trigger this from project-config, we should
make sure it updates project-config as a first step. Currently
it's counting on having run after service-review in run_all.sh.

Change-Id: I14ce9b42af533c742128ce87cda8c8fb897632e4
2020-03-30 10:00:12 -05:00