The elastic-recheck uncategorized bugs page has manila jobs in it
so we need to be able to index the manila service logs in logstash.
For example: http://goo.gl/k1bjUX
Change-Id: I3360858a5a704bc1304c2bc00792ea15f2b924f2
Related-Bug: #1491325
With the recent ceph gate blocker with backups it'd be good to be able
to query for failures in the cinder backup logs, so let's add it to the
logstash index.
Example log: http://goo.gl/4IIWai
Related-Bug: #1476416
Change-Id: Ie5f63e3a4acb5cfef97292cd7c8a009d86ee703a
Enable us to use logstash.openstack.org to help debug multinode failures
that occur on the subnode.
Change-Id: I3629f4827abec68b731ce47048dab553908662d2
Depends-On: Icf842ec12e87ccd208c551870312c8e4b62613bd
The SSL cert for jenkins.openstack.org was obtained in 2013 when
this interface was more heavily used by our developer community.
Since then we've rolled out 7 additional Jenkins masters and so this
is no longer a useful primary reference. The only real need for
authenticated connections to its WebUI at this point is systems
administrators performing maintenance and minimal local
configuration, for which ToFU of a self-signed cert is sufficient.
Change-Id: Ibf95983a2ac76c2e9e39bcfc99643e3cac401245
This syncs up the SSL cert check sites list to match the SSL certs
we have Puppet applying from our hiera list.
Change-Id: I02812af75a9c619856c7130be92e2b15ba370608
We suspect that the centos6 git slowness is affecting git client
operations on our servers themselves (invoked via puppet vcsrepo).
This installs ianw's fixed version of git on all centos6 machines.
Change-Id: I8496e9fd8d07829fb341b9241ea20d3f49d455b4
In the same line as other changes, move settings of config
file to template, and expose the settings on manifest,
so it can be easily configurable.
Depends-On: I78962555c9a9ec1a96ce19810a463a5d619b04f9
Change-Id: I673c9c177bf2fdb3e6428e3ad4252ee76b53309c
Instead of taking care of cgitrc configuration in system-config,
use the new embedded logic for puppet-cgit to set that
configuration.
Depends on puppet-cgit module, as the configuration was moved
there.
Depends-On: I5c8ef0e7036c4b7a33aa12dc502c048af0499dda
Change-Id: I0bdbbdc3689cc33981c9c74af4b6c3080acf2dbe
We need the zuul-env venv to be on all slaves not just dib/nodepool
built slaves. Do this by puppeting the virtualenv setup and pip install
of zuul in slave_common.pp.
Change-Id: I290a695c697fb456bee6f8212ba50b6c1b4533fc
In the Zuul review table added to gerrit in hideci, replace the
term "Review" with "Change" as it is more correct.
Change-Id: I34010ef651d7c3d41eaa73ae17791806cf6b56ac
This should cause easy_install to only contact our pypi mirrors
when fetching packages.
https://pythonhosted.org/setuptools/easy_install.html
#restricting-downloads-with-allow-hosts
Change-Id: I8f7f2bc8fb281cb038a3b493ef33427892b36536
This changes remove the jenkins.default file and use the one of puppet-jenkins.
This change needs to land before I87849efa7a40f3ac62e90e2d763a2836b6d91aab.
That will leave jenkins.default unmanaged for a brief time.
Change-Id: I7316dba6cb333bf0821eacde8341601409a4453d
gearman-logging.conf, logging.conf and merger-logging.conf
has been moved in puppet-zuul modules in:
I76851c8672968a7581622cac8ff0062c1f50e0ef
The patch this one depends on adds a feature flag (by default set
to false) that can activate the installation of these configuration
files.
This patch removes the configuration files and set the
feature flag to true in order to let puppet-zuul manage
the configuration files by itself.
Two follow up patches will then be created (once this one is merged)
in order to set the feature flag (in puppet-zuul) at true by default
and another one on system-config to remove "manage_log_conf => true".
Change-Id: Ic5ceb7fb23a8403a31f9db2774ddd900fd838930
Depends-On: I76851c8672968a7581622cac8ff0062c1f50e0ef
This returns the optimized url for zuul, which should dramatically
drop the amount of data transfered out of zuul. It also uses the ajax
method which lets us ensure that we don't schedule another pass
through the loop until we completed the current request.
Add support for jquery visibility optimization
Change-Id: I0e50f07fd9165e7a45c2712f6b1c4b3601759cba
This reverts commit ff6d73b989c57db79bb53e82f814d651945c3ac6.
This brings back zuul inline status which is further optimized in
follow on patches. We do this in phases because it's a lot easier to
review that way.
It also introduces zuul_inline global control variable, so we can land
this turned off, and enable in the debugger to verify it's doing the
correct thing.
Change-Id: If951a4a05a7dfef7a6d0c8e15ed263ff0523165e
This provides the facility to leave tracing in hideci that won't
trigger by default, however if trying to debug bad behavior you can
enter the javascript console, set hide_ci_debug = true.
Change-Id: I42bf4e830256ee64eb726e3a82d805f7ca35e246
This is a small tests server for testing hideci (and other gerrit
static file changes), it does this by creating a local http server,
then proxying and translating pages on the file (changing hard coded
references to zuul.o.o and review.o.o to route through this
file). You'll end up with a localhost:8001 (port is configurable) that
you can browse to and be on live gerrit + local files served.
Login doesn't work, because the openid redirect magic appears to
happen in a way that we can't intercept (boo), but you can still poke
at a lot of the interface pretty seamlessly this way. Makes for much
better testing.
We need to fetch zuul targeted status urls over http as well because
default python 2.7 apparently blows it's stack on zuul's ssl cert.
Change-Id: Ic28729cea9f2d1aea675025e5fef29f2bcc25164
This moves the hiera root under /opt/system-config so it can reach
into both private and public hiera directories. This implies that
hiera data will live in a hiera/ directory in system-config.
Manual: This requires a manual change to the puppetmaster system. A
rooter must move /etc/puppet/hieradata to /opt/system-config/hieradata
Spec: http://specs.openstack.org/openstack-infra/infra-specs/specs/public_hiera.html
Change-Id: I1736759ee9ac7cd0c206538ed0a2f6d0d71ea440
We've been trying to get the cells job in the check queue passing
consistently and it's been a game of whack-a-mole with regressions, so
when we're trying to debug new failures it'd be super helpful to
actually have logstash for the cells logs.
This adds the cells logs and only indexes them for the cells job(s)
which is the only time they should appear.
Change-Id: Id4450b7cb5d3303f9cb031c3e77fc17cfff97890
Before we start having ansible copy smaller hiera files around, we
need to be able to split common.yaml into smaller files and continue to
use our current structure. Configure hiera to look at group and fqdn
files in addition to common.
Change-Id: I32bf69f80c748668ca218a7a326c5737ec81fa7f
The system to add zuul status to gerrit pages is very inefficient
and is causing high load on the zuul server as well as poor
performance in browsers. Remove it until it can be reworked to be
more efficient.
This reverts commit 5be687279c6a5284a39e1e62e928b5cf5b359aa3.
This reverts commit 0118d2b4b53cea2641c123a57c14bf8276237f09.
Change-Id: I0ec03e9c585ecc53a839a7a03fa0171a3d28b873
There previous regex had a bug which meant that the Toggle CI button
and functionality wouldn't trigger when browsing to a change which
included the revision number. This updates the regex to match in those
conditions.
Change-Id: Icc3d580d063c3a64f9d2b7e7d6a46e67afe0c779
Modern browsers are not happy to retrieve plaintext HTTP content
when running in the context of an HTTPS-served page. When including
Zuul's status JSON blob from the Gerrit WebUI via hideci.js, use
HTTPS.
Change-Id: Ibafe2b210ecdebea1781192beb0f4a14a23121eb
Move the documentation to append to apache indexes into the
devstack-gate footer.
Change-Id: Ifcc7b9ab40aad55bc45377183ea06d40d9fe2f78
Depends-On: I8b26cc58c2ad6ca029726d227cf1d38d72465627
The libjs-query package sets up jquery on trusty with these
files and sim links:
~$ ll /usr/share/javascript/jquery/
drwxr-xr-x 2 root root 4096 Jan 15 20:44 ./
drwxr-xr-x 5 root root 4096 Jan 15 20:44 ../
-rw-r--r-- 1 root root 252879 Jul 5 2013 jquery.js
lrwxrwxrwx 1 root root 13 Jul 5 2013 jquery.lite.js -> jquery.min.js
lrwxrwxrwx 1 root root 9 Jul 5 2013 jquery.min.js -> jquery.js
lrwxrwxrwx 1 root root 13 Jul 5 2013 jquery.pack.js -> jquery.min.js
-rw-r--r-- 1 root root 5 May 23 2012 version.txt
The current puppet config is broken for trusty because it attempts to copy
the link instead of the file. This results in a broken sim link to jquery
and breaks the Toggle CI button on Gerrit because that button depends on
jquery. This change corrects this situation by copying the file provided
jquery.js file instead of the link.
Change-Id: I18056ca528871d9a96218f0919bbd262da005f31
When running ansible we need to pass a specific version of
project-config through to puppet from ansible. Do this via the
project_config_ref fact that the puppet role in ansible understands.
Depends-On: Id99c3c2c20764ed4ba4259bd53f8067289374403
Change-Id: I88995c81c13080d913bac239a7635619cdc34441
