The entrypoints use for jeepyb won't work without pycrypto
installed, so we want to be able to pip install pycrypto which
requires the gcc package.
Change-Id: I9ff914347743c20728b5b10028866d8cbc7f0c61
* modules/openstack_project/templates/logs-dev.vhost.erb
* modules/openstack_project/templates/logs.vhost.erb: With the
recent advent of an additional parent node in the job log path, the
ReadmeName was no longer being applied to new log directories. This
corrects it by adding duplicate Directory blocks for them with the
new pattern. Note that ReadmeName does not work inside regular
expression blocks like DirectoryMatch, but the old Directory blocks
can be removed when those logs expire in about 6 months time. Also
added patterns to provide readme files for equivalent periodic jobs.
Change-Id: Ib12f1d6f033b8129af38d694f7b221bea9614ecd
Add jenkins01 and jenkins02, both of which will have unit test and
devstack slaves. Leave jenkins.o.o alone; over time it will be
reduced so that it alone has special jobs and privileged slaves
attached to it.
Note that currently all of the jobs will be defined on all nodes,
including jobs on timers. I think the long-term fix for that is to
have zuul schedule timed jobs.
Change-Id: I10bbd5555e5194b1031700975d5b3ae6b458b8b3
This commit adds openstack-glance to the list of channels for
gerritbot. This commit initially just has it tracking the glance and
python-glanceclient repos.
Change-Id: I6f25ca8fd34b2d89ff3c0d119b307143b3b54c8d
New versions of setuptools and old versions explode when mixed together
in dangerous ratios. Ensure the ratio is just right in the pip module
so that it ends up everywhere that needs it.
Change-Id: I22fe26c6cb40ee24ca242226e5b52dc127b4c564
change the date link to something human creatable (the uri escapes
got obtuse quickly). Also change it to something which is a valid
css class name so that we could highlight the lines later. This
required some changes to span parsing to inject the additional
css class.
Finally add a couple of fixups suggested by clarkb and fungi on
the last round. This should be ready for main log server.
Change-Id: Ia5111873ee60c174a5c7ddc479fa0c63ead9d97d
Updated manuals.yaml to reflect the pom.xml location specified
in openstack-training. Also added publisher statement to allow
openstack-training to show up on docs.openstack.org Updated zuul
layout.yaml to enable zuul to gate openstack-training.
Change-Id: I2e082a7c02547d76d4df97a5deaecbb3faf86652
Implements: Blueprint training-manuals
The script allows a node 15 minutes to boot. Additionally, a bit
of time is needed afterwords to add it to Jenkins. Increase the
timeout of the launch job from 10 to 20 minutes so that entire
process is more likely to occur within one run of the job.
The job itself is still scheduled to run every 10 minutes, so if
this proceeds quickly, we will still start a launch job every 10
minutes. If things are slow, we may only run it every 20 minutes
in the worst case. The job is not allowed to have concurrent runs
so this is safe, and the n+1 job will simply be queued.
Change-Id: I879c4d309116f1b0517d878b7365ebc29b27f547
It may be useful to have a consumable log of every call the system has
processed. This enables a simple CSV based file for CDRs (Call Detail
Records).
Change-Id: I2086594a127e1377056fdb10af763ade3af4ad56
* modules/jenkins/manifests/params.pp
* modules/jenkins/manifests/slave.pp: The conditional check introduced
in the Jenkins slave manifest in commit 3c7af7d was only a half-fix
since the python3 pip provider lacked a similar check, so depending
on the order in which it's puppeted the conflict could still arise.
Since this package is not needed on non-py3k slaves, we can just
remove it from the slave manifest and expect slaves which do need it
to get it from the pip puppet module instead.
Change-Id: If22aaa1319b61aa58306036a03843fa0cc79b34c
ensure that path of the file we're going to open is actually
inside our log root. If not return a 400.
escape dates in the regex so they are easier to pass around,
unencoded spaces kind of suck for that.
catch the possible IOError of openning a file that doesn't exist,
be nice and give people a 404 in that case.
move the content negotiation into a function, for readability
Change-Id: I334e1ac0419cd140c6af35c78634a2d7c05dcf01
apply the same logging configuration for jenkins-dev as for
jenkins prod.
Change-Id: I5bff25b9e701a3f6ed764879d8110132a551271b
reference: https://review.openstack.org/#/c/38352
Add a job to automatically deploy the zmq-event-publisher
plugin to the jenkins maven repository when a
tag is created.
Change-Id: I99a1f41800f54cf649a21783df5d6da2c0959304
We keep adding more tempest tests to run per patchset. These tests are
the most expensive to index as they come with many megabytes of
uncompressed logs. Add more logstash worker nodes in an attempt to keep
up.
Change-Id: I41d35792d58d1b0456927b0f5b1b7728bf3d145c
The '-u' option was making curl prompt for a password,
which we don't want. Remove the '-u' option to
automatically pass in jenkins user credentials to curl
via the config file.
Change-Id: I5766bcfef561e6ac10b49c958394d9601e62e1b5
this adds a wsgi application which processes all the txt.gz log
files and htmlifies them on the fly before sending them to the
user. It uses content negotiation to only do this if the client
says it Accepts text/html, otherwise it just dumps them back out
as text/plain.
In either case the content is compressed with mod_deflate, which
provides a 15x-20x bandwidth savings vs. if we left it
uncompressed on the wire.
Should get more testing before general deployment, but this is
getting close to the approach I think we want to use.
This enables the functionality on a new logs-dev.openstack.org
vhost so that we can do live testing that this works before
switching over the main site to it.
Change-Id: I12a06c4b55be05fb8060b76f5aea9ebc801c0537
This commit adds a logging configuration file for jenkins so
that we can persist the jenkins logger configuration across
restarts.
This commit also adds a logger configuration,
"org.gearman.session.logger" to "WARNING"
Change-Id: I4cf886a93f33bd153a6e3f81534df582425bd8f5
