27 Commits

Author SHA1 Message Date
Monty Taylor
ba2b36bad4 Add slave-common to long lived slaves
We need the jenkins slave scripts on these too.

Change-Id: I25ef6bf730cba1e0aee0b027d1517dd4636c8b47
2015-06-29 17:21:53 +00:00
Yolanda Robla
4b213ccb36 Expose jenkins_gitfullname and jenkins_gitemail
Jenkins is consuming git user and email from jenkinsuser
parameters. But these parameters are not exposed on
OpenStack manifests.
Update all the manifests where it's relevant to send
that git username and email, either to jenkins slaves
or to static servers where jenkinsuser is needed.

Change-Id: I4e2b94b1220f88288401f9106721bc4df7fe9125
2015-04-07 20:21:41 +02:00
Jeremy Stanley
314c56b3d8 Stop building py3k-precise nodes
The special py3k-precise nodes are no longer needed by any jobs, so
stop building them and clean up any custom Puppet related to them.

Change-Id: I40d5d09f28ef53583d239d2e852e9c50b5962cf8
Depends-On: Ie105674833e0a527f990a7448855a1090f5dc651
2015-01-30 17:33:40 +00:00
Monty Taylor
b4b5724a0b Add AFS
I don't really think this needs any further explanation.

Change-Id: I41378bd320c6c6fad2c981d5cc773486af075c41
2014-10-20 15:13:14 -05:00
Clark Boylan
8ebf38cd29 Allow puppet to be automatically upgraded
Since the puppet 3 release puppet versions are semver and we should be
able to rely on minor version releases not breaking the world. To get
security updates and the like allow puppet to be automatically upgraded.
Do this by setting an additional origin for the puppetlabs apt repo in
our unattended upgrades template.

Change-Id: I6224ef68aeb891431661f3afc553c4c3433e583a
2014-09-12 12:55:31 -07:00
Monty Taylor
e8fee5ca6d Remove old salt references from the puppet
Now that salt has been removed, remove the puppet module ensure
absent support.

This should be landed after puppet has been run after the previous patch has been landed.

Change-Id: I17a8caf19fd78b47d3c4683092aab76564497e05
2014-07-05 11:36:52 -07:00
Monty Taylor
0fb121893d Remove salt
We don't really use the salt infrastructure that we set up, which means
it's cruft. Go ahead and admit that we don't use it and remove it from
our systems.

Change-Id: Ic43695719cbad30aded16ac480deb3dfd9b2a110
2014-07-04 21:44:44 -07:00
Monty Taylor
5edaf90e60 Put the mirror config into slave_common
slave.pp is skipped for single-use slaves. Put the base mirror config
into slave_common so that it'll get picked up.

Change-Id: I4bff37ecab78264207e83eb237798ed320dfdab7
2014-07-01 10:44:37 -07:00
Monty Taylor
d291355275 Make select-mirror use the bandersnatch mirror
A simple next step is to have select-mirror just default everything
to the same thing.

Change-Id: I9882167596de0791eda86397510e2a942848f5c5
2014-06-30 15:24:50 -07:00
K Jonathan Harker
8e7f9e3458 Move openstack-specific config out of ::jenkins
The ::jenkins::slave class contained a lot of openstack-specific
configuration rather than configuration of a generic jenkins slave.

The term "bare slave" is overloaded and confusing: create simple_slave
and thick_slave to differentiate between the two meanings of "bare".
Some portions of ::jenkins::slave will move to simple_slave, some
portions to thick_slave, and some portions to slave_common (all in the
openstack_project module).

Change-Id: I5281a03a7f6da3f98714bcc59ae840ace8435578
2014-05-20 14:39:51 -07:00
Jeremy Stanley
a6202f901b Add saltstack APT repository to automatic upgrades
* modules/openstack_project/manifests/automatic_upgrades.pp: Pass
the additional allowed origins list through to the unattended
upgrades module.

* modules/openstack_project/manifests/slave.pp: Add the
"LP-PPA-saltstack-salt precise" repository origin to the list of
allowed origins for automatic upgrades.

* modules/unattended_upgrades/manifests/init.pp: Add a list of
additional allowed origins for package repository upgrades and
convert the apt-preferences stub for 50unattended-upgrades to a
template so the list can be applied to it.

* modules/unattended_upgrades/templates/50unattended-upgrades.erb:
Renamed from ../../files/50unattended-upgrades and enhanced with a
loop over the origins list to append to the default set of allowed
upgrade origins.

Change-Id: I821d199ae1a00ed78c2a52bf80ddba8a4eaa7d8b
2013-09-12 17:12:18 +00:00
Alex Gaynor
32db246dd3 Add support for running tox with PyPy and use it for Marconi
This works by installing PyPy from the Ubuntu PPA, and then invoking
`tox -e pypy` (similar to all the other Python buidlers). PyPy shares
nodes with the Python3 builders.

Change-Id: Ibf683c1995b0f5c04c93c56010befb222b386d7a
2013-08-27 13:44:10 -07:00
Dan Prince
d74cca4082 Add python3 option to jenkins::slave.
Adds a new python3 option to our jenkins slave manifest which
can be used to enable using python3-pip when installing
*key* pip packages for unit testing (tox, setuptools-git).

Also, updates openstack_project::slave so that it supports the option
as well.

Change-Id: I5face30b09e3e8d2f70b4da83481f4f8bd33fc51
Reviewed-on: https://review.openstack.org/32452
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Elizabeth Krumbach Joseph <lyz@princessleia.com>
Approved: Clark Boylan <clark.boylan@gmail.com>
Tested-by: Jenkins
2013-06-24 21:56:50 +00:00
James E. Blair
00d9391958 Add jenkins dev slaves.
Allow them to use an ssh key distinct from production.
Clean up unused slave classes.
Use dedicated keys on dev slaves (do this in prod in the future, but it's a
breaking change).
Add a dev_slave_template class for devstack-gate to use.
Remove devstack-gate deps from jenkins master (they're on devstack-launch
now).
Clean up unneeded remove statements for glance creds.
Tidy up some permissions on files where they weren't specified before.

Change-Id: I02cef1ee3951c5780084118073770521bebb9eda
Reviewed-on: https://review.openstack.org/29319
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Clark Boylan <clark.boylan@gmail.com>
Tested-by: Jenkins
2013-05-20 17:34:27 +00:00
Dan Prince
36aefd0c48 Split out tmp clean and auto upgrades.
Create abstractions for tmpcleanup and automatic_upgrades
which can be used to install/include distro specific
modules modules for these features.

On Ubuntu this will still install unattended_upgrades and tmpreaper.

On RHEL we need to implement similar functionality and modules.

Change-Id: I9209610582e23c86dccb5e70691bb598dad36950
Reviewed-on: https://review.openstack.org/23197
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2013-03-04 17:58:03 +00:00
James E. Blair
64494b078a Add a dedicated slave to launch devstack nodes.
So that we can take this load off of the jenkins master.

Change-Id: Id66efede75fab9977013e69f3415a53dc239b0ce
Reviewed-on: https://review.openstack.org/22379
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2013-02-20 17:43:23 +00:00
Matthew Wagoner
f31a426c65 Cleanup openstack_project manifest lint errors.
Now with extra unwrap!

Change-Id: I7c622ffa77821f33f911793fc6b6cdaaba37904a
Reviewed-on: https://review.openstack.org/15052
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2012-11-21 17:48:11 +00:00
Clark Boylan
002c77b547 Install salt master and add minions.
Install a salt master on the puppetmaster node and turn permanent
jenkins slaves into salt minions.

Change-Id: Ib7cba747ee545481a4d97d78ce6009cf5bb2374d
Reviewed-on: https://review.openstack.org/14303
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-10-23 16:48:15 +00:00
Clark Boylan
94a7768dc3 Pass sysadmins list into node defs.
Pass the sysadmins list into each node definition. This allows us to
retrieve the data from hiera rather than hard coding it in the puppet
manifests. Also, update test script to use bogus sysadmin data when
testing.

Change-Id: Ide3560f16bce4d66fb95cc5021fc879476e6a712
Reviewed-on: https://review.openstack.org/12512
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-09-10 15:58:27 +00:00
Monty Taylor
39fc1d5072 A few puppetmaster migration errors.
Change-Id: Ibcc8456da4d3fa3beb94173e571a5da071b6fa15
Reviewed-on: https://review.openstack.org/11628
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-19 18:25:04 +00:00
Monty Taylor
f6ae3e6b7b Use puppetmaster for slaves.
Use puppet agent --test for puppet cron.

We don't need the private ssh or gpg key on the slaves anymore.
We do need the glance testing stuff, so stick that into hiera.

Change-Id: If94fc3f150bf569efe9461f80d3565f9825eebce
Reviewed-on: https://review.openstack.org/10851
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-19 18:02:37 +00:00
Monty Taylor
e35a6e7c73 Aggregate jenkins modules into one module.
Put jenkins_master into jenkins::master and jenkins_job_builder into
jenkins::job_builder and jenkins_slave into jenkins::slave.

Change-Id: Icb0e3071894730c17d8f36f49e9d34979d9c568e
Reviewed-on: https://review.openstack.org/11249
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-12 18:22:26 +00:00
Monty Taylor
be854cd76a Revert "Aggregate jenkins modules into one module."
This reverts commit 222f983fabfbf05f8aa074af90d60d7587acddfa

Change-Id: Iebc5744c5342a19aafdf24ea64e0b98812464ef4
Reviewed-on: https://review.openstack.org/11247
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-12 18:12:03 +00:00
Monty Taylor
222f983fab Aggregate jenkins modules into one module.
Put jenkins_master into jenkins::master and jenkins_job_builder into
jenkins::job_builder and jenkins_slave into jenkins::slave.

Change-Id: I2a1d242ecab0e765ab1b1556bbebd2db8f632888
Reviewed-on: https://review.openstack.org/10842
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-12 18:03:58 +00:00
Monty Taylor
fd2f6b4944 Replace use of local apt module with upstream.
Change-Id: Idcf8af9712f8d10b50cfffc0aa74f7caa1a24c77
Reviewed-on: https://review.openstack.org/10833
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 07:10:43 +00:00
Monty Taylor
b2bbd47eef Include openstack_project class to access members.
Change-Id: I4d04bd6cc248ff6b724a42fe872afadc080bb126
2012-07-23 19:22:19 -05:00
Monty Taylor
0059cdd0e5 Fix some puppetmaster gotchas.
Need /usr/bin/test.
Rename openstack_project::jenkins_slave to openstack_project::slave to
deal with scoping issues.

Change-Id: Ia703cdd0407eef4afe4c6cf07263150699cc47c9
2012-07-23 18:05:35 -05:00