652 Commits

Author SHA1 Message Date
James E. Blair
f36e38f697 Remove jenkins_jobs, add jenkins_job_builder.
Change-Id: I774b08719297979c0079c37679c3face3788e111
Reviewed-on: https://review.openstack.org/11151
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-10 16:03:40 +00:00
Monty Taylor
6c763db08e Fix two typos.
Change-Id: I6b02a28b8dd658425b39bf7f5fb858efbb9023d7
Reviewed-on: https://review.openstack.org/11146
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-10 14:46:31 +00:00
James E. Blair
42dc2ac848 Change the name of the pypi tarball job.
The pypi_jobs template defines a -tarball job which is different
than the -tarball job in python_jobs template.  That's confusing,
and not supported by the version of job-builder in development.

This changes the name of that job, updates the zuul layout, and
removes the "upload" from the sdist command in the tarball job,
which wasn't working anyway (and isn't wanted).

This alse enables the reddwarf jobs, which are configured in zuul.

Also, there's a hackish change to test.sh and the test output
to write out xml files in a way that's compatible with the
version of job-builder in development, so that they may be
directly compared.  The new version will not implement that
in quite such a hackish way.

Change-Id: Ice3f03b41e44e2979942f516febd059f4ab4cefa
Reviewed-on: https://review.openstack.org/11108
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-10 14:45:06 +00:00
Monty Taylor
5ec9629e56 Re-write of mirror script to read projects.yaml.
Change-Id: I810324b4d1648e79a71f1940196b6522833a1671
Reviewed-on: https://review.openstack.org/11112
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-10 14:34:03 +00:00
Monty Taylor
e5c9deed11 Add in a parameter to help non-us devstack-gate.
Change-Id: Ia0b5c80c479f8acd5cc1e0dc0a4515d88e6b5db8
Reviewed-on: https://review.openstack.org/11091
Reviewed-by: Devananda van der Veen <devananda.vdv@gmail.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-10 14:33:50 +00:00
Monty Taylor
d10c011a03 Add a requirement on server install.
Change-Id: Ifc51229a8df1a7024ee89ca8b1b0c85f38ff90d4
Reviewed-on: https://review.openstack.org/11076
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-10 14:33:36 +00:00
Monty Taylor
339f4e115f Use account_security to remove bogus accounts.
Change-Id: I20aa549cf87f24d13d302fc219df84727c9fba10
Reviewed-on: https://review.openstack.org/11041
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-10 14:33:17 +00:00
James E. Blair
c8af1ffc11 Add new infra projects to gerribot channel config.
Change-Id: Idfd581724daee805608f3ffd729720a6860cc6fa
Reviewed-on: https://review.openstack.org/11001
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-09 13:34:01 +00:00
James E. Blair
a511ad1a82 Increase text contrast.
Change the text color to black to increase the contrast and improve
legibility.

Change-Id: I641c30904184711c239741076a549e0d2b4761c7
Reviewed-on: https://review.openstack.org/10285
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: linuxjedi <andrew@linuxjedi.co.uk>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-09 13:24:59 +00:00
Monty Taylor
fb8315bc3a Use puppetlabs-mysql module.
Change-Id: I09126a1bc2e27199bac35729b5d5ecd349c535ef
Reviewed-on: https://review.openstack.org/10231
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-08 16:36:18 +00:00
Monty Taylor
9d285579f4 Trimmed the slave dep list a bit.
Change-Id: I13d70dc726399d351784dbe1339f10a804bd609a
Reviewed-on: https://review.openstack.org/10844
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-08 13:32:41 +00:00
Monty Taylor
1c7c567f5a Install git from git-core ppa for oneiric.
Fixes 1034130.

Oneiric git is very slow with precise due to a version mismatch madness.

Change-Id: I2eb54848cd671e091879dd2f6a57f32a2ac6405b
Reviewed-on: https://review.openstack.org/10843
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-08 13:32:07 +00:00
James E. Blair
2f0c6fe10f Remove junit post-build action.
Addresses bug 1034130.

Change-Id: I4ad0907fca32ab12f33f65a5de4783854e15c522
Reviewed-on: https://review.openstack.org/10991
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-07 20:39:02 +00:00
Monty Taylor
4450b86d1f Don't create database every run.
Change-Id: I524cab78b4f17a60ea7fdc3fd2a6af2ca82ebb51
Reviewed-on: https://review.openstack.org/10964
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 18:13:58 +00:00
Monty Taylor
aa8030e651 Don't re-install pip from pip every run.
I think having a recent pip is fine. If we run in to problems, we can go back,
but I think we're mainly just wasting effort here.

Change-Id: Ic5f2d49b2002393e1f9b048472266c0a00225110
Reviewed-on: https://review.openstack.org/10963
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 18:13:40 +00:00
Monty Taylor
839348cad3 Don't try to include sources for jenkins apt repo.
Change-Id: Iaa53dc84c5ab6e17b6155c0c0f1c4c12ea276959
Reviewed-on: https://review.openstack.org/10983
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 18:05:52 +00:00
James E. Blair
a52452397a Switch "queue" to "pipeline" in zuul.
Change-Id: I02064d3c49135e41ba19be3790e6f3e695dd5b32
Reviewed-on: https://review.openstack.org/10982
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-07 17:55:01 +00:00
Monty Taylor
4aa77df2e5 Fix jenkins loop and zuul vcsrepo.
Change-Id: I83cf1303bb07e59b0c3305a2540f048638940372
Reviewed-on: https://review.openstack.org/10979
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 17:19:36 +00:00
James E. Blair
d28dd5286e Change 20 min timeouts to 30.
Also, remove ansi color setting, because it really munged up the
output when it was used.

Change-Id: Id0dac3bfbc40987b98501ced7d1158f1a83a1e02
Reviewed-on: https://review.openstack.org/10968
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 15:30:13 +00:00
Monty Taylor
7e179fa012 Remove unneeded origin/ prefix.
Change-Id: If38227a8f2bf5890f59bc4050f71d400447771b7
Reviewed-on: https://review.openstack.org/10957
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 13:44:56 +00:00
Clark Boylan
b506753e70 Fix a typo in openstack_project::base.
The conditional to realize users was triggered by install_useres instead
of install_users so things didn't quite work properly. Correct that
issue.

Change-Id: I84ff3e0116a9b4de07cb649b81574b813aaea578
Reviewed-on: https://review.openstack.org/10935
Reviewed-by: linuxjedi <andrew@linuxjedi.co.uk>
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 12:41:46 +00:00
Monty Taylor
fd2f6b4944 Replace use of local apt module with upstream.
Change-Id: Idcf8af9712f8d10b50cfffc0aa74f7caa1a24c77
Reviewed-on: https://review.openstack.org/10833
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 07:10:43 +00:00
Monty Taylor
246566d65e Replace manual git work with vcsrepo module.
Change-Id: Ia0f3acd50aab07cc83d13cd12c8f7fc67f1c697d
Reviewed-on: https://review.openstack.org/10832
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 07:09:43 +00:00
Monty Taylor
085d70d77e Fix gerritbot init status checking.
The logic is lifted from apache, but changed to use ps instead of pidof,
since gerritbot runs as a python program, so pidof doesn't work.

Change-Id: I504e3534b55dfc27b09d7f044169b2f3a18dcd36
Reviewed-on: https://review.openstack.org/10881
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 06:56:18 +00:00
Monty Taylor
993f7c5f78 Rename backup to bup.
Naming it after what it installs. Also, split the target cronjob into
a define.

Change-Id: I73a4383f529c60bc35c60241dfc91508965d755e
Reviewed-on: https://review.openstack.org/10885
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 06:19:37 +00:00
Monty Taylor
337a07dbbd Removed unused drizzle_user file.
Change-Id: I4c6dc32ee4dcad5db5eb91deace61fffa1f57638
Reviewed-on: https://review.openstack.org/10904
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 06:09:41 +00:00
Monty Taylor
efe7d5ac02 Add openstack/requirements.
Change-Id: Ic1a244ab0c851f4dfa5e43c2a6ca5b03fc3b4216
Reviewed-on: https://review.openstack.org/10923
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-06 23:25:56 +00:00
James E. Blair
ecb9e6c816 Add timestamps/ansicolor to alll non-maven jobs.
(Untested with maven.)

Change-Id: I5d66b15afad5d1d50be83d00b4f81a50ccd10f98
Reviewed-on: https://review.openstack.org/10921
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-06 23:20:46 +00:00
Clark Boylan
373f45f844 Add jobs to publish gerritbot tarballs/to pypi.
Gerritbot should be installable via pip. To make this possible add
jobs to publish gerritbot tarballs and push gerritbot to pypi when tags
are added to gerritbot.

Change-Id: I5de346cd96a096809c9fe44d2117ebdb45a180c4
Reviewed-on: https://review.openstack.org/10910
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-06 23:11:08 +00:00
Monty Taylor
d3e5dffa48 Jenkins needs the origin/ prefix to run bitrot.
Change-Id: I89712c58efc64ac089251f0dd42cdd0cc9e2b04b
Reviewed-on: https://review.openstack.org/10880
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-06 17:43:37 +00:00
Monty Taylor
b6ef2cee21 Enable plugin sync for puppet.conf.
pluginsync = true is required for puppetmaster to serve out plugin information,
such as custom facter lib stuff to the agents.

Change-Id: Ia6a72bc6abdaba62ddc5f5e8ceeeb652284f98d3
Reviewed-on: https://review.openstack.org/10850
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-05 16:53:11 +00:00
Monty Taylor
6b20654720 Remove reference to non-existent group.
Change-Id: I2965c548fb51f7235faa02b8808b8b36f31ded7c
Reviewed-on: https://review.openstack.org/10829
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-04 13:15:30 +00:00
James E. Blair
cf9ee4c23f Add jenkins-job-builder project.
Change-Id: I0389b92a0621ab276a91f00f7352986fee27e42d
Reviewed-on: https://review.openstack.org/10808
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-03 23:38:38 +00:00
Monty Taylor
f774c793ba Add in final two steps for initial install.
With these applied, initial install actually works 100% through.

Change-Id: I6587a537beb5703bf11783f3df79278ea1c7aca5
Reviewed-on: https://review.openstack.org/10718
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-03 23:14:26 +00:00
Monty Taylor
5fdfa26704 Add zuul.conf.
Add a templated zuul.conf with apikey filled in by hiera.
Made an openstack_project::zuul class to encapsulate installation
and config of zuul with our config files.

Change-Id: Idc09819b27672879b74b90bdbf699b07aa416a2a
Reviewed-on: https://review.openstack.org/10460
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-03 23:14:01 +00:00
Monty Taylor
e63619e980 Make gitweb a boolean option.
Change-Id: Iff55f35c0d9888f1029115c17d4644a68d4e8b4c
Reviewed-on: https://review.openstack.org/10727
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-03 23:12:38 +00:00
James E. Blair
9450c735a2 Set timeouts for all jobs.
Mostly set to 20 minutes to start.  A few with different values.

Change-Id: If388f2281dd49caed391748bdb9ec8090cc29380
2012-08-03 09:44:30 -07:00
James E. Blair
d6eaa493bd Add periodic bitrot check jobs.
Add jobs that run daily to make sure stable branches still pass
tests.  Added as a template that can be added to any project
and any branch.

Change-Id: I90c2bab2afd8e1ad7077f3473504069b0dad9876
2012-08-03 09:31:12 -07:00
James E. Blair
856ca2b2e8 Use oneiric for stable/diablo.
For all python27 jobs, use oneiric slaves if the branch is
stable/diablo.  Python26 jobs are already on oneiric due to
lack of python 2.6 on anything later.

Change-Id: Id440e14721ccdd4225c5e5b170510c3c000a36b3
2012-08-02 13:04:00 -07:00
Monty Taylor
ec58d088fb Add openstack_project::server back.
Change-Id: I2167ef83d1b27677889f2d2f5833fab175f22549
2012-08-02 12:26:30 -05:00
Jenkins
1f21e19d54 Merge "Add script for jenkins slave bootstrap." 2012-08-02 17:01:16 +00:00
James E. Blair
537d67a834 Fix zuul-docs being disabled.
Change-Id: I3c314ac41748be0443390e29c4e7fb89bae1e022
2012-08-02 09:29:16 -07:00
Monty Taylor
126aaf94b9 Add script for jenkins slave bootstrap.
Change-Id: I7e94193bc81c3caabd77ca112952a98f15f3c434
2012-08-02 11:08:16 -05:00
Monty Taylor
892a620737 Have apache honor replicate_local.
Change-Id: I44538a151afda2086469d0309b8113be0a477f93
2012-08-02 10:55:08 -05:00
Monty Taylor
383c023b15 Add support for initial project creation.
If replicate_local is set, this will ensure that /var/lib/git is created,
and that projects listed in the projects.config have repos there.

Additionally, it creates a new config file, projects.config which is a
yaml file listing all of the projects and various operational semantics about
them, such as whether or not they should have pull requests closed and whether
or not they track any remotes. This replaces remotes.config and github.config.

Moving forward, there is no reason to not have this script be able to
do github api calls to create the github repo if it's not there, set the
github project description, gerrit api calls to create the project in gerrit,
and initial project permissions templates.

Change-Id: I1ad803b0aa5f7386206d0c3f4cd858017242fe64
2012-08-02 15:49:02 +00:00
Jenkins
ff362d81a7 Merge "Set some parameters to more sensible defaults." 2012-08-02 15:39:47 +00:00
Jenkins
224264bedf Merge "Added an option to toggle replication choices." 2012-08-02 15:39:32 +00:00
Clark Boylan
2ba9ba7a4d Switch zuul to jenkins python jobs template.
Switch zuul jenkins jobs config to use the python jobs template. The
gate-zuul-pyflakes job has been kept though. Add zuul-docs job as well.
Configure the zuul layout to gate zuul on python26 and python27 jobs.
Also configured to run the zuul-coverage job and zuul-docs job post
merge.

Change-Id: Ib3500c361bca0e2c35fa9552b0aa98468d2f040f
2012-08-01 10:03:28 -07:00
Monty Taylor
ef3881d487 Set some parameters to more sensible defaults.
Also, moved depends for launchpad sync script to the launchpad sync
module, and put the ntp stuff into an ntp module.

Change-Id: I2568752493fefa305f9108a23da101d80a311552
2012-07-29 13:04:17 -05:00
Monty Taylor
0b921968d1 Added an option to toggle replication choices.
New options for github replication and local replication.

Change-Id: I06a6ca5347232ec80e26f6116742ab0007435ffe
2012-07-29 13:04:17 -05:00