638 Commits

Author SHA1 Message Date
Monty Taylor
aa8030e651 Don't re-install pip from pip every run.
I think having a recent pip is fine. If we run in to problems, we can go back,
but I think we're mainly just wasting effort here.

Change-Id: Ic5f2d49b2002393e1f9b048472266c0a00225110
Reviewed-on: https://review.openstack.org/10963
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 18:13:40 +00:00
Monty Taylor
839348cad3 Don't try to include sources for jenkins apt repo.
Change-Id: Iaa53dc84c5ab6e17b6155c0c0f1c4c12ea276959
Reviewed-on: https://review.openstack.org/10983
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 18:05:52 +00:00
James E. Blair
a52452397a Switch "queue" to "pipeline" in zuul.
Change-Id: I02064d3c49135e41ba19be3790e6f3e695dd5b32
Reviewed-on: https://review.openstack.org/10982
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-07 17:55:01 +00:00
Monty Taylor
4aa77df2e5 Fix jenkins loop and zuul vcsrepo.
Change-Id: I83cf1303bb07e59b0c3305a2540f048638940372
Reviewed-on: https://review.openstack.org/10979
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 17:19:36 +00:00
James E. Blair
d28dd5286e Change 20 min timeouts to 30.
Also, remove ansi color setting, because it really munged up the
output when it was used.

Change-Id: Id0dac3bfbc40987b98501ced7d1158f1a83a1e02
Reviewed-on: https://review.openstack.org/10968
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 15:30:13 +00:00
Monty Taylor
7e179fa012 Remove unneeded origin/ prefix.
Change-Id: If38227a8f2bf5890f59bc4050f71d400447771b7
Reviewed-on: https://review.openstack.org/10957
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 13:44:56 +00:00
Clark Boylan
b506753e70 Fix a typo in openstack_project::base.
The conditional to realize users was triggered by install_useres instead
of install_users so things didn't quite work properly. Correct that
issue.

Change-Id: I84ff3e0116a9b4de07cb649b81574b813aaea578
Reviewed-on: https://review.openstack.org/10935
Reviewed-by: linuxjedi <andrew@linuxjedi.co.uk>
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 12:41:46 +00:00
Monty Taylor
fd2f6b4944 Replace use of local apt module with upstream.
Change-Id: Idcf8af9712f8d10b50cfffc0aa74f7caa1a24c77
Reviewed-on: https://review.openstack.org/10833
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 07:10:43 +00:00
Monty Taylor
246566d65e Replace manual git work with vcsrepo module.
Change-Id: Ia0f3acd50aab07cc83d13cd12c8f7fc67f1c697d
Reviewed-on: https://review.openstack.org/10832
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 07:09:43 +00:00
Monty Taylor
085d70d77e Fix gerritbot init status checking.
The logic is lifted from apache, but changed to use ps instead of pidof,
since gerritbot runs as a python program, so pidof doesn't work.

Change-Id: I504e3534b55dfc27b09d7f044169b2f3a18dcd36
Reviewed-on: https://review.openstack.org/10881
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 06:56:18 +00:00
Monty Taylor
993f7c5f78 Rename backup to bup.
Naming it after what it installs. Also, split the target cronjob into
a define.

Change-Id: I73a4383f529c60bc35c60241dfc91508965d755e
Reviewed-on: https://review.openstack.org/10885
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 06:19:37 +00:00
Monty Taylor
337a07dbbd Removed unused drizzle_user file.
Change-Id: I4c6dc32ee4dcad5db5eb91deace61fffa1f57638
Reviewed-on: https://review.openstack.org/10904
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-07 06:09:41 +00:00
Monty Taylor
efe7d5ac02 Add openstack/requirements.
Change-Id: Ic1a244ab0c851f4dfa5e43c2a6ca5b03fc3b4216
Reviewed-on: https://review.openstack.org/10923
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-06 23:25:56 +00:00
James E. Blair
ecb9e6c816 Add timestamps/ansicolor to alll non-maven jobs.
(Untested with maven.)

Change-Id: I5d66b15afad5d1d50be83d00b4f81a50ccd10f98
Reviewed-on: https://review.openstack.org/10921
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-06 23:20:46 +00:00
Clark Boylan
373f45f844 Add jobs to publish gerritbot tarballs/to pypi.
Gerritbot should be installable via pip. To make this possible add
jobs to publish gerritbot tarballs and push gerritbot to pypi when tags
are added to gerritbot.

Change-Id: I5de346cd96a096809c9fe44d2117ebdb45a180c4
Reviewed-on: https://review.openstack.org/10910
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-06 23:11:08 +00:00
Monty Taylor
d3e5dffa48 Jenkins needs the origin/ prefix to run bitrot.
Change-Id: I89712c58efc64ac089251f0dd42cdd0cc9e2b04b
Reviewed-on: https://review.openstack.org/10880
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-06 17:43:37 +00:00
Monty Taylor
b6ef2cee21 Enable plugin sync for puppet.conf.
pluginsync = true is required for puppetmaster to serve out plugin information,
such as custom facter lib stuff to the agents.

Change-Id: Ia6a72bc6abdaba62ddc5f5e8ceeeb652284f98d3
Reviewed-on: https://review.openstack.org/10850
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-05 16:53:11 +00:00
Monty Taylor
6b20654720 Remove reference to non-existent group.
Change-Id: I2965c548fb51f7235faa02b8808b8b36f31ded7c
Reviewed-on: https://review.openstack.org/10829
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-04 13:15:30 +00:00
James E. Blair
cf9ee4c23f Add jenkins-job-builder project.
Change-Id: I0389b92a0621ab276a91f00f7352986fee27e42d
Reviewed-on: https://review.openstack.org/10808
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-03 23:38:38 +00:00
Monty Taylor
f774c793ba Add in final two steps for initial install.
With these applied, initial install actually works 100% through.

Change-Id: I6587a537beb5703bf11783f3df79278ea1c7aca5
Reviewed-on: https://review.openstack.org/10718
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-03 23:14:26 +00:00
Monty Taylor
5fdfa26704 Add zuul.conf.
Add a templated zuul.conf with apikey filled in by hiera.
Made an openstack_project::zuul class to encapsulate installation
and config of zuul with our config files.

Change-Id: Idc09819b27672879b74b90bdbf699b07aa416a2a
Reviewed-on: https://review.openstack.org/10460
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-03 23:14:01 +00:00
Monty Taylor
e63619e980 Make gitweb a boolean option.
Change-Id: Iff55f35c0d9888f1029115c17d4644a68d4e8b4c
Reviewed-on: https://review.openstack.org/10727
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-08-03 23:12:38 +00:00
James E. Blair
9450c735a2 Set timeouts for all jobs.
Mostly set to 20 minutes to start.  A few with different values.

Change-Id: If388f2281dd49caed391748bdb9ec8090cc29380
2012-08-03 09:44:30 -07:00
James E. Blair
d6eaa493bd Add periodic bitrot check jobs.
Add jobs that run daily to make sure stable branches still pass
tests.  Added as a template that can be added to any project
and any branch.

Change-Id: I90c2bab2afd8e1ad7077f3473504069b0dad9876
2012-08-03 09:31:12 -07:00
James E. Blair
856ca2b2e8 Use oneiric for stable/diablo.
For all python27 jobs, use oneiric slaves if the branch is
stable/diablo.  Python26 jobs are already on oneiric due to
lack of python 2.6 on anything later.

Change-Id: Id440e14721ccdd4225c5e5b170510c3c000a36b3
2012-08-02 13:04:00 -07:00
Monty Taylor
ec58d088fb Add openstack_project::server back.
Change-Id: I2167ef83d1b27677889f2d2f5833fab175f22549
2012-08-02 12:26:30 -05:00
Jenkins
1f21e19d54 Merge "Add script for jenkins slave bootstrap." 2012-08-02 17:01:16 +00:00
James E. Blair
537d67a834 Fix zuul-docs being disabled.
Change-Id: I3c314ac41748be0443390e29c4e7fb89bae1e022
2012-08-02 09:29:16 -07:00
Monty Taylor
126aaf94b9 Add script for jenkins slave bootstrap.
Change-Id: I7e94193bc81c3caabd77ca112952a98f15f3c434
2012-08-02 11:08:16 -05:00
Monty Taylor
892a620737 Have apache honor replicate_local.
Change-Id: I44538a151afda2086469d0309b8113be0a477f93
2012-08-02 10:55:08 -05:00
Monty Taylor
383c023b15 Add support for initial project creation.
If replicate_local is set, this will ensure that /var/lib/git is created,
and that projects listed in the projects.config have repos there.

Additionally, it creates a new config file, projects.config which is a
yaml file listing all of the projects and various operational semantics about
them, such as whether or not they should have pull requests closed and whether
or not they track any remotes. This replaces remotes.config and github.config.

Moving forward, there is no reason to not have this script be able to
do github api calls to create the github repo if it's not there, set the
github project description, gerrit api calls to create the project in gerrit,
and initial project permissions templates.

Change-Id: I1ad803b0aa5f7386206d0c3f4cd858017242fe64
2012-08-02 15:49:02 +00:00
Jenkins
ff362d81a7 Merge "Set some parameters to more sensible defaults." 2012-08-02 15:39:47 +00:00
Jenkins
224264bedf Merge "Added an option to toggle replication choices." 2012-08-02 15:39:32 +00:00
Clark Boylan
2ba9ba7a4d Switch zuul to jenkins python jobs template.
Switch zuul jenkins jobs config to use the python jobs template. The
gate-zuul-pyflakes job has been kept though. Add zuul-docs job as well.
Configure the zuul layout to gate zuul on python26 and python27 jobs.
Also configured to run the zuul-coverage job and zuul-docs job post
merge.

Change-Id: Ib3500c361bca0e2c35fa9552b0aa98468d2f040f
2012-08-01 10:03:28 -07:00
Monty Taylor
ef3881d487 Set some parameters to more sensible defaults.
Also, moved depends for launchpad sync script to the launchpad sync
module, and put the ntp stuff into an ntp module.

Change-Id: I2568752493fefa305f9108a23da101d80a311552
2012-07-29 13:04:17 -05:00
Monty Taylor
0b921968d1 Added an option to toggle replication choices.
New options for github replication and local replication.

Change-Id: I06a6ca5347232ec80e26f6116742ab0007435ffe
2012-07-29 13:04:17 -05:00
Monty Taylor
d20c4523bf Broke launchpad user sync into its own class.
Additionally, the file installation of the scripts wasn't working,
so the sync script wasn't actually getting installed. This moves
the underlying scripts to be installed by the gerrit module,
because it owns /usr/local/gerrit/scripts, and then manages the
gerrit hooks which call those scripts in the openstack_project
class, since that's where the config choice to enable those
functions really should live.

Change-Id: I54fb9edd9fb0c634d8d9de4e57f9ddad6af63a99
2012-07-29 13:04:17 -05:00
Jenkins
ad9859efd6 Merge "Remove uses of remove_cron." 2012-07-29 12:49:56 +00:00
Jenkins
3a1eaf9365 Merge "Add support for puppet dashboard." 2012-07-29 12:49:26 +00:00
Monty Taylor
279b406a4b Add natty entry for java_home.
Change-Id: I0c2605c7dfd2ccff3d966ee4e4e8067a91eb1b98
2012-07-28 10:54:35 -05:00
Monty Taylor
46282d44c1 Fixed a template typo.
Variable interpolation needs <%= not just <%. :)

Also, while I was in there, I replaced default with "oneiric",
because I don't actually know that the value is a good default value,
and I removed a couple of comments about moving to MySQL and Apache
modules from upstream.

Change-Id: Iec5b10cee2cbd0e0a2573fefa707d34d2a363cb4
2012-07-28 10:04:43 -05:00
Jenkins
a2a516e914 Merge "Fix the zuul reloading on config changes." 2012-07-28 14:04:16 +00:00
Jenkins
d73d32a8f7 Merge "Modified gerrit to use MySQL and Apache modules." 2012-07-28 13:44:04 +00:00
Clark Boylan
81e77fc27a Fix the zuul reloading on config changes.
Zuul config files were broken out into a new module which introduced
cross module subscription dependencies. To make this work the module
doing the notify/subscribe must include the module the resource that
the subscription/notify is on. To fix this have config files notify
the zuul_reload exec.

Change-Id: I2d9e2236bc378d9dd92f811830dee6540b4cf4e2
2012-07-27 17:10:46 -07:00
Jenkins
ff1a2f5691 Merge "Gate Horizon on Selenium tests." 2012-07-27 22:23:11 +00:00
Monty Taylor
67ef0a4aa8 Remove uses of remove_cron.
Change-Id: Id95228ae662880176b54903ffbcb196fbead992f
2012-07-27 13:12:16 -05:00
Monty Taylor
5fb75ec390 Add support for puppet dashboard.
Change-Id: Ia63c0af6724f95417910215a82abaadd53ba0b49
2012-07-27 12:51:31 -05:00
Monty Taylor
c510a30e1e Modified gerrit to use MySQL and Apache modules.
Change-Id: I82ff3c46438f8db126fa6a881efa09c90b1906e4
2012-07-27 17:37:37 +00:00
Clark Boylan
1d65e2dc3c Run jenkins jobs script only after config update.
Previously the jenkins job script was run against Jenkins during each
Puppet run. Now run the jenkins job script only if any of the job
configs or jenkins job configs change.

Change-Id: I12d6dcf56ae46de7b5f373f2e4df6214c0f59c79
2012-07-27 10:33:54 -07:00
Monty Taylor
98a0e386cd Fix a typo.
Change-Id: Ibe21c15f30371879880f4de288367099fc8752a6
2012-07-27 10:20:24 -05:00