31 Commits

Author SHA1 Message Date
Jeremy Stanley
7f2c8e5bf1 Switch jobs from Ubuntu Quantal to Precise slaves.
All jobs previously using a quantal node label are now using a
precise node label instead. Documentation has also been updated to
reflect the change in preferred release/image name.

Change-Id: I636416a9d9dc6714cd9751e2210882db2cbf786e
Reviewed-on: https://review.openstack.org/28861
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-13 16:57:34 +00:00
Jeremy Stanley
beef21e7a7 Switch jobs from Ubuntu Oneiric to CentOS 6.
Ubuntu Oneiric Ocelot will end of life on May 9, 2013. Jobs which
previously ran on oneiric unit test slaves because of availability
of Python 2.6 now run on centos6 slaves instead.

* .../jenkins_job_builder/config/heat.yaml: The dev-heat-coverage
and dev-python-heatclient-coverage previously now use centos6
slaves.

* .../jenkins_job_builder/config/python-bitrot-jobs.yaml: The
periodic-{name}-python26-{branch-name} template now uses centos6
slaves, and obsolete periodic-{name}-python26-{branch-name}-centos6
template is removed.

* .../jenkins_job_builder/config/python-jobs.yaml: The
gate-{name}-python26 template now uses centos6 slaves, and obsolete
gate-{name}-python26-centos6 template is removed.

* .../zuul/layout.yaml: Stop running the non-voting .*-centos6 jobs
as they're no longer necessary. Also stop running gate-nova-python26
on stable/folsom for now, as it won't be worth the effort to get
running successfully on CentOS at this point.

Change-Id: I29f0d6fca99c130aa9d9c5cfe9dfb0467dd10832
Reviewed-on: https://review.openstack.org/28252
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-09 23:14:32 +00:00
Jeremy Stanley
795cf8657e Switching from RHEL to CentOS.
* .../jenkins_job_builder/config/python-bitrot-jobs.yaml: Add
centos6 bitrot variants of python26 bitrot jobs.

* .../jenkins_job_builder/config/python-jobs.yaml: Switch the node
label and name on python26 rhel6 jobs.

* .../zuul/layout.yaml: Replace python26 rhel6 job variants with the
new centos6 versions, but keep them non-voting still.

Change-Id: I31125b6c4d137591cf98716dbc8950537ad4d45b
Reviewed-on: https://review.openstack.org/27567
Reviewed-by: Dan Prince <dprince@redhat.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: matthew-wagoner <matthew.wagoner@hp.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-04-30 19:02:16 +00:00
James E. Blair
461c876790 Upload all sphinx docs to docs-draft.
Change-Id: Ia17448dfcd8b56b74a7fdba6b5e99493f850b7ae
Reviewed-on: https://review.openstack.org/26551
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2013-04-09 23:50:51 +00:00
Jeremy Stanley
9a368f19cd Move other non-devstack precise jobs to quantal.
All remaining unit tests and builds which previously took place on
persistent precise*.slave.openstack.org servers now run on quantal
servers instead.

Change-Id: Ie4a59eeb7e3895f5d35471377c3bea462c615f50
Reviewed-on: https://review.openstack.org/26084
Reviewed-by: matthew-wagoner <matthew.wagoner@hp.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-04-06 01:28:27 +00:00
Julien Danjou
deaa0361bc Remove Folsom jobs for Ceilometer
Change-Id: Ic0cd002dcd7378c4d04e4b3b264f1b4611d9a5f5
Signed-off-by: Julien Danjou <julien@danjou.info>
Reviewed-on: https://review.openstack.org/26214
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Doug Hellmann <doug.hellmann@dreamhost.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Eoghan Glynn <eglynn@redhat.com>
Approved: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Tested-by: Jenkins
2013-04-05 20:41:51 +00:00
James E. Blair
bc72476375 Add requirements check job.
Initially non-voting, and only runs when requirements files
of openstack/ projects are updated.

Change-Id: I7aa06fb7bda6d2c08cf402167db800827ac24f81
Reviewed-on: https://review.openstack.org/25447
Reviewed-by: Anita Kuno <akuno@lavabit.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2013-03-27 17:12:35 +00:00
Jeremy Stanley
416df31309 Non-voting RHEL6 Python 2.6 unit test checks.
* .../jenkins_job_builder/config/python-jobs.yaml: Add a template
gate-{name}-python26-rhel6 job identical to gate-{name}-python26 but
with a rhel6 node label. Also add it to the python-jobs group.

* .../zuul/layout.yaml: Make gate-{name}-python26-rhel6 non-voting
and go to extra lengths to avoid stable branches earlier than folsom
for now. Add it to all projects calling gate-{name}-python26
directly.

Change-Id: I8da8b27b5b7062e628665533df4e289fa2448ba8
Reviewed-on: https://review.openstack.org/24364
Reviewed-by: Anita Kuno <akuno@lavabit.com>
Reviewed-by: Dan Prince <dprince@redhat.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-03-21 13:34:30 +00:00
James E. Blair
8c6df9f19c Select a pypi mirror before running tox.
Change-Id: I62a86b6a0ad30ff8cb387ddcc05668128248c6d0
Reviewed-on: https://review.openstack.org/23513
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2013-03-18 20:29:07 +00:00
James E. Blair
a76ebf2d42 Add org and project params to run-tox.
These are ignored for now, but the github org will be used in
a subsequent change to determine which pypi mirror to use.

The project parameter may eventually be useful for allowing
special behavior for openstack/requirements, so go ahead and
include it here for completeness.

Change-Id: I31f235df100622ea26420c81404b16f24b05be01
Reviewed-on: https://review.openstack.org/23512
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-03-07 20:46:06 +00:00
Clark Boylan
9c01783dbc Gzip testr result files before archiving.
Gzip testr result files before archiving them to static.o.o as the
subunit log files may be quite large. This will speed jobs up and reduce
the space needed on static.o.o to archive logs.

Change-Id: I3c9570a79c8c348c9b70b7c6a98ba5c207f97825
Reviewed-on: https://review.openstack.org/22636
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-02-24 01:32:04 +00:00
Clark Boylan
cd02e47f93 Increase python unittest timeout to 40 minutes.
The python unittests (particularly python26) have been getting close to
the test timeout and occasionally go over. Increase the test timeout by
10 minutes for a timeout of 40 minutes. This is approximately the length
of time that tempest-devstack-gate-vm tests take to run so should not
increase the runtime for a change in the qate.

Change-Id: Ic2c015ad87968a6885c9bbc82fed5f37b3aee209
Reviewed-on: https://review.openstack.org/22397
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-02-20 04:54:17 +00:00
James E. Blair
3f7dfb5f3c Check for extra files on unit test runs.
After running python unit tests, make sure there are no new
files in the repo that are not listed in .gitignore.  This
includes empty directories.

This will only print the result for now, later we can enforce
this by exiting with failure if there are new files.

Change-Id: I9501c3ee19d5289214976bc5e7cb58edb422e645
Reviewed-on: https://review.openstack.org/19966
Reviewed-by: Maru Newby <mnewby@internap.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-01-18 21:16:45 +00:00
Hengqing Hu
6bc12f6231 Add coverage-log(-post) macros to reduce duplication
Change-Id: I9d54b93ade444880bb79ed799b6b6ea95833be44
Reviewed-on: https://review.openstack.org/19578
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2013-01-15 18:32:29 +00:00
Monty Taylor
bca812d090 Simplify tarball and pypi publishing
Only publish distinct tarballs to tarballs.o.o for tags.
Use tarballs from tarballs.o.o when uploading to pypi instead of rebuilding.
Publish $project-$branch.tar.gz tarballs for every commit.

Change-Id: Ifd2c3b8c9734875ffb15528f84409f44e2f842da
Reviewed-on: https://review.openstack.org/18797
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-01-08 02:16:57 +00:00
Clark Boylan
34cdef195b Copy tmp subunit log if file is present.
Copy .testrepository/tmp* with the scp plugin in python26 and python27
jobs if the file is present. This will give us some information about
which tests ran if testr hangs and is unable to finish within the
Jenkins timeout. If tests successfully run this file should not be
copied as testr deletes it before the plugin will attempt to copy it.

Change-Id: Id3d193094943e44bcf3083487f79a288d309d8c4
Reviewed-on: https://review.openstack.org/18742
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2013-01-03 00:23:09 +00:00
James E. Blair
e04970cc53 Remove merge jobs.
Zuul internally merges or cherry-picks changes before running jobs
and gerrit-git-prep now uses the output of that.  Therefore, merge
jobs are redundant.  However, some projects have no gate tests,
so create a noop job for those projects so Zuul has something to run.
As long as it doesn't actually do anything with a git repo, it can
be shared by all projects.

* Remove definitions of merge jobs in jjb.
* Add a new singleton 'gate-noop' job.
* Remove invocations of -merge jobs in zuul, replacing them
  with -noop jobs if they are the only jobs for a pipeline.
* Update new job documentation to mention gate-noop, and lack
  of need to update projects.yaml if not using python-jobs.

Change-Id: I56d3f0f99b2f05780fc82222854db4f1c8f68b57
Reviewed-on: https://review.openstack.org/18246
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2012-12-17 18:39:50 +00:00
Clark Boylan
abc5b00d63 Capture testr log files when testr is used.
When testr is the test runner that is used capture the subunit stream
log file, convert it to pretty html output and publish both the log and
html file to static.openstack.org.

Change-Id: I0b79e048d25f2a8bc7cca6adf583d788809c7f05
Reviewed-on: https://review.openstack.org/17964
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-12-12 21:51:01 +00:00
Jeremy Stanley
88dfa4e4ae Enable Folsom jobs for Ceilometer.
These jobs were introduced via https://review.openstack.org/16520
and were set to run for openstack/ceilometer on zuul, but were not
added to the ceilometer project and thus did not exist in Jenkins.
The result was all check runs against Ceilometer's commits were
coming back with a status of "LOST" for these two jobs.

* .../jenkins_job_builder/config/projects.yaml: Added
python-jobs-folsom to the ceilometer project.

* .../jenkins_job_builder/config/python-jobs.yaml: Created a
python-jobs-folsom group to allow easier application of
folsom-specific Python jobs to projects. This currently just
contains the gate-{name}-python2[67]-folsom jobs.

Change-Id: I4e397a6a1b787e1c674e356af9c8e099c0b24159
Reviewed-on: https://review.openstack.org/17047
Reviewed-by: Paul Belanger <paul.belanger@polybeacon.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-11-28 16:27:23 +00:00
Julien Danjou
67c9194ec8 Run tests against Folsom for Ceilometer
We want to keep the compatibility with Folsom so we run tests using versions
of our dependencies bound to this version.

Change-Id: Ia7af8207d004cbe809add790d467637e81bfb866
Signed-off-by: Julien Danjou <julien@danjou.info>
Reviewed-on: https://review.openstack.org/16520
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Doug Hellmann <doug.hellmann@dreamhost.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-11-26 21:06:51 +00:00
Clark Boylan
f40847dd78 Kill trailing whitespace.
Killed trailing whitespace in the puppet repo files using
`sed -r 's/\s+$//'`. Skip binary files and html templates for lodgeit
and mailman.

Change-Id: Ib43493161d8f0e8fae1426b22fb1737832ca14cd
Reviewed-on: https://review.openstack.org/12969
Reviewed-by: Paul Belanger <paul.belanger@polybeacon.com>
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-10-05 23:27:31 +00:00
Clark Boylan
7075bbb146 Use console-log scp macro to copy build logs.
Previoulsy we had spelled out that the build logs should be copied when
there were other files to copy in order to avoid multiple SCP
connections. Now, in order to copy the entire console log, we need
multiple SCP connections anyways so go back to using the console-log
macros for simplicity and consistency.

Change-Id: I6e88d08f7eec945b907353ed90ac0d482b7a9c9a
Reviewed-on: https://review.openstack.org/12532
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-09-12 17:11:18 +00:00
James E. Blair
1150793436 Set jenkins job default logrotate to 1 day.
Remove timeout and logrotate sections, except where overriding
defaults.

Change-Id: If65952da0bb59319e9c413349a95b4e7b39eece2
Reviewed-on: https://review.openstack.org/12516
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-09-10 15:28:41 +00:00
James E. Blair
0c6f4af977 Switch to html coverage reports.
Change-Id: Id841726e55bb0c8fb9b6a80648e1e3727b8d5a03
Reviewed-on: https://review.openstack.org/11891
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-24 16:28:26 +00:00
Clark Boylan
63b209e1a0 Output nose html results to nose_results.html.
The **/*results.html glob matched more than just the nose results file
in some cases. Change the nose output file to nose_results.html and the
glob to **/*nose_results.html to be more specific. This should prevent
unwanted files from being copied into the offsite logs.

Change-Id: I3e5b3d140bb0a540d7bdcab84aa70ed324e100da
Reviewed-on: https://review.openstack.org/11804
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-22 16:03:19 +00:00
Clark Boylan
16bb62e795 Find nosetests result.html file in sub dirs.
Some projects run nosetests in a subdir of the workspace directory.
When they do this the results file is output in that sub dir. Find
results.html in these cases when SCPing using the ** glob.

Change-Id: Ic83cc69881aba3c53b027317ab5e525d028bb95e
Reviewed-on: https://review.openstack.org/11774
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-22 00:55:08 +00:00
Clark Boylan
073a93ce31 Enable Nose HTML output on unittest jobs.
Have nose output an HTML results file at the end of unittest builds.
Also copy that results file to static.openstack.org.

Change-Id: I46c487919e09d25eebf2858830bde080a4c8e4f4
Reviewed-on: https://review.openstack.org/11736
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-21 21:10:20 +00:00
James E. Blair
12accf97d9 Use a different path for console logs for post jobs.
Change-Id: I42846e6fa78876115c9dcb236260de50b76329f2
Reviewed-on: https://review.openstack.org/11726
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-21 17:22:36 +00:00
James E. Blair
16288858be Add console log copying to all jobs.
Change-Id: I46156c36b619a098b8a3f9c6d156ef2fae4e2c52
Reviewed-on: https://review.openstack.org/11683
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-21 15:54:26 +00:00
Yun Mao
ea15c64952 Add template for pylint checker in Nova
Change-Id: I90f97a48ddb3fad61f3f6551a7d118e0bb48f178
Reviewed-on: https://review.openstack.org/11498
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-20 18:02:11 +00:00
James E. Blair
2003f3dd5c Collapse projcets into projects.yaml.
Rename yml files to yaml.

Change-Id: Ie87763b05537012e57081ee2b18fff6bca2a00bd
Reviewed-on: https://review.openstack.org/11169
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2012-08-10 18:56:42 +00:00