217 Commits

Author SHA1 Message Date
Jenkins
6e5ef766c5 Merge "Fix horizon-upstream-translation-update" 2014-03-19 18:21:19 +00:00
Andreas Jaeger
4939be236f Fix horizon-upstream-translation-update
Check if there is already a .tx folder and run tx --init only if
there is none. The horizon repo currently has one and thus the job fails
to build.

Change-Id: Ifa3115943c49550f3d72007484e9343f7de1d8ca
2014-03-19 07:20:22 +01:00
Jeremy Stanley
d5436c322e Remove obsolete third argument check from ggp
This was used when transitioning to ZUUL_URL from the calling
environment, and is no longer required by any calls to the script.

Change-Id: Ie3e1740a6cc3d67bd306b5d6c258002d51eaffe8
2014-03-18 16:39:17 +00:00
Davanum Srinivas
618f6bff81 Save md5 and sha1 checksums with artifacts
tarballs.openstack.org seems to be missing checksums

Change-Id: I5653c8bdbbf45aa74d848d28a8e9c38dc5b3fc17
2014-03-16 19:57:15 -04:00
Jenkins
7ccf63861c Merge "Fix manuals translation jobs" 2014-03-14 15:31:21 +00:00
Andreas Jaeger
a77f69cacb Fix manuals translation jobs
Currently the periodic job manuals-propose-translation-update runs
three times on the same repository instead of running once each for
api-site, openstack-manuals and operations-guide.

Also, manuals-upstream-translation-update does not handle the api-site
repo.

* Change the scripts so that they handle all three repositories.
* Update the jenkins configuration to call the scripts with repository name
  as parameter. This needs new job-templates.
* Create a job-group
* Use job-group for each repository.
* Adjust Zuul for new jobs using a template.
* Update manual jobs in zuul to check for just "master" as branch
  instead of using a regex.

Change-Id: I755730ea43ad05a373704ab2fb7e5b55f1c8aeee
Closes-Bug: #1291844
2014-03-14 15:59:39 +01:00
Andreas Jaeger
70fc436c35 Initialize transifex data for openstack-manuals
Maintaining transifix in git causes some problems, we're removing it
now from openstack-manuals and thus need to initialize it here.

The manuals change at https://review.openstack.org/#/c/79859 is waiting
for this to go in.

Change-Id: I1bc1e1ae0f25ce5d88a70cdbab2541c8a52ddd78
2014-03-12 08:34:24 +01:00
Clark Boylan
139f1f0986 Allow jenkins to sudo as any user.
Jenkins needs to sudo as stack and tempest to properly run devstack jobs
and may need to act on behalf of other users in the future. Rather than
listing root,stack,tempest in the sudoer file just let jenkins sudo as
any user.

Fixes-bug: 1290669
Change-Id: I4a5c6b7ead717475d6334a7ef3121271aca83f5a
2014-03-10 21:39:05 -07:00
Jenkins
b9c70fb590 Merge "Use a sudoers file for jenkins sudo rights" 2014-03-10 15:56:48 +00:00
Jenkins
017b0ec3b5 Merge "remove inline set -e that is preventing explanations" 2014-03-06 15:12:49 +00:00
Sean Dague
e8133fa98d remove inline set -e that is preventing explanations
the script has a set -e mid way through which is now defeating
the explanation parts of the script. Remove this to actually
come back to our normally scheduled program.

Change-Id: I53b5888f44083731b60e03a833f6d8e7769e0e47
2014-03-05 10:26:58 -05:00
daisy-ycguo
e5674d0635 Job to push Horizon translation to Transifex
Add script and job to push the 4 Horizon translation source files
(4 English po files) to Transifex.

Since Horizon has two "locale" folders in different position,
it's not able to levarage the existing upstream_translation.sh
and have to add a new upstream_translation_horizon.sh.

Change-Id: I7a42365414a6a5dcde276bc10761b08e3e756931
2014-03-05 18:35:53 +09:00
Clark Boylan
688bdd459e Create new version-properties.sh script
Create a new version-properties.sh script that will be used on slave
hosts to determine version information from git. This is mostly a copy
of the maven-properties.sh script. The reason we are not simply renaming
is that this commit must be merged then all slave images updated before
we change our jenkins jobs to use the new script. Renaming doesn't allow
us to do that.

Change-Id: I37c0b7cc3ca034addf32897a5a8c6501dedf00b0
2014-02-27 15:11:42 -08:00
Clark Boylan
db20f1f27a Revert "rename maven-properties.sh script to version-properties.sh"
This reverts commit dea3bdb050a55d56a1913e50e59cf176d70d3eb7.

This revert is necessary because it changed jenkins jobs before the
slave images could be rebuilt. We need to update the slave images first
then update the jenkins jobs in a pair of changes that can be merged one
at a time.

Change-Id: Iae4abf8c2dd8ad67ad008c57bbd17ba1304134c6
2014-02-27 15:09:43 -08:00
Jenkins
a56c077f2c Merge "rename maven-properties.sh script to version-properties.sh" 2014-02-27 19:31:36 +00:00
Jenkins
787e3734cc Merge "run-unittests.sh: fix a typo" 2014-02-24 19:12:26 +00:00
Jenkins
a280632250 Merge "Add logs about the pypi mirror" 2014-02-23 08:08:55 +00:00
Khai Do
dea3bdb050 rename maven-properties.sh script to version-properties.sh
Initially maven-properties.sh was intended to make maven projects use git versioning,
that's how it got the name.  However this filename is inappropriate because it's just a
generic script that retrieves git version info to allow builds to version their artifacts.
version-properties.sh is a much more appropriate name for this script.

Change-Id: I3ffc3e9e29bb626f4af5449f0413608a30ee79a0
2014-02-20 21:39:49 -08:00
Marton Kiss
f46639efd6 Basic gating and release jobs of openstackid project
Add check, gate, post and release jobs to PHP/Laravel based openstackid
project. Extend precise node with php5-mcrypt package required for
build process.

Change-Id: If7858412d5c3425aab20c0d11a92cab4c86f47dd
2014-02-20 19:38:14 +01:00
YAMAMOTO Takashi
5e457d59f5 run-unittests.sh: fix a typo
NOST_HTML_OUT_FILE -> NOSE_HTML_OUT_FILE

Change-Id: Ia6e30a6fbda9ea5abb0401fe30c9d3aa9faef90d
Closes-Bug: #1282408
2014-02-20 15:28:20 +09:00
James E. Blair
200ce362a2 Use a sudoers file for jenkins sudo rights
This way we can start with the file in place on all single-use
slaves, and then remove the file at the beginning of jobs that
should not be able to sudo (for example, unit test jobs).

Change-Id: I37aabdba89d00b45365126c8f776ae6ef8357c8f
2014-02-12 08:02:40 -08:00
Davanum Srinivas
17f0e01330 Add logs about the pypi mirror
Makes it easier to diagnose when we look at logs if it shows
if we using the internal mirror or not.

Change-Id: I61945e742dc7dcb021ed20cbace4196b32d192c4
2014-02-09 15:35:52 -05:00
Jenkins
6a94aa26c2 Merge "Make requirement update proposals more robust." 2014-02-06 22:15:37 +00:00
Jenkins
f7a1f74d9a Merge "Use ZUUL_URL in ggp" 2014-02-05 17:02:30 +00:00
Clark Boylan
1059461c6c Make requirement update proposals more robust.
When proposing requirement update changes ensure that the proper branch
can be checked out if the branch isn't master. To do this checkout
origin/$BRANCH instead of just branch. Additonally, don't git review -d
an existing change as it may have merge conflicts with the target
branch. Instead make changes against the target branch, push them to the
existing change as a new patchset, and ignore failures of git review
when there are no new changes.

This allows changes to the requirements files to happen out of band from
these automated change proposals.

Closes-Bug: 1274251
Change-Id: I7b81b87a90639a66dce5502cded5e37d96abd1f7
2014-02-03 17:13:55 -08:00
Michael Krotscheck
1d1b723e5d Added select_mirror to javascript build.
Turns out that using tox also requires we resolve our pypi mirror.

Change-Id: Ibd00b5fd5ae1eb222b16d208893aa782a7bc8306
2014-01-28 15:12:28 -08:00
Monty Taylor
c7403353b1 Use nodeenv via tox to do javascript testing
The OpenStack CI systems like things that run in virtualenvs. This moves
the first stab at running javascript unittests from custom in-tree scripts
to being based on tox and nodeenv. Additionally, it publishes the dist
dir from the tree to docs-draft, because the dist contents should be the
compiled, minified and fully-functional web code, and it should be directly
verifiable on a passing commit.

Change-Id: Id48ee2524d846b5e08ca94f485f8d67abbd3681a
2014-01-27 15:12:21 -08:00
Monty Taylor
da1465db09 Make the alphabetized check self-gating
When putting the alphabetize script into slave_scripts, we run the risk
of bugs entering the script without being tested before they are rolled
live and become part of the gate. This just recently happened. Instead,
move it to the tools dir, which makes it easy for a dev to run, and also
which makes changes to the script self-gating.

Change-Id: Ia5e1870f84b0cbc0c6f172b6982263440af5575e
2014-01-26 09:32:44 -08:00
Andreas Jaeger
cc5c802da7 Fix check_projects_yaml_alphabetized.sh
The previous patch moved " PROJECTS_LIST=$OLDPWD/modules/..." before
the pushd call. But pushd changes the path and thus OLDPWD as well.

So, there are two possible fixes: Either remove the OLDPWD variable from
the if and set PROJECTS_LIST in another way with a full path or
move the pushd call before the if.

Change-Id: If47ab0cfb0078d5e570057c974e3d1f0367d4e0a
2014-01-26 15:00:43 +01:00
Monty Taylor
18870e4a5e Account for both possible projects.yaml names
We're about to rename projects.yaml from review.projects.yaml.erb to
review.projects.yaml and this script needs to know about that.

Change-Id: I84f2caee8aeccb7816c9d367557f3bd0e8315ecf
2014-01-25 08:54:27 -08:00
James E. Blair
f36640710c Use ZUUL_URL in ggp
Makes ggp more generally useful and needed to support multiple
Zuul mergers.

Change-Id: I3c6989f6a710bc124f55aed810be0d4888c67727
2014-01-24 11:41:37 -08:00
Sergey Lukjanov
600e4271dd Fix/improve projects_yaml_alphabetized script
* use 'if ! command; then' condition to check diff
* previously "diff projects_list projects_list.sorted > projects_list.diff"
  command returns exit code 1 and due to the 'bash -xe' it fails execution
* make sort case insensitive

Now this script prints something like:

+ sed -e '/^- project: /!d' -e 's/^- project: //'
modules/openstack_project/templates/review.projects.yaml.erb
+ LC_ALL=C
+ sort projects_list -o projects_list.sorted
+ diff projects_list projects_list.sorted
+ echo 'The following projects should be alphabetized: '
The following projects should be alphabetized:
+ cat projects_list.diff
+ grep -e '> '
> openstack/openstack-doc-tools
> stackforge/cliff
> stackforge/entropy
> stackforge/fuel-devops
> stackforge/MRaaS
> stackforge/puppet_openstack_builder
> stackforge/stevedore
> stackforge/tooz
+ exit 1

Change-Id: Ib6160dc401a70ada16fa961ae8d941b3e8845d4b
2013-12-20 12:39:18 +04:00
Jenkins
45b21a030b Merge "Don't attempt to open an interactive editor" 2013-12-19 23:12:25 +00:00
Anita Kuno
0f5e254d16 Fix the yaml-alphabetized job
Added $OLDPWD/ to the beginning of the path to
review.projects.yaml.erb. Hopefully the script can find the file
now and the job will run successfully.

Change-Id: I32ed800d79a39e47ae20c54147f2e4db2725c97b
2013-12-18 13:25:27 -05:00
Jenkins
84bd35da4e Merge "Add job to check projects.yaml alphabetized" 2013-12-16 19:15:43 +00:00
Jenkins
8a8ed79eac Merge "If zero tests run fail the job." 2013-12-15 18:27:13 +00:00
Monty Taylor
833096afe8 Don't attempt to open an interactive editor
Merging with git can cause git to want to pop you into an editor. That's
not cool in a script. Supply --no-edit to cause the commit to just work.

Change-Id: Ic70d74c28d1ca16ae21b2a6c141b26d4e68b21f0
2013-12-13 19:52:48 -05:00
Sergey Lukjanov
4303c893c3 Add job to check projects.yaml alphabetized
It checks that projects.yaml alphabetized and prints list of projects
that should be sorted. Additionally, it adds new job as non-voting to
the openstack-infra/config project.

Change-Id: I9c0eb5072a5b1446ee654296e60c1f8587a3a7ad
2013-12-13 03:38:51 +04:00
Jeremy Stanley
dde1d73058 Check that the target branch exists
* propose_requirements_update.sh: Look before we leap. Don't descend
into the project repository and try to check out a branch without
first making sure it exists on the origin.

Change-Id: Ib4de5bdf8bf5cf134e3307755617456f282d790d
2013-12-11 17:06:04 +00:00
James E. Blair
95d09355a3 Fix branch logic in req propose script
Checkout the appropriate branch in the target project directory
before syncing the requirements.

Change-Id: I9947255412b57e6d7be0b95bd920b85f1c92658a
2013-12-10 17:46:38 -08:00
Clark Boylan
4ad7cd6615 Be explicit and verbose when using git diff.
Specify that git should diff against HEAD when diffing in the
propose_requirements_update.sh script. Replace --quiet with --exit-code
so that we can verbosely see what differences there are.

Change-Id: I0d194151db457f7eb56e010c94b20562d0221e34
2013-12-10 15:29:19 -08:00
Clark Boylan
257d8b632c Use amend when updating reqs proposal change.
Use git commit --amend when updating an preexisting requirements
proposal update change. Otherwise multiple changes are proposed causing
git review to run interactively and fail (and if it didn't fail multiple
dependent changes would be proposed which we don't want either).

Change-Id: Ic5a173d671ebe25e2bcf2b4972e39879992d3bdf
2013-12-10 14:01:03 -08:00
Sergey Lukjanov
fc62f782be Use full clone in propose requirements updates
Shallow (--depth=1) clone raises some problems with git review tool.

Here is the part of the failed propose-requirements-update job logs:

  + git clone --depth=1 ssh://jenkins@review.openstack.org:29418/openstack/cinder.git
  + pushd cinder
  + git review -s
  + git review -d I2d8f240009d2f847b321baa011880f753783be83
  Downloading refs/changes/69/60969/1 from gerrit into review/jenkins/openstack/requirements
  fatal: unresolved deltas left after unpacking
  fatal: unpack-objects failed

Change-Id: Ie69261fde73c18134906f3edd1263479830005c4
2013-12-11 00:43:29 +04:00
Monty Taylor
8be4b62e4d Update submodules if they're there
Some of our things, like new upstream gerrit, may have submodules
in them. In order to make sure that they, you know, work. We should
run some submodules update commands.

Change-Id: I7c47dd71a49108e79e27b5ba69fa09da638b3764
2013-12-10 01:43:44 +01:00
Jenkins
97322c888c Merge "new maven plugin jobs to build and deploy maven plugins to maven nexus" 2013-12-06 21:54:56 +00:00
Clark Boylan
8c28621bab If zero tests run fail the job.
If testr ran zero tests treat that as a failing job. At least one test
should run in every Jenkins Job running testr. Failure to do that is a
job Failure.

Change-Id: I414def2db856d48f24cdc7f61437a66543e28258
2013-12-06 12:57:07 -08:00
Jenkins
318bd35b4c Merge "Use requirements project list for mirror selection" 2013-12-06 16:55:33 +00:00
James E. Blair
5e3892fbd1 Have gerrit-git-prep clone from /opt/git if it exists
Change-Id: Ifd47e1610b9f3720fdde1e9f88ea7e4aaeb485c7
2013-12-05 10:18:42 -08:00
Monty Taylor
e3f7b0561e Use requirements project list for mirror selection
The openstack/requirements repo maintains a list of projects that have
opted in to receiving automatic updates. Those projects clearly want to
be beholden to the mirror as well, so consume that for mirror choice
instead of trying to figure it out via rules based on name.

Change-Id: I5c65287fabe43fc3e6dec315b29c13788bd3c1ea
2013-12-04 11:14:52 -05:00
Clark Boylan
5d65a11833 Enable requirement update proposal jobs
Apparently we needed to use the magical ZUUL_REF job variable to get the
branch info from a change in the Zuul post pipeline. Use it and only
propose requirements updates to the branches that were updated.

Closes-bug: 1246249
Change-Id: I7adfd19e502846d3a07cde1808fdc79164c061a9
2013-12-03 17:28:07 -08:00