We apparently didn't rebase all changes properly and some new scripts
ended up in jenkins/files/slave_scripts when they should all go into
openstack_project/files/slave_scripts. Move them now.
Change-Id: If6eec70f9da393193497d4d52d6a69a34cdb4db2
We want to make wheels for pre-release and release events. We will only
build wheels on python 2.7. If the project supports python 3 as well, the
project will have marked itself as supporting universal wheels. If it does
that, python 2.7 will build a wheel that can be used in both places. If it
does not support python 3, then we don't have to build on on python 3.
Change-Id: I060b59d8adc586ff37065fa4f6172a592ee3f903
There are few things that are different for our slaves on trusty. Of
note, we don't want to pin puppet, and we need to provide a version
for postgres.
Change-Id: Ibee78cd4fbeef2e6af43379d2bc3a0f0e9767a06
The jenkins-sudo file resources were moved from the jenkins module to
the openstack_project module, and the source paths in the file resource
were changed to reflect the move, but the source *.sudo files were not
moved to the new module.
Change-Id: I54c288fe73cacd8e0bd09db3d6f855e06fc65434
The ::jenkins::slave class contained a lot of openstack-specific
configuration rather than configuration of a generic jenkins slave.
The term "bare slave" is overloaded and confusing: create simple_slave
and thick_slave to differentiate between the two meanings of "bare".
Some portions of ::jenkins::slave will move to simple_slave, some
portions to thick_slave, and some portions to slave_common (all in the
openstack_project module).
Change-Id: I5281a03a7f6da3f98714bcc59ae840ace8435578
The daily "Imported Translations from Transifex" patch includes all po
files, even the ones that are completely untranslated or only have a partial
translation. There's no real need for these files.
Therefore, only download files that are at least 75 per cent translated.
There is one exception: For openstack-manuals the common directory
contains many files where only a few need to be translated - so allow
here 8 per cent translation. This currently downloads the Japanese and
French files and thus covers the languages that we need.
Partial-Bug: #1317794
Change-Id: I763c21768e3876aaaf4734bf2d769de20b49ff42
The unittests attempt to check that more than 0 tests run; however, in
some cases 0 tests will be run and testr last won't list the number of
tests as a number. This causes the sed filter to fail to match resulting
in a rancount of "". If we get a rancount of "" or "0" fail the test.
Change-Id: I1f7ca358c73c071e60ba4b651cf75db18b8fd487
If you start with an out of date repo (we do -- we clone from cached
git repos on our images) and the git remote update fails (eg due to
mirror sync issues) and you then do a fetch with a ref argument
(eg refs/tags/foo), it will fail with:
error: no such remote ref refs/tags/foo
However, git fetch --tags will get all the tags from the zuul merger,
which is what we really care about, and the subsequent checkout and
reset will make sure that we really did get the tag we wanted.
Therefore, remove the ref argument that can cause these occasional
failures.
Change-Id: Iaed8b82204a3eddc7ee418ebe94637f2a371d25b
When pushing changes to gerrit for requirements proposals there are
cases where we want to ignore push errors. Specifically when gerrit is
complaining because you are pushing the same commit or one with
identical comments. We should just ignore these errors as it means the
current reqs proposal is up to date.
See
https://review.openstack.org/Documentation/error-no-changes-made.html
for more info.
Change-Id: I5d7a1991449a80f570191eaad49dc3f9a0ff1a6a
Requirements proposal jobs need to set git configs for each git repo it
is proposing to. This is necessary because it shouldn't set the git
config globally for the Jenkins user on the slaves.
Change-Id: Id69ba218065022f69d2dd9d140825699d78604e3
Add slave-file to handle horizon translations.
Setup periodic job to import horizon translations the same way its done
for other projects.
Change-Id: I0e28f0268e7f3fdea9d5f22d2e896b0079410ea6
After the switch to using the proposal-bot gerrit user in proposal jobs
some jobs continued to attempted to use the jenkins user. Fix that and
use the proposal-bot user.
Change-Id: I146b6ea29d66bd171072e6529413efcc5cae3d8d
Include PO-Revision-Date in list of lines to ignore so that we do
not get new proposed files where just the date has changed.
Change-Id: I3ce13d0cdd9fdbf1711d40ebbdef408c93d49523
Switch all jenkins proposal jobs to a dedicated user with dedicated
credentials. This is being done to be more flexible and secure when it
comes to managing the scripts that make proposals to gerrit.
Change-Id: I2dbdd530bf5b64c14207f645512a1eb319681166
If a single file has changed, all other .pot files are send as well
since they have a new timestamp.
Check for files that only have a new timestamp and revert their change
so that they do not get committed at all.
Also, handle Project-Id-Version the same way as the timestamp.
Change-Id: I49488d01a7bb9242508ec7d378240449124608de
Call update_catalog with option --ignore-obsolete=true to not generate
any obsolete translation entries.
Change-Id: Ia898149f6203ebf024a64b8bf3ecbffd75261ce8
Related-Bug: #1299349
subunit logs should not be more than 50MB uncompressed. If they
are you are doing something terribly wrong, and both consuming a
ton of infra resources, as well as local user memory.
Change-Id: I0f93684c0b9055bc95808cfae827e171fa30f6d1
milestone-proposed was checked out in a detached state, which prevents
git-review from successfully proposing changes to it. It works with
master because master is checked out by default on the initial clone.
This commit makes sure the branch is checked out with proper origin
tracking before proceeding with changes.
Fixes bug #1302490
Change-Id: Iff4f653d2d68fd36bb076ed8ae9fa5b0bb03edda
* .../slave_scripts/project-requirements-change.py: When parsing
requirements files, only perform style checks like missing final
newline or duplicate entries on the new/proposed version of a file
and ignore them on the original version of the file in the
repository. This makes it possible to actually correct errors on
imported requirements files, even with the job running this script
already voting on the correcting change. Also annotate this with
more commentary so people have some hope of understanding what the
heck it's doing.
Change-Id: I8ea2800ecc8eb24937e69a573e925b4daf64ff3f
Closes-Bug: #1300843
I042cdd2dd2407f381cafcabc5c6b83d9b9a9eb00 adds instructions to
workers on how to send logs to swift using the FormPost middleware.
This slave-script allows you to pass in a directory to push to
swift using these instructions and returns a URL where they are
available.
Change-Id: I7ccafa408a88ef80317b1c546b3451c0033dce61
Prior to this change we attempted to push translations made direclty in
the git tree to transifex allowing translations to be made via git
directly or in transifex. Simplify the process to avoid cases where the
transifex client will refuse to update local translations because they
are newer than those in transifex. This makes transifex the only source
of translation updates. In addition to simplifying the process force tx
pull -a operations as a way to force the updates if we end up in this
state.
Change-Id: I171b3b1a29cbeaab0c4d9de3ab1bd3a6b933ea53
* gerrit-git-prep.sh: If the zuul ref is a tag, then fetch the tag
from zuul. Otherwise there's a risk that it may not have replicated
to the origin yet when initially setting up the workspace.
Change-Id: Iadd8385e4a0d0957fcac1cf89d0b5a1cfa848b49
* modules/jenkins/files/slave_scripts/gerrit-git-prep.sh: Allow
callers to supply BRANCH in the environment for cases where there
will be no ZUUL_REF environment variable. This is mainly to support
use in periodic jobs, so that we can transition away from the
Jenkins SCM plug-in.
Change-Id: I86c77695d8c374c94932664026ab7a541686ae74
There was an extra closing bracked "]" that breaks the script.
Hope this finally gets the job running again.
Change-Id: Ib9721e312aa9a678fe483d6cbb1fb910be1c1659
pip's default timeout of 15 seconds doesn't seem to be high enough
causing us to intermittently fail getting the pypi index. Increasing
the timeout to 60 in an attempt to make it less likely to hit the
problem.
Change-Id: Ifd4689283e53d6afb7a76b480e004cdde3b302f6
Related-Bug: #1272417
The current job fails to run since there's no venv created, we need
to pass -V to update it - otherwise the job will fail.
Change-Id: I4293cbef253cea9638c22bb5a980d07da9d315db
Some git repositories have .tx directories, most have none. Handle both
ways - check if .tx directory exists and create it with tx init if not.
Change-Id: I7035fd6d130aabe553678e8b7aec78d33333715f
Check if there is already a .tx folder and run tx --init only if
there is none. The horizon repo currently has one and thus the job fails
to build.
Change-Id: Ifa3115943c49550f3d72007484e9343f7de1d8ca
This was used when transitioning to ZUUL_URL from the calling
environment, and is no longer required by any calls to the script.
Change-Id: Ie3e1740a6cc3d67bd306b5d6c258002d51eaffe8
Currently the periodic job manuals-propose-translation-update runs
three times on the same repository instead of running once each for
api-site, openstack-manuals and operations-guide.
Also, manuals-upstream-translation-update does not handle the api-site
repo.
* Change the scripts so that they handle all three repositories.
* Update the jenkins configuration to call the scripts with repository name
as parameter. This needs new job-templates.
* Create a job-group
* Use job-group for each repository.
* Adjust Zuul for new jobs using a template.
* Update manual jobs in zuul to check for just "master" as branch
instead of using a regex.
Change-Id: I755730ea43ad05a373704ab2fb7e5b55f1c8aeee
Closes-Bug: #1291844
Maintaining transifix in git causes some problems, we're removing it
now from openstack-manuals and thus need to initialize it here.
The manuals change at https://review.openstack.org/#/c/79859 is waiting
for this to go in.
Change-Id: I1bc1e1ae0f25ce5d88a70cdbab2541c8a52ddd78
Jenkins needs to sudo as stack and tempest to properly run devstack jobs
and may need to act on behalf of other users in the future. Rather than
listing root,stack,tempest in the sudoer file just let jenkins sudo as
any user.
Fixes-bug: 1290669
Change-Id: I4a5c6b7ead717475d6334a7ef3121271aca83f5a
