This causes apply-test.sh to get the list of puppet modules to do
integration test with from modules.env. Modules.env has been
refactored to have three lists of modules: Package modules(MODULES),
SOURCE_MODULES, and INTEGRATION_MODULES.
When PUPPET_INTEGRATION_TEST is not set, INTEGRATION_MODULES is
folded into SOURCE_MODULES.
In apply-test.sh, INTEGRATION_MODULES is sourced from modules.env
and some string/array manipulation is performed to pass each entry
to zuul-cloner.
Change-Id: I47302c5c7e8c41b985f16a05c4e9b8078ea867a3
Part of an effort to split most of puppet modules out of system-config.
https://review.openstack.org/#/c/130619/ should land before this
commit can be merged.
Change-Id: I7720ad7d2b25816c63e971112a7a733bde52b7f3
We are renaming openstack-infra/config to
openstack-infra/system-config. This patch addresses the one file
in the tools directory that needed editing.
Change-Id: Id078dc7031f833c6d1a58cddbcecf0666244c6a1
Fix all of the bashate failures. Also, bashate will install its negative
tests in its virtualenv, so we need to generate a list of files to pass to
bashate that excludes .tox/
Change-Id: I55559bf6137f705aec9a7f277928ad8d4cadc2ca
Since the split to project-config, there is no longer a need to
run 'tox' for projects_alphabetized, since those resources no
longer exist. Also removing the shell scripts that were running
the tests.
Change-Id: Ib7a762d872da9c5d945206807c405e7452b49638
Content from the config repo was split into a new repo,
project-config. This patch deletes the moved content from the
config repo.
Change-Id: Ifa1ae2cb7c23ae48f388b7d57a4c0d0799ef1dc2
Story: 167
In order to use disk-image-builder to build nodepool images, we need
a few things. First, we need additional debs to be installed for
disk-image-builder to work. Then we need the image elements themselves
to describe the images we want to create. Also, a few helper scripts
for locally working with the disk images have been included.
Tested with build-image.sh script; devstack-gate-trusty.qcow2 created
correctly
Change-Id: I539743147341dc5b387d103fecd3e9ff0f01fdfc
The zuul cloner needs the ZUUL_* env vars when setting up projects
for the new apply integration test.
Also, add some more debugging to both versions of the test.
Change-Id: I486b19cecd034250068e4a59604e1e0ca90ed83d
Make module installation conditional in install_modules.sh so that
we can specify that we _do not_ want it to install the modules
that will be participating in the integration test.
Add a variant of the apply test script (currently test.sh) that
uses zuul-cloner to check out the appropriate versions of modules
that are participating in the integration test.
Add jobs that run this to the experimental pipeline.
Change-Id: I16055cdd45f6e05aa8ebceb500c5709f265268df
It turns out that we pass a lot of args around simply for the
purpose of doing mirror selection. This goes away if everything
gets a mirror.
This change should only be merged after the parent change has
propagated to all puppeted slaves and updated nodepool images.
Co-Authored-By: Jeremy Stanley <fungi@yuggoth.org>
Change-Id: I4a721f6559d7160c8213268a8c1e35c667a67a4f
This is the result of running:
find modules/openstack_project/files/gerrit/acls/ -type f \
-name "*.config" -exec ./tools/normalize_acl.py {} 6 \;
Change-Id: I7aa27b859529b2bc8a990d6272334222996cbbc4
* tools/normalize_acl.py: Script which can perform one or more of a
list of normalizing transformations to an ACL file.
Change-Id: I063ab91b6e786eccaee61c669f0e840c7af6be14
* tools/atc/README: Simplify instructions to use mysqlclient
tab-separated-values stdout, and remove obsolete manual steps which
have been automated.
* tools/atc/email-stats.sh: The functionality this shell script
previously provided has now been translated to Python and folded
into the inner script.
* tools/atc/email_stats.py: Implement the old email-stats.sh outer
loop, make it possible to run in a virtualenv, and make previously
hard-coded constants into command-line parameters with sane and
dynamically-determined defaults. Update field order and contents to
cope with differences in Gerrit 2.8, use a proper YAML parser on the
programs.yaml which has also changed format since the previous run,
and adjust for the improved extra-atcs file format as well.
Change-Id: I2deef2e6766ff998190e66737e7cec9cdcd5459c
* tools/atc/email-stats.py: Adjust the order in which Gerrit E-mail
addresses are returned so that the one listed as the preferred
address is sorted to the beginning of the set.
Change-Id: I95b5817ada58f4059df4f5c0b406183f1c1e5b74
* tools/atc/email_stats.py: Move procedural code out of the global
scope to make this file safely importable, and clean up a couple of
unused variables flake8 noticed in the newly importable main
codeblock.
Change-Id: I1a29c84e067eea875ba57a16196723f65f60ff01
Rename tools/atc/email-stats.py to tools/atc/email_stats.py in
preparation for making it an importable module. This is being
separated from the subsequent change to make it more reviewable.
Change-Id: I1907de0715c96f54edb44910746fbb24a5ab8665
Add a tox environment to run the zuul layout tests locally.
Modify run-layout.sh to ignore a missing mirror selection script
and assume that it is running with a valid mirror configuration.
This allows the script to be run locally without breaking a
dev environment.
Change-Id: I5b0c94ae51e7f41b8b26b3ef4f78b830031d263e
Add a check job to require upstream URLs to use a scheme
that we are confident won't cause connection errors during
the import.
Add a tox configuration for this new job, as well as the
existing alphabetical check script, to make it easier
for developers to run those tests locally just by running
"tox".
Change-Id: I894ac0f8afb234404bb6e80e64b90aa25e052f10
puppetboard does not always tell us what we need to know. This tool
is the beginning of trying to figure that out.
Change-Id: I495986e40cdb2c062da9591a29feef5288f1bc57
Currently, the run-compare-xml.sh script will only report changed or
removed files, it does not report new files being created. This change
replaces diff in a for loop with a recursive diff that treats missing
files as empty files. The result is that the output is presented as a
single unified diff that includes new files as well as changed and
removed files.
Change-Id: I0bb5a1ee93e689666ca5080ec5ccbe036c73d682
* tools/atc/email-stats.sh: We now have an official list of projects
in the openstack/governance project, so use it instead of the old
hard-coded list.
Change-Id: If93c71174687ac7e4e46d514642c48edb841adfe
* tools/atc/README: When generating the initial data dump, MySQL on
review.openstack.org creates output files with DOS line endings and
ISO-8859-1 encoding. Recommend using fromdos and iconv to normalize
them.
Change-Id: Ie16a56c024b0eee97b0e6bd5abe8ed3b0e0a9f7e
The projects list is a common list for devs to interact with. The config
in the list is not, but the config in the list means the file needs to
be in an erb template.
Split the two concerns, similar to zuul. Put the config in a config file
and the project data in a yaml file.
Change-Id: I708b8655b4b1ce377f3b7369e987418c1d72d977
When putting the alphabetize script into slave_scripts, we run the risk
of bugs entering the script without being tested before they are rolled
live and become part of the gate. This just recently happened. Instead,
move it to the tools dir, which makes it easy for a dev to run, and also
which makes changes to the script self-gating.
Change-Id: Ia5e1870f84b0cbc0c6f172b6982263440af5575e
The OpenStack Havana release heralds end of support for Folsom, so
stop testing it.
* modules/jenkins/files/slave_scripts/docbook-properties.sh: Remove
folsom-specific settings.
* .../openstack_project/files/gerrit/acls/openstack/ceilometer.config:
Get rid of the stable/folsom ACL override.
* .../jenkins_job_builder/config/devstack-gate.yaml
* .../manuals.yaml
* .../projects.yaml
* .../python-bitrot-jobs.yaml
* modules/openstack_project/files/zuul/layout-dev.yaml
* .../layout.yaml: Remove all folsom-only jobs and clean up
configuration and comments associated with them.
* tools/invite2summit/settings.py.sample: Adjust usage comment to no
longer refer to Folsom.
Change-Id: Ieb38a74e6945abe2e40cd3e1cd23b52fbd826933
