89 Commits

Author SHA1 Message Date
Vladimir Kozhukalov
a1c0645c36 Enable yoga compute-kit job
Change-Id: I6860194ca90d2f81f32cb9bb8633a5af1d798b31
2023-04-12 06:07:06 +03:00
Gage Hugo
65aa849ea5 Remove Ussuri release jobs
This change removes the ussuri-bionic jobs from check in zuul
for openstack-helm. Ussuri is the only release that is still
using bionic images and this change is part of our effort to
stay up-to-date.

A future change will update the charts to remove ussuri overrides
to reflect this.

Change-Id: I18a55426d92654e7baa422ad92ea9f092d854460
2022-10-19 23:27:04 -05:00
sunile
94a8d348a9 Added horizon to install as default component
Added horizon to the openstack umbrella chart to deploy but disabled
by default.

Change-Id: Ia835c0c142d0e0878623af9165d595a386b7c4c2
2022-10-03 16:39:33 +00:00
Gage Hugo
1ece13de23 Update tungsten fabric job
This change updates the tungsten fabric job to use a newer version
of openstack, wallaby, as well as moves it from periodic to
experimental.

Change-Id: I191bdaedba507ee76c04b2a2143362e772bcabc9
2022-09-04 20:02:52 +00:00
Dustin Specker
7a7c533e3e upgrading subchart config only impacts subchart
This verifies that making a configuration change to one of Umbrella's
subcharts results in only the application (DaemonSet, Deployment or
StatefulSet) for that subchart being updated. No other subchart's
application should be updated.

This only validates subcharts from openstack-helm-infra.
Validating the remaining subcharts from openstack-helm will
be done in the future.

OpenStack Umbrella's default values for rabbitmq was configured
to use a host path. This is so rabbitmq retains its data
between StatefulSet changes. Otherwise components fail to authenticate
with rabbitmq after the rabbitmq pods have been recreated. The
OpenStack Umbrella Chart will use the `standard` storage class
by default since that's what is provisioned via minikube.

Change-Id: I8570e32e6ae03563037608d337f31066edf29755
2022-07-06 12:39:33 -05:00
Dustin Specker
078a496937 upgrading umbrella w/o changes has no app changes
If a Helm upgrade is performed on the OpenStack Umbrella chart using
the exact same configuration as the first release, then it's expected
for no DaemonSets, Deployments, or StatefulSets to be updated.
This did not work as expected.

A few changes were required to support this desired behavior:
1. Update glance's configmap-etc.yaml to trim whitespace and convert
   YAML comment to Helm template comment. Before this change, Helm
   rendered the template with the YAML comment and a newline for the
   install phase. On upgrades, Helm rendered the template without the
   YAML comment and newline causing the hash of configmap-etc to change,
   thus causing the glance-api Deployment to update.
2. Update openstack.sh script to create a randomly generated memcache
   secret for glance. Without this change, the glance-api deployment
   changes each time since Helm randomly generates a new memcache
   secret if not provided.

This behavior is enforced via a new test script,
validate-umbrella-upgrade-no-side-effects.sh.

The following jobs are always recreated due to hooks:
- keystone-bootstrap
- keystone-credential-setup
- keystone-db-init
- keystone-db-sync
- keystone-domain-manage
- keystone-fernet-setup
- keystone-rabbit-init
- rabbitmq-cluster-wait

Some Jobs are created via CronJobs and could be created during
validation. So far, heat-engine-cleaner has been seen, but others
could be caught too.

So the validation script ignores these pod changes by ignoring if
Jobs were recreated. Plus Jobs being recreated should not impact
the OpenStack deployment.

Change-Id: Iffaa346d814b8d0a3e2292849943219f70d50a23
2022-06-28 15:55:31 -05:00
Zuul
1f6de05a62 Merge "added pattern to trigger helm-compute-kit-umbrella-chart" 2022-06-27 18:19:05 +00:00
Ahmed Hussain Syed
393e3b4c40 added pattern to trigger helm-compute-kit-umbrella-chart
Change-Id: Ie0c6464477980f7a948eebcfc426bfcdc13d2c2a
2022-06-24 17:43:56 -05:00
Gage Hugo
01cdea17e4 Add Xena and Yoga jobs
This change adds both the Xena and Yoga releases of openstack to the
running jobs that openstack-helm uses to test.

A future change will enable the compute-kit yoga job.

Depends-on: https://review.opendev.org/c/openstack/openstack-helm/+/845156
Depends-on: https://review.opendev.org/c/openstack/openstack-helm/+/845656

Change-Id: I1bed5f1ce4c0919df9e772e920f3146fc39ffb79
2022-06-14 02:23:29 +00:00
Gage Hugo
cb8ef9c229 Remove train jobs
This change removes the zuul check and gate jobs that run the
train release of openstack. This is part of the effort to continue
support for the latest versions of openstack.

Change-Id: Id44d43fe8d99ae6b3f5405458986ce93d1366282
2022-05-31 20:41:59 +00:00
Graham Steffaniak
2e5b7f9cb7 add compute-kit to openstack umbrella chart
ADD: include new charts to the umbrella chart for comprehensive
     deployment of openstack-helm.

       * openvswitch
       * libvirt
       * neutron
       * nova
       * placement

Change-Id: I78d1c7c629024c3f9530239dff9f8eb9da598764
2022-05-19 17:07:31 -05:00
Gage Hugo
0a3ff67bfc Update horizon job to wallaby and ubuntu focal
This change updates the horizon job to run under the wallaby
release on ubuntu focal image. Due to the dependencies
between the images repo and this one, we will need to create
a separate new job before moving over.

Change-Id: I966adc8ac4a54d3c2c06707ecd6c041fe4708c96
2022-04-26 18:37:16 +00:00
Graham Steffaniak
0da3bfb941 Added zuul umbrella chart check
zuul job to verify the openstack umbrella chart deployment works
 properly.

Change-Id: Iafd7de13dfdf8f5942d54a4f37324e4a3dda8ef3
2022-04-08 13:18:31 -05:00
Gage Hugo
b13a8de906 Add Xena check jobs
This change adds the Xena release of OpenStack to the check jobs
for openstack-helm.

Change-Id: I0e07b77b41221a55d8cc97a58bceaaf37d565c35
2022-03-03 20:27:31 +00:00
Gage Hugo
7d718fb5b5 Fix broken bandit gate
The current bandit job appears to be failing due to a dependency
on setuptools. This change adds in a manual install for setuptools
when running the bandit job.

Change-Id: I6d0f5987c4f1a5fe7cfeed3eddb6d21c3040ebb0
2022-01-21 20:53:45 +00:00
Gage Hugo
ded761cf6e Cleanup zuul jobs file and update releases
This change cleans up several redundant values and updates several
openstack release references to wallaby.

Change-Id: I547408a81c73b6b3db147582def6e8527e75a5c3
2022-01-05 02:54:51 +00:00
Zuul
28a29d1d7a Merge "Run keystone-ldap job on keystone changes" 2021-11-18 02:37:43 +00:00
Gage Hugo
863d8afb27 Run keystone-ldap job on keystone changes
This change modifies the keystone-ldap job to run in check when
the keystone chart contains any modifications. This moves it from
running periodically to running on each keystone change.

Depends-On: https://review.opendev.org/c/openstack/openstack-helm/+/816209

Change-Id: I32008e3a14b0428922071205f873087c2aba071d
2021-11-12 22:38:42 +00:00
Gage Hugo
b4978e8e60 Update periodic/experimental jobs to helm v3
This change updates the experimental jobs that are
currently working to use helm v3. Later changes should
fix the other issues that they are currently experiencing.

Change-Id: I068a9bb835e1bde4d11d8dee0352c49248c20b15
2021-11-11 23:46:20 +00:00
Gage Hugo
f42a54532c Only run cinder jobs on cinder changes
We currently run multiple jobs that deploy cinder on changes
that have no relation to the service. This change modifies the
job to only run when we modify the cinder chart, test scripts,
or the zuul files themselves.

Change-Id: Ia188193929143cb6ae52266a5a87d2662626d42e
2021-11-04 15:17:40 -05:00
Gage Hugo
7034968d96 Move check jobs to use helm3
This change migrates the check jobs in OSH to use the
new helm v3 script when deploying kubernetes via
minikube.

This is one step in the move to helm v3. Future changes
will migrate the other jobs.

Change-Id: If741db5997a27ed06584b9af2d50485d8de34a2b
2021-10-29 19:41:25 +00:00
Gage Hugo
75349b25b7 Remove extra linting job
Now that the main linting job runs helm v3, this extra job is
no longer needed. This change removes the specific helm v3
linter job.

Change-Id: I40d6be368a4f36242c54b9a57b7e6f7328be8bb6
2021-10-22 17:31:25 -05:00
Gage Hugo
9c7380568e Cleanup unused jobs
This change removes a bunch of old and duplicated jobs,
duplicate netpol and the old armada jobs that have not
been maintained. Also removed the tls job from
experimental since we run it now in gating.

Change-Id: Ic19520d8790c52d66d62b20a23658c57d954697e
2021-09-04 00:42:28 +00:00
Gage Hugo
dfcf42289b Run helm3 linter in check
This change adds a helm3 linter to the zuul check job list. The job
currently emits some warnings, these will be cleared up in future
changes.

Change-Id: I4d74ba5464e9e3d78b95298e9778b99f1b387fcd
2021-08-09 21:35:07 +00:00
Andrii Ostapenko
3ac3caa013 Add support for Victoria and Wallaby
Defines compute kit and cinder jobs for new releases with
corresponding values overrides.

Disables compute agent list test for Wallaby since related API
is removed [0].

Since Wallaby with switch of osc to sdk '--id auto' is no longer
treated specially in 'openstack flavor create'. The same behavior
can be achieved w/o specifying --id flag for flavor creation [1].

Starting Wallaby 'nova-manage api_db version' returns init version
for empty database greater than 0 [2]. _db-sync.sh.tpl logic prior to
this commit does not work due to this. We need to either remove
(done in current commit) or justify and alter previous logic.

[0] https://review.opendev.org/749309
[1] https://review.opendev.org/750151
[2] https://opendev.org/openstack/nova/src/branch/stable/wallaby/nova/db/sqlalchemy/migration.py#L32

Change-Id: I361431d9aa8c1a06c5d59f479fb161ecd87e2ee2
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2021-08-02 15:46:07 +00:00
Gage Hugo
cc8fe0c0aa Remove old release jobs and update to latest
With the latest change[0] officially dropping support for older
non-maintained releases, this change removes several EOL release
jobs as well as bumps anything using those up to the latest
supported T release.

[0] https://review.opendev.org/c/openstack/openstack-helm/+/788380

Change-Id: I8df32c6bcc0b9a0c65aa1299c6a792b27da81ae8
2021-04-30 14:37:02 -05:00
Gupta, Sangeet (sg774j)
7f42914f7d Zuul.d: Making TLS gate voting again
Reverting https://review.opendev.org/c/openstack/openstack-helm/+/773651
since ubuntu-bionic-expanded seems to be available now.

Depends-on: https://review.opendev.org/c/openstack/openstack-helm/+/787557

Change-Id: Ib93eca9e6e84a60af2bd3ed5b90647966fa0aca3
2021-04-27 12:12:44 +00:00
Gage Hugo
c308d67cdf Move stein to periodic, update to train
With stein in extended maintenance, this change updates the check
and gate jobs to run train and up, as well as updating some jobs
to use train. Moved stein to periodic.

Change-Id: Icd516f25140ebd479b49da101e4f84326f341274
2021-03-24 14:34:29 -05:00
Gupta, Sangeet (sg774j)
86c2196679 zuul.d: Adding multinode job
This new job deploys 5 node cluster and deploy train
openstack.

Depends-on: https://review.opendev.org/c/openstack/openstack-helm-infra/+/765588

Change-Id: I9c946d5eab46d6603c9b8ff25dc482b543d236bf
2020-12-28 16:38:32 +00:00
Zuul
ca48e44974 Merge "Optimize tls job to reduce build time" 2020-09-17 02:12:29 +00:00
okozachenko
b0c4f7f593 Upgrade train jobs to ussuri
I am gonna use openstack-helm images to run the latest
openstack, ussuri on k8s and so added ussuri zuul ci.
As the first stage, only added for ones which has train
already.

Change-Id: Icd554a0d21f55cd074d1e5c35e1de25e02223cee
2020-09-15 22:47:33 +03:00
Andrii Ostapenko
5f4a385add Optimize tls job to reduce build time
Also run cron job test in parallel with 900-use-it.sh

Change-Id: I79ba1f3d15b3788fc9271d7b0029cc7989055728
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-09-10 22:15:46 +00:00
Andrii Ostapenko
25a02b797f
Add force cron jobs test run
Change-Id: Iba1045e8b8a992c77449c77a16d410589b7778bc
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-09-10 17:15:26 -05:00
Zuul
4eb8c1bed8 Merge "Dont run cert-manager in jobs w/o tls enabled" 2020-08-12 20:48:51 +00:00
Andrii Ostapenko
ba412dec93
Dont run cert-manager in jobs w/o tls enabled
Change-Id: I1bf7d33811417866dd03bbed13dc9ef155b36f18
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-12 13:04:00 -05:00
Andrii Ostapenko
7b7d117378 Run other tests consequently with neutron ones for compute kit
This allows to distribute memory spike caused by running all tests
in parallel, decreasing a chance of oom.

Was:
--------------------- neutron tests ---------------------
--- nova tests ---
--- keystone tests ---
--- glance tests ---

Now:
--------------------- neutron tests ---------------------
--- nova tests --- --- keystone tests --- --- glance tests ---

Change-Id: I5c625f075a27ac08c8d72c8da52ae7b85f3f202f
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-12 03:47:36 +00:00
Andrii Ostapenko
5dfb1ec9ee Increase timeout for neutron helm tests run in parallel
On small part of oversubscribed executors it takes longer than 15
minutes to run neutron helm tests if it's run in parallel with others.

Change-Id: I56a436b3442c5102d6d2e67ef0cd1e035ebca109
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-12 01:05:37 +00:00
Andrii Ostapenko
676c72a52d
Add missing parameter to tls job
Change-Id: Iaec6c51c647a9e522346222464ab71ff73fb5083
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-10 23:04:10 -05:00
Andrii Ostapenko
d996fde657
Switch from 32GB to 16GB nodes for jobs requiring more ram
Also use osh-infra-gate-runner for tls job instead of non-existent
osh-gate-runner.

Change-Id: I3c1105422307fda5b014fc17bcdfe24999ce97eb
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-07 18:39:36 -05:00
Andrii Ostapenko
f3ed377cbc Parallelize helm test run for compute-kit
Depends-On: https://review.opendev.org/742499
Change-Id: Iebc74280f5fd6302723caa325603645a2f9755dc
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-06 00:51:29 +00:00
Andrii Ostapenko
fa0b3d3ebe Parallelize osh-gate-runner for gate jobs
Depends-On: https://review.opendev.org/739659
Change-Id: I925773d9e93ec3cc90fbd14cffa7c8d8738ce8d5
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-06 00:51:23 +00:00
Chinasubbareddy Mallavarapu
59dac81fd4 [CEPH] Update ceph scripts to create loopback devices
This is to update ceph scripts to create loopback devices
in single script and also to update gate scripts.

Change-Id: I937ae79512ffc998d8dbd0b277a611347550044b
2020-07-29 09:51:31 -05:00
Andrii Ostapenko
67acec14cd Refactor to support jobs invocations from other projects
Switch osh fuctional jobs to osh-infra-job-runner playbook inheriting
from openstack-helm-infra-functional.
Specify gate_scripts_relative_path var for each job to support the
case when corresponding jobs defined in osh are invoked from another
project to allow playbook know where to look for gate scripts.

Depends-On: https://review.opendev.org/740557
Change-Id: I315f04ef7bdf5bf97d09843de8f878e2d15377dc
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-12 03:19:39 +00:00
Tin Lam
918a307427 feat(tls): add tls support to openstack services
This patch set enables TLS for the following OpenStack services: keystone,
horizon, glance, cinder, heat, nova, placement and neutron for s- (stein)
and t- (train) release. This serves as a consolidation and clean up patch
for the following patches:

[0] https://review.opendev.org/#/c/733291
[1] https://review.opendev.org/#/c/735202
[2] https://review.opendev.org/#/c/733962
[3] https://review.opendev.org/#/c/733404
[4] https://review.opendev.org/#/c/734896

This also addresses comments mentioned in previous patches.

Co-authored-by: Gage Hugo <gagehugo@gmail.com>
Co-authored-by: sgupta <sg774j@att.com>

Depends-on: https://review.opendev.org/#/c/737194/

Change-Id: Id34ace54298660b4b151522916e929a29f5731be
Signed-off-by: Tin Lam <tin@irrational.io>
2020-07-10 09:36:31 -05:00
Gage Hugo
6027ac0c0c Cleanup zuul checks
This change moves the tungsten fabric check down to the periodic
checks with the other feature overrides, removes several duplicate
checks that are currently non-functional, and moves the rest to
experimental.

Also moves the compute-kit jobs back to using the default
single-node nodeset due to cloudedge going down and not
enough available 32gb nodes as a result

Change-Id: Ib4f314d5246af8756611346ed4919492d98510a5
2020-07-09 18:38:56 +00:00
Zuul
135e2c8b64 Merge "Add TungstenFabric compatibility to charts" 2020-07-08 13:47:49 +00:00
Chinasubbareddy Mallavarapu
a385c18176 [CEPH] OSH: use loopback devices for ceph osds.
- This is to make use of loopback devices for ceph osds since
support for directory backed osds going to depricate.

- Move to bluestore from filestore for ceph-osds.

Change-Id: Ia95c9ceb81f7d253dd582a2e753a6ed8fe60a04d
2020-06-30 17:05:22 -05:00
OlegBravo
4f2eb8cac6 Add TungstenFabric compatibility to charts
The charts changes are required for deployment
of various clouds based on Tungsten Fabric SDN.
Right now it's tested for Airship-in-a-bottle.

The code cannot be tested currently in
OpenStack Helm project because of absence of
tests and platform for that.

This patchset doesn't have Heat-related changes,
they'll be added later.

Change-Id: I73f2ced2b09dbb93146334b59fe4571fa13dbfb0
Depends-On: https://review.opendev.org/#/c/734635/
2020-06-26 10:39:20 +03:00
Andrii Ostapenko
81884d8a60
Switch compute-kit jobs to 32GB nodes
We're running compute kit jobs on the edge of current flavor
capabilities and actually exceeding it with TLS enabled.
With this change compute kit TLS commit successfully pass check
jobs.

Change-Id: Ide1a1600f2e19fcb91ec7d90c8f316283b2d9697
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-06-21 18:14:59 -05:00
Tin Lam
26c795aa0d feat(tls): adding cert manager to gate
Change-Id: I913c9de3bd405ecd4482c6d455c9c7399e64f95a
Signed-off-by: Tin Lam <tin@irrational.io>
2020-05-20 19:59:58 +00:00