91 Commits

Author SHA1 Message Date
Gage Hugo
f895ef79c1 Make TLS job voting again
The TLS job was previously broken with the change to helm v3, but
has since been fixed. This change makes it voting again.

Change-Id: I3ea6f12a4d165f9ff64e002e860e873a603f6a6d
2021-11-11 17:50:15 -06:00
Gage Hugo
f42a54532c Only run cinder jobs on cinder changes
We currently run multiple jobs that deploy cinder on changes
that have no relation to the service. This change modifies the
job to only run when we modify the cinder chart, test scripts,
or the zuul files themselves.

Change-Id: Ia188193929143cb6ae52266a5a87d2662626d42e
2021-11-04 15:17:40 -05:00
Zuul
873de94f74 Merge "Move check jobs to use helm3" 2021-11-01 16:48:33 +00:00
Gage Hugo
7034968d96 Move check jobs to use helm3
This change migrates the check jobs in OSH to use the
new helm v3 script when deploying kubernetes via
minikube.

This is one step in the move to helm v3. Future changes
will migrate the other jobs.

Change-Id: If741db5997a27ed06584b9af2d50485d8de34a2b
2021-10-29 19:41:25 +00:00
Gage Hugo
bdd1e7ebe9 Make TLS job nonvoting
The move to helm v3 breaks the rendering for the ca-issuer chart.
While that gets fixed, we can temporary make the job non-voting
in order to unblock the migration to helm v3.

Change-Id: Ia25ac1f85974fc8c8ac8cf3ffedff746a92f2cf5
2021-10-28 18:23:25 -05:00
Gage Hugo
75349b25b7 Remove extra linting job
Now that the main linting job runs helm v3, this extra job is
no longer needed. This change removes the specific helm v3
linter job.

Change-Id: I40d6be368a4f36242c54b9a57b7e6f7328be8bb6
2021-10-22 17:31:25 -05:00
Zuul
f0639fccb1 Merge "Re-enable multinode gating jobs" 2021-09-06 03:39:37 +00:00
Gage Hugo
4a952a84a6 Re-enable multinode gating jobs
Now that the kubeadm-aio is fixed, we can re-enable the
multinode jobs for gating against openstack-helm.

Change-Id: Ib1f1bca5f370e0326ea0211dfcfba9544bd458b2
2021-09-04 01:29:47 +00:00
Gage Hugo
9c7380568e Cleanup unused jobs
This change removes a bunch of old and duplicated jobs,
duplicate netpol and the old armada jobs that have not
been maintained. Also removed the tls job from
experimental since we run it now in gating.

Change-Id: Ic19520d8790c52d66d62b20a23658c57d954697e
2021-09-04 00:42:28 +00:00
Zuul
2f80bd3ff2 Merge "Add V and W jobs to zuul check" 2021-08-16 08:16:40 +00:00
Gage Hugo
dfcf42289b Run helm3 linter in check
This change adds a helm3 linter to the zuul check job list. The job
currently emits some warnings, these will be cleared up in future
changes.

Change-Id: I4d74ba5464e9e3d78b95298e9778b99f1b387fcd
2021-08-09 21:35:07 +00:00
Gage Hugo
73b307a3de Add V and W jobs to zuul check
This change adds the V and W openstack release jobs to the zuul
check list. This will bring OSH testing more in line with the latest
supported releases of OpenStack.

Change-Id: I2cc98159ee9bf1ad3ac5c70a772e2b4c1bbd7fa4
2021-08-09 13:36:13 -05:00
Andrii Ostapenko
3ac3caa013 Add support for Victoria and Wallaby
Defines compute kit and cinder jobs for new releases with
corresponding values overrides.

Disables compute agent list test for Wallaby since related API
is removed [0].

Since Wallaby with switch of osc to sdk '--id auto' is no longer
treated specially in 'openstack flavor create'. The same behavior
can be achieved w/o specifying --id flag for flavor creation [1].

Starting Wallaby 'nova-manage api_db version' returns init version
for empty database greater than 0 [2]. _db-sync.sh.tpl logic prior to
this commit does not work due to this. We need to either remove
(done in current commit) or justify and alter previous logic.

[0] https://review.opendev.org/749309
[1] https://review.opendev.org/750151
[2] https://opendev.org/openstack/nova/src/branch/stable/wallaby/nova/db/sqlalchemy/migration.py#L32

Change-Id: I361431d9aa8c1a06c5d59f479fb161ecd87e2ee2
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2021-08-02 15:46:07 +00:00
Zuul
c30ef33edd Merge "Remove old release jobs and update to latest" 2021-05-20 15:45:02 +00:00
Gage Hugo
42cdcea972 Disable multinode gate jobs
With the latest removal of the tiller chart, the multinode jobs were
still utilizing the older method of deploying the kubeadm-aio. We
can disable these for now until the jobs get updated to avoid blocking
existing work.

Change-Id: Icbf694a1b23da5e662ba5b894ff45f443f705021
2021-05-04 16:57:55 -05:00
Gage Hugo
cc8fe0c0aa Remove old release jobs and update to latest
With the latest change[0] officially dropping support for older
non-maintained releases, this change removes several EOL release
jobs as well as bumps anything using those up to the latest
supported T release.

[0] https://review.opendev.org/c/openstack/openstack-helm/+/788380

Change-Id: I8df32c6bcc0b9a0c65aa1299c6a792b27da81ae8
2021-04-30 14:37:02 -05:00
Gupta, Sangeet (sg774j)
7f42914f7d Zuul.d: Making TLS gate voting again
Reverting https://review.opendev.org/c/openstack/openstack-helm/+/773651
since ubuntu-bionic-expanded seems to be available now.

Depends-on: https://review.opendev.org/c/openstack/openstack-helm/+/787557

Change-Id: Ib93eca9e6e84a60af2bd3ed5b90647966fa0aca3
2021-04-27 12:12:44 +00:00
Gage Hugo
c308d67cdf Move stein to periodic, update to train
With stein in extended maintenance, this change updates the check
and gate jobs to run train and up, as well as updating some jobs
to use train. Moved stein to periodic.

Change-Id: Icd516f25140ebd479b49da101e4f84326f341274
2021-03-24 14:34:29 -05:00
Gage Hugo
44a34f7db4 Stop running Rocky jobs in check
We already run the rocky jobs in periodic. With Rocky in EOL, we
can remove them from being checked on every change.

Change-Id: I8728297c9b0742cd10977185568c75fc2b8b7e7e
2021-02-08 20:04:10 +00:00
Andrii Ostapenko
deed80582e
Temporary make tls job non-voting
ubuntu-bionic-expanded is not available now. Temporary disable it to
unlock urgent efforts.

Change-Id: Ib6224d7420b0b09c1fbd615437eb15f02e762c34
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2021-02-02 06:11:14 -06:00
Gage Hugo
6ea15a7f9d Add reno job to Openstack-Helm
With OSH now publishing charts regularly with each change, there
needs to be a way to track these changes in order to track the
changes between chart versions.

This proposed change adds in a reno check job to publish notes
based from the changes to each chart by version as a way to
track and document all the changes that get made to OSH
and published to tarballs.o.o.

Change-Id: Iff8681c697957e4711754fc20b07fa6b728eb584
2021-01-20 21:47:35 +00:00
Gupta, Sangeet (sg774j)
86c2196679 zuul.d: Adding multinode job
This new job deploys 5 node cluster and deploy train
openstack.

Depends-on: https://review.opendev.org/c/openstack/openstack-helm-infra/+/765588

Change-Id: I9c946d5eab46d6603c9b8ff25dc482b543d236bf
2020-12-28 16:38:32 +00:00
Mohammed Naser
e9d00e7c17 Add openstack-helm chart publish jobs
Depends-On: https://review.opendev.org/762442
Change-Id: If4616b27a579c121972e8e12bdb0554ac584d7ed
2020-11-11 19:23:09 -05:00
Zuul
ca48e44974 Merge "Optimize tls job to reduce build time" 2020-09-17 02:12:29 +00:00
okozachenko
b0c4f7f593 Upgrade train jobs to ussuri
I am gonna use openstack-helm images to run the latest
openstack, ussuri on k8s and so added ussuri zuul ci.
As the first stage, only added for ones which has train
already.

Change-Id: Icd554a0d21f55cd074d1e5c35e1de25e02223cee
2020-09-15 22:47:33 +03:00
Andrii Ostapenko
5f4a385add Optimize tls job to reduce build time
Also run cron job test in parallel with 900-use-it.sh

Change-Id: I79ba1f3d15b3788fc9271d7b0029cc7989055728
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-09-10 22:15:46 +00:00
Andrii Ostapenko
25a02b797f
Add force cron jobs test run
Change-Id: Iba1045e8b8a992c77449c77a16d410589b7778bc
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-09-10 17:15:26 -05:00
Andrii Ostapenko
4cd0626fb5 Move tls job to gate pipeline
Running it in gates only to at least avoid dramatically impacting
feedback time for check pipeline.

Change-Id: Ic08714615d0c1b1cecc67fa1cd690a63a8a7c5c2
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-09-10 15:59:51 +00:00
Zuul
4eb8c1bed8 Merge "Dont run cert-manager in jobs w/o tls enabled" 2020-08-12 20:48:51 +00:00
Andrii Ostapenko
ba412dec93
Dont run cert-manager in jobs w/o tls enabled
Change-Id: I1bf7d33811417866dd03bbed13dc9ef155b36f18
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-12 13:04:00 -05:00
Andrii Ostapenko
7b7d117378 Run other tests consequently with neutron ones for compute kit
This allows to distribute memory spike caused by running all tests
in parallel, decreasing a chance of oom.

Was:
--------------------- neutron tests ---------------------
--- nova tests ---
--- keystone tests ---
--- glance tests ---

Now:
--------------------- neutron tests ---------------------
--- nova tests --- --- keystone tests --- --- glance tests ---

Change-Id: I5c625f075a27ac08c8d72c8da52ae7b85f3f202f
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-12 03:47:36 +00:00
Andrii Ostapenko
5dfb1ec9ee Increase timeout for neutron helm tests run in parallel
On small part of oversubscribed executors it takes longer than 15
minutes to run neutron helm tests if it's run in parallel with others.

Change-Id: I56a436b3442c5102d6d2e67ef0cd1e035ebca109
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-12 01:05:37 +00:00
Andrii Ostapenko
676c72a52d
Add missing parameter to tls job
Change-Id: Iaec6c51c647a9e522346222464ab71ff73fb5083
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-10 23:04:10 -05:00
Andrii Ostapenko
d996fde657
Switch from 32GB to 16GB nodes for jobs requiring more ram
Also use osh-infra-gate-runner for tls job instead of non-existent
osh-gate-runner.

Change-Id: I3c1105422307fda5b014fc17bcdfe24999ce97eb
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-07 18:39:36 -05:00
Andrii Ostapenko
f3ed377cbc Parallelize helm test run for compute-kit
Depends-On: https://review.opendev.org/742499
Change-Id: Iebc74280f5fd6302723caa325603645a2f9755dc
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-06 00:51:29 +00:00
Andrii Ostapenko
fa0b3d3ebe Parallelize osh-gate-runner for gate jobs
Depends-On: https://review.opendev.org/739659
Change-Id: I925773d9e93ec3cc90fbd14cffa7c8d8738ce8d5
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-06 00:51:23 +00:00
Chinasubbareddy Mallavarapu
59dac81fd4 [CEPH] Update ceph scripts to create loopback devices
This is to update ceph scripts to create loopback devices
in single script and also to update gate scripts.

Change-Id: I937ae79512ffc998d8dbd0b277a611347550044b
2020-07-29 09:51:31 -05:00
Andrii Ostapenko
67acec14cd Refactor to support jobs invocations from other projects
Switch osh fuctional jobs to osh-infra-job-runner playbook inheriting
from openstack-helm-infra-functional.
Specify gate_scripts_relative_path var for each job to support the
case when corresponding jobs defined in osh are invoked from another
project to allow playbook know where to look for gate scripts.

Depends-On: https://review.opendev.org/740557
Change-Id: I315f04ef7bdf5bf97d09843de8f878e2d15377dc
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-12 03:19:39 +00:00
Tin Lam
918a307427 feat(tls): add tls support to openstack services
This patch set enables TLS for the following OpenStack services: keystone,
horizon, glance, cinder, heat, nova, placement and neutron for s- (stein)
and t- (train) release. This serves as a consolidation and clean up patch
for the following patches:

[0] https://review.opendev.org/#/c/733291
[1] https://review.opendev.org/#/c/735202
[2] https://review.opendev.org/#/c/733962
[3] https://review.opendev.org/#/c/733404
[4] https://review.opendev.org/#/c/734896

This also addresses comments mentioned in previous patches.

Co-authored-by: Gage Hugo <gagehugo@gmail.com>
Co-authored-by: sgupta <sg774j@att.com>

Depends-on: https://review.opendev.org/#/c/737194/

Change-Id: Id34ace54298660b4b151522916e929a29f5731be
Signed-off-by: Tin Lam <tin@irrational.io>
2020-07-10 09:36:31 -05:00
Gage Hugo
6027ac0c0c Cleanup zuul checks
This change moves the tungsten fabric check down to the periodic
checks with the other feature overrides, removes several duplicate
checks that are currently non-functional, and moves the rest to
experimental.

Also moves the compute-kit jobs back to using the default
single-node nodeset due to cloudedge going down and not
enough available 32gb nodes as a result

Change-Id: Ib4f314d5246af8756611346ed4919492d98510a5
2020-07-09 18:38:56 +00:00
Zuul
135e2c8b64 Merge "Add TungstenFabric compatibility to charts" 2020-07-08 13:47:49 +00:00
Chinasubbareddy Mallavarapu
a385c18176 [CEPH] OSH: use loopback devices for ceph osds.
- This is to make use of loopback devices for ceph osds since
support for directory backed osds going to depricate.

- Move to bluestore from filestore for ceph-osds.

Change-Id: Ia95c9ceb81f7d253dd582a2e753a6ed8fe60a04d
2020-06-30 17:05:22 -05:00
OlegBravo
4f2eb8cac6 Add TungstenFabric compatibility to charts
The charts changes are required for deployment
of various clouds based on Tungsten Fabric SDN.
Right now it's tested for Airship-in-a-bottle.

The code cannot be tested currently in
OpenStack Helm project because of absence of
tests and platform for that.

This patchset doesn't have Heat-related changes,
they'll be added later.

Change-Id: I73f2ced2b09dbb93146334b59fe4571fa13dbfb0
Depends-On: https://review.opendev.org/#/c/734635/
2020-06-26 10:39:20 +03:00
Andrii Ostapenko
81884d8a60
Switch compute-kit jobs to 32GB nodes
We're running compute kit jobs on the edge of current flavor
capabilities and actually exceeding it with TLS enabled.
With this change compute kit TLS commit successfully pass check
jobs.

Change-Id: Ide1a1600f2e19fcb91ec7d90c8f316283b2d9697
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-06-21 18:14:59 -05:00
Tin Lam
26c795aa0d feat(tls): adding cert manager to gate
Change-Id: I913c9de3bd405ecd4482c6d455c9c7399e64f95a
Signed-off-by: Tin Lam <tin@irrational.io>
2020-05-20 19:59:58 +00:00
diwakar thyagaraj
a61050c2b3 Enable Apparmor to init containers for Heat Components
Also added Ingress apparmor Fix.

Change-Id: I6f4a1e6778b16c855072c0d6583e61af86f252a6
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-05-07 08:30:28 -05:00
Tin Lam
4675f69d39 Cleanup OSH infra jobs
This patch set cleans up and moves some jobs to experimental and
periodic to reduce the resources need on infra.

Change-Id: I7567b57521a36e7da6490c4e65522b32eccf5a51
Signed-off-by: Tin Lam <tin@irrational.io>
2020-04-03 09:10:50 -05:00
dt241s@att.com
1c46490094 Enable Apparmor to Cinder
Co-Authored by gage Hugo <gagehugo@gmail.com>.

This Patchset creates Zuul Gate Jobs for apparmor to support Cinder.

Change-Id: I7705512a3b50560b183e19f0868be40078241cdd
2020-04-01 04:27:56 +00:00
Gage Hugo
a23f0c4d5b Only run horizon check for horizon changes
This change sets the files attribute for the zuul job that runs
the horizon check to only run that check when a file change is made
under the horizon chart directory.

Change-Id: I3703b39216d6139f28d00b7fc0bf098514bdbe6d
2020-03-28 23:04:38 +00:00
rajesh.kudaka
78d1624ad3 Add netpol value overrides for placement chart
Change-Id: Iea52d94a1b5cf1db41ce694349e49e6311a47333
2020-03-19 16:53:37 +00:00