759 Commits

Author SHA1 Message Date
Stephen Taylor
5f645609c8 [Ceph] Add final_osd value to test deployment scripts
The ceph-rbd-pool job is being changed to use the "final_osd"
target instead of the "osd" target to determine if more OSDs than
expected are running. The deployment test scripts therefore must
be updated to include this value.

Change-Id: I63e4a0b3ba58d5ee79cda75bd9e9650d5a49aff5
2022-12-13 14:57:09 -07:00
Zuul
7bb3f30c9d Merge "Deploy placement before nova" 2022-10-24 20:20:16 +00:00
Gage Hugo
ba0b7eeb05 Run 1 replica of rabbitmq in the gate
Occasionally rabbitmq replicas fail to come up when running in
zuul due to resource constraints. This causes random failures
and needless rechecks when it comes up.

This change sets the number of replicas when deploying the compute
kit script to 1 from the default 2.

Change-Id: Icdcc075a88d05f87a7f787d306d6b430485964c9
2022-10-23 20:18:59 -05:00
Gage Hugo
3001bd2750 Deploy placement before nova
With the placement db migrate job removed, we can now deploy
placement ahead of nova. This fixes issues of several nova pods
failing due to placement not being up before nova is.

This change moves the placement service to deploy before nova
in the compute-kit script.

Depends-on: https://review.opendev.org/c/openstack/openstack-helm/+/860975

Change-Id: I62f82224e898761d5b388867c63a259967601d45
2022-10-23 20:13:24 -05:00
sunile
94a8d348a9 Added horizon to install as default component
Added horizon to the openstack umbrella chart to deploy but disabled
by default.

Change-Id: Ia835c0c142d0e0878623af9165d595a386b7c4c2
2022-10-03 16:39:33 +00:00
josebb
41cf532623 Fix indentation of placement value overrides in compute-kit script
Change-Id: Icc58b4399c45400bbc9ad6553ece43c9600e351a
2022-08-11 13:17:09 +00:00
Zuul
ffc9c3788d Merge "make 170-setup-gateway idempotent" 2022-07-25 15:32:53 +00:00
Zuul
2a558fd536 Merge "Dont create openstack objects if they exist" 2022-07-22 16:53:16 +00:00
Dustin Specker
1aadb948aa make 170-setup-gateway idempotent
Before if we tried to add an address that was already added to the
br-ex device the script would error out. Now, use replace which is
idempotent.

Change-Id: I34bbb361c4fa2f347431629f79753f75b458926f
2022-07-22 11:02:11 -05:00
Kostiantyn Kalynovskyi
5644b08c5c Dont create openstack objects if they exist
Change-Id: Ib2d5a4d1dd456d9bf272624295f9ee5ffa2a9035
2022-07-19 16:49:57 +00:00
Zuul
0bc4ad5aee Merge "Create cron jobs idempotently" 2022-07-19 00:59:47 +00:00
Zuul
88b451187e Merge "Add idempotency to setup-gateway.sh" 2022-07-19 00:59:45 +00:00
Kostiantyn Kalynovskyi
18fdc30961 Create cron jobs idempotently
Change-Id: Ib7d74ed3b202237027e6da9908c257e81c8cfc25
2022-07-15 20:20:14 +00:00
Kostiantyn Kalynovskyi
5b6192746a Add idempotency to setup-gateway.sh
Now docker container will not be run if it already
exists.

Change-Id: Ife797c0326d36e4c20a89014621b3a1f111ec51d
2022-07-15 16:30:14 +00:00
Dylan Murphy
a207621467 Add helm dep up before umbrella deploy
This is useful for avoiding using stale dependencies
in local development.

Change-Id: Ifa7af2184de2a707ca0d46308b7d19c9cd10793b
2022-07-11 19:53:01 +00:00
Dylan Murphy
dbe7b30748 upgrading an OSH subchart config only impacts subchart
This verifies that making a configuration change to one of Umbrella's
subcharts results in only the application (DaemonSet, Deployment or
StatefulSet) for that subchart being updated. No other subchart's
application should be updated.

This only validates subcharts from openstack-helm.
Validating the remaining subcharts from openstack-helm-infra has
been done in another commit.

Change-Id: I649dde64313dfaaa7440c86fd50c3882874bf122
2022-07-08 13:12:48 -04:00
Dustin Specker
7a7c533e3e upgrading subchart config only impacts subchart
This verifies that making a configuration change to one of Umbrella's
subcharts results in only the application (DaemonSet, Deployment or
StatefulSet) for that subchart being updated. No other subchart's
application should be updated.

This only validates subcharts from openstack-helm-infra.
Validating the remaining subcharts from openstack-helm will
be done in the future.

OpenStack Umbrella's default values for rabbitmq was configured
to use a host path. This is so rabbitmq retains its data
between StatefulSet changes. Otherwise components fail to authenticate
with rabbitmq after the rabbitmq pods have been recreated. The
OpenStack Umbrella Chart will use the `standard` storage class
by default since that's what is provisioned via minikube.

Change-Id: I8570e32e6ae03563037608d337f31066edf29755
2022-07-06 12:39:33 -05:00
Dustin Specker
078a496937 upgrading umbrella w/o changes has no app changes
If a Helm upgrade is performed on the OpenStack Umbrella chart using
the exact same configuration as the first release, then it's expected
for no DaemonSets, Deployments, or StatefulSets to be updated.
This did not work as expected.

A few changes were required to support this desired behavior:
1. Update glance's configmap-etc.yaml to trim whitespace and convert
   YAML comment to Helm template comment. Before this change, Helm
   rendered the template with the YAML comment and a newline for the
   install phase. On upgrades, Helm rendered the template without the
   YAML comment and newline causing the hash of configmap-etc to change,
   thus causing the glance-api Deployment to update.
2. Update openstack.sh script to create a randomly generated memcache
   secret for glance. Without this change, the glance-api deployment
   changes each time since Helm randomly generates a new memcache
   secret if not provided.

This behavior is enforced via a new test script,
validate-umbrella-upgrade-no-side-effects.sh.

The following jobs are always recreated due to hooks:
- keystone-bootstrap
- keystone-credential-setup
- keystone-db-init
- keystone-db-sync
- keystone-domain-manage
- keystone-fernet-setup
- keystone-rabbit-init
- rabbitmq-cluster-wait

Some Jobs are created via CronJobs and could be created during
validation. So far, heat-engine-cleaner has been seen, but others
could be caught too.

So the validation script ignores these pod changes by ignoring if
Jobs were recreated. Plus Jobs being recreated should not impact
the OpenStack deployment.

Change-Id: Iffaa346d814b8d0a3e2292849943219f70d50a23
2022-06-28 15:55:31 -05:00
Zuul
820788a501 Merge "Adding python3-dev and net-tools to install-packages.sh" 2022-06-28 04:29:47 +00:00
v-vamshiko
fde7d03e89 Adding python3-dev and net-tools to install-packages.sh
Adding python3-dev for openstack cli. Adding net-tools for route.
As some environments do not have these packages installed, we are making
sure these are added by updating install-package.sh.

Change-Id: I95f26fdca3c9a8d8412831f44ba84051bb4b9c91
2022-06-27 12:19:01 -07:00
Zuul
db4ade3f72 Merge "Set libvirt cgroup path to openstack-helm/ if hugepages is enabled on system" 2022-06-27 19:16:03 +00:00
Zuul
aa413cadd8 Merge "Update setup-gateway script to use Xena" 2022-06-14 16:47:56 +00:00
Gage Hugo
1282d02d27 Update default openstack version in scripts
Several of the deployment scripts in the repo are still currently
using stein as their defaults. Since this release is quite old
now, this change bumps the version used to be Xena by default.

Change-Id: Ia5c941fd4adab9f9bf12c298497181580891a612
2022-06-14 02:21:31 +00:00
Gage Hugo
67cf809fcd Update setup-gateway script to use Xena
Currently the 170-setup-gateway.sh script is still hardcoded to
use a train neutron image. This change updates the version to
use the newer Xena image instead.

Change-Id: I0a4a0d81ea9dc041e9095323346c3ea4755d55f5
2022-06-13 21:15:47 -05:00
Dylan Murphy
2129f8ea3d Set libvirt cgroup path to openstack-helm/
if hugepages is enabled on system

Change-Id: If4a28356162027536a84c64b2ebc00988551161d
2022-06-10 16:58:59 -04:00
Dustin Specker
dc0ed0c156 change var name used for nova virt args in umbrella deployment
Before, the script was using OSH_EXTRA_HELM_ARGS to configure
virt_type and cpu_mode. This unfortunately overrode any passed in
OSH_EXTRA_HELM_ARGS.

Now, use OSH_EXTRA_HELM_VIRT_ARGS so users can still specify
OSH_EXTRA_HELM_ARGS when using `openstack.sh`.

Change-Id: I34019f2f751bd2e1bbbfdc0a17b99613e478369c
2022-06-06 16:00:37 -05:00
Graham Steffaniak
2e5b7f9cb7 add compute-kit to openstack umbrella chart
ADD: include new charts to the umbrella chart for comprehensive
     deployment of openstack-helm.

       * openvswitch
       * libvirt
       * neutron
       * nova
       * placement

Change-Id: I78d1c7c629024c3f9530239dff9f8eb9da598764
2022-05-19 17:07:31 -05:00
Dustin Specker
65482ab665 accept ssh diffie-hellman-group1-sha1 and update cert-manager
openssh-client, etc. updated and might not accept these algos by
default. Cirros images should probably be updated at some point to
use a new SSH server.

Update cert-manager to 1.8.0 because [1] changed `deploy-k8s.sh`
to use Kubernetes 1.23 instead of 1.19.

This broke cert-manager as ca-injector had an error of:

Error: error registering secret controller: no matches for kind
"MutatingWebhookConfiguration" in version
"admissionregistration.k8s.io/v1beta1"

This is because admissionregistration.k8s.io/v1beta1 no longer exists
in Kubernetes 1.23.

Upgrade cert-manager so it uses admissionregistration.k8s.io/v1 instead.

1 - https://review.opendev.org/c/openstack/openstack-helm-infra/+/840691

Change-Id: I5ea204bbcd7add2f787df79ac1d996842f4d1fcc
2022-05-13 12:38:43 -05:00
Gage Hugo
d1b72aa35e Remove nova-placement from nova chart
nova-placement has been removed as of train, since we
do not support openstack releases before train, it
is no longer needed. This change removes nova-placement
from the nova chart and all the overrides, as well as
changes the compute-kit scripts to always deploy
the placement chart.

Change-Id: Ic8649371fe9e954806cbe4bf11c589fb58c7a88d
2022-04-07 14:50:29 -05:00
josebb
dec8f64ebc Deploy separate placement always
Older than train releases are not supported by gate already. So no
need to keep cases to deploy placement inside nova helmrelease.
Apart from that, changed the deployment order of nova and placement.

Change-Id: I03f303e8081207e15ecf8424039948305af3bb12
2022-04-06 12:16:32 +03:00
Graham Steffaniak
1157d95b71 Create Openstack common components umbrella chart
ADD openstack chart with values_overrides
    * rabbitmq
    * mariadb
    * memcached
    * keystone
    * heat
    * glance

    This adds umbrella chart that references other charts via
    symlink and include global values.

    Because chart valeus_overrides yaml apply to the main chart,
    the umbrella chart has a chart-scoped replacement

  ADD openstack.sh deploy script
    This script deploys all components with a single release.

  ADD corresponding release notes

  CHG wait-for-pods-sh to accept timeout arguement

  CHG get-values-overrides.sh to modify file path for subchart

Change-Id: I25cd9d6785c61540d6329657c0358f27299d3647
2022-04-05 09:47:06 -05:00
Gage Hugo
f3de6d808a Remove consoleauth in nova
Nova consoleauth was removes several releases ago and most of our
overrides were specifically needing to disable it in order to
deploy. Since it is no longer in nova, this change removes the
nova consoleauth support from the nova chart.

Change-Id: I0a27265330156a11f6049e9beaaa14a38d8a4a93
2022-03-26 18:49:30 -05:00
Gage Hugo
402a013e8f Update ceph development scripts
With the move to helm v3, several of the development scripts are
either out of date or are linked to ones that are. This change
updates several of the symlinks and scripts that exist under
the ceph development directory to bring them up-to-date with
the current state of the repository.

Change-Id: I15b431d5301d47c6c83513e356c0c819d2c50963
2022-02-28 01:56:55 +00:00
Zuul
7c3a9de5aa Merge "Update nfs development scripts" 2022-02-22 08:44:44 +00:00
Zuul
2fc4418033 Merge "Fix failing bandit gate" 2022-02-22 08:44:41 +00:00
Zuul
6174308720 Merge "Remove glance registry" 2022-02-22 08:44:26 +00:00
Gage Hugo
2f89f1d020 Remove glance registry
Glance registry was deprecated in Queens and removed in Stein.
This change removes glance-registry settings and templates
from the glance chart. Also removed the overrides from older
releases that are no longer actively supported and tested.

Change-Id: I704d844b9ab96daa73ec42e29cded31fbbe3f720
2022-02-21 21:32:08 +00:00
Anderson, Craig (ca846m)
3ec6a94276 Fix failing bandit gate
Install bandit version compatible with Python 3.6.9

Change-Id: Ie6d5f343c73ba4df7e061f200d0ae201f65a5aa9
2022-02-20 12:15:19 -08:00
Gage Hugo
0534f0524b Update nfs development scripts
The development scripts are currently pointing to the old helm v2
minikube scripts and as a result, they do not work properly. This
change points them to use the correct up-to-date scripts and is
part of the effort to update and cleanup the deployment scripts
for openstack-helm.

Change-Id: I4797eace5f9f625de886c7abe1111222da2e92f9
2022-02-16 14:26:33 -06:00
jinyuanliu
e56a95b50b The generator parameter has been discarded
Generator parameter has been deprecated since V1.18.0
66944ff3b5

Change-Id: I67ee89e9087bff04e95c44340e9f6ebeeb7a86fa
2022-02-14 03:56:30 -05:00
Gage Hugo
7d718fb5b5 Fix broken bandit gate
The current bandit job appears to be failing due to a dependency
on setuptools. This change adds in a manual install for setuptools
when running the bandit job.

Change-Id: I6d0f5987c4f1a5fe7cfeed3eddb6d21c3040ebb0
2022-01-21 20:53:45 +00:00
Zuul
5b13af166b Merge "Reduce duplicated memcache scripts" 2022-01-21 19:15:29 +00:00
Zuul
39531fb386 Merge "Fix glance-api pod always in init status" 2022-01-19 04:08:30 +00:00
Gage Hugo
5345b2a812 Reduce duplicated memcache scripts
This change reduces the amount of scripts used to deploy memcache
down to one by removing a duplicate and pointing the symlink
to the component script.

Change-Id: Ia127666cf89c8823ffb3ba2b5ebe7d62afa5f82b
2022-01-17 21:20:53 -06:00
Gage Hugo
c0bdc96c40 Remove outdated overrides for glance
The deployment scripts for glance have leftover value settings
from older openstack releases that are no longer supported by
OSH. This change removes those random override values and has
them fallback to the get-values-overrides script.

Change-Id: If348d8be9748c281be27bdf5e8ac37d240d72636
2021-12-14 16:31:39 +00:00
Zuul
71de762a28 Merge "Update periodic/experimental jobs to helm v3" 2021-11-18 02:37:40 +00:00
Nafiz Haider
6ec2773c95 Remove cinder v1/v2 defaults
This change removes the cinder v1 and v2 endpoint definitions
from the default values in the cinder chart.

Change-Id: I0ee35ad71c76df157e2c670a7899e4b6c1b91e46
2021-11-15 15:59:06 +00:00
Gage Hugo
b4978e8e60 Update periodic/experimental jobs to helm v3
This change updates the experimental jobs that are
currently working to use helm v3. Later changes should
fix the other issues that they are currently experiencing.

Change-Id: I068a9bb835e1bde4d11d8dee0352c49248c20b15
2021-11-11 23:46:20 +00:00
Zuul
c74b35e958 Merge "Fix helm test method" 2021-11-10 16:54:50 +00:00
jinyuanliu
b6870e7f4a Fix helm test method about compute-kit
This patch makes the helm test command more standard by calling script of common.

Change-Id: I324c4e8ee8f8cd12bae427511747a91d8d1f8c5a
2021-11-02 02:55:34 -04:00