70 Commits

Author SHA1 Message Date
Vladimir Kozhukalov
58facb9e50 Fix ceph deployment
When deploy ceph on loop devices we need lvm2
to be installed on the host to create necessary
device links like /dev/<vgname>/<lvname>

Change-Id: Ice7031da38009e913cd43b95398218d25dc97930
2023-02-20 19:15:01 +03:00
Terekhin, Alexey (at4945)
9216563be2 Fix for creation endpoins and services when v1/v2 are disabled.
Change-Id: I187e882c653c93ad4e1ef83a88ac4fcc3e60f763
2023-01-19 14:09:43 -08:00
Kostiantyn Kalynovskyi
18fdc30961 Create cron jobs idempotently
Change-Id: Ib7d74ed3b202237027e6da9908c257e81c8cfc25
2022-07-15 20:20:14 +00:00
v-vamshiko
fde7d03e89 Adding python3-dev and net-tools to install-packages.sh
Adding python3-dev for openstack cli. Adding net-tools for route.
As some environments do not have these packages installed, we are making
sure these are added by updating install-package.sh.

Change-Id: I95f26fdca3c9a8d8412831f44ba84051bb4b9c91
2022-06-27 12:19:01 -07:00
Gage Hugo
1282d02d27 Update default openstack version in scripts
Several of the deployment scripts in the repo are still currently
using stein as their defaults. Since this release is quite old
now, this change bumps the version used to be Xena by default.

Change-Id: Ia5c941fd4adab9f9bf12c298497181580891a612
2022-06-14 02:21:31 +00:00
Graham Steffaniak
1157d95b71 Create Openstack common components umbrella chart
ADD openstack chart with values_overrides
    * rabbitmq
    * mariadb
    * memcached
    * keystone
    * heat
    * glance

    This adds umbrella chart that references other charts via
    symlink and include global values.

    Because chart valeus_overrides yaml apply to the main chart,
    the umbrella chart has a chart-scoped replacement

  ADD openstack.sh deploy script
    This script deploys all components with a single release.

  ADD corresponding release notes

  CHG wait-for-pods-sh to accept timeout arguement

  CHG get-values-overrides.sh to modify file path for subchart

Change-Id: I25cd9d6785c61540d6329657c0358f27299d3647
2022-04-05 09:47:06 -05:00
Gage Hugo
402a013e8f Update ceph development scripts
With the move to helm v3, several of the development scripts are
either out of date or are linked to ones that are. This change
updates several of the symlinks and scripts that exist under
the ceph development directory to bring them up-to-date with
the current state of the repository.

Change-Id: I15b431d5301d47c6c83513e356c0c819d2c50963
2022-02-28 01:56:55 +00:00
Gage Hugo
5345b2a812 Reduce duplicated memcache scripts
This change reduces the amount of scripts used to deploy memcache
down to one by removing a duplicate and pointing the symlink
to the component script.

Change-Id: Ia127666cf89c8823ffb3ba2b5ebe7d62afa5f82b
2022-01-17 21:20:53 -06:00
Zuul
71de762a28 Merge "Update periodic/experimental jobs to helm v3" 2021-11-18 02:37:40 +00:00
Nafiz Haider
6ec2773c95 Remove cinder v1/v2 defaults
This change removes the cinder v1 and v2 endpoint definitions
from the default values in the cinder chart.

Change-Id: I0ee35ad71c76df157e2c670a7899e4b6c1b91e46
2021-11-15 15:59:06 +00:00
Gage Hugo
b4978e8e60 Update periodic/experimental jobs to helm v3
This change updates the experimental jobs that are
currently working to use helm v3. Later changes should
fix the other issues that they are currently experiencing.

Change-Id: I068a9bb835e1bde4d11d8dee0352c49248c20b15
2021-11-11 23:46:20 +00:00
Gage Hugo
7034968d96 Move check jobs to use helm3
This change migrates the check jobs in OSH to use the
new helm v3 script when deploying kubernetes via
minikube.

This is one step in the move to helm v3. Future changes
will migrate the other jobs.

Change-Id: If741db5997a27ed06584b9af2d50485d8de34a2b
2021-10-29 19:41:25 +00:00
Gage Hugo
f2108855f5 Remove helm status from deployment scripts
With the move to helm v3, helm status requires a namespace to be
specified, but doing so breaks helm v2 compatability. In order
to preserve our gating with both versions of helm while we make
the change from v2 to v3, this change removes the usage of helm
serve in openstack-helm's deployment scripts.

Once we fully move to helm v3, these scripts can be improved and
cleaned up to be more compatible with the new v3 syntax.

Change-Id: I02b6bbf780abf8c8bc7c1783c35d9411d25e18a8
2021-10-10 23:34:17 +00:00
Andrii Ostapenko
3ac3caa013 Add support for Victoria and Wallaby
Defines compute kit and cinder jobs for new releases with
corresponding values overrides.

Disables compute agent list test for Wallaby since related API
is removed [0].

Since Wallaby with switch of osc to sdk '--id auto' is no longer
treated specially in 'openstack flavor create'. The same behavior
can be achieved w/o specifying --id flag for flavor creation [1].

Starting Wallaby 'nova-manage api_db version' returns init version
for empty database greater than 0 [2]. _db-sync.sh.tpl logic prior to
this commit does not work due to this. We need to either remove
(done in current commit) or justify and alter previous logic.

[0] https://review.opendev.org/749309
[1] https://review.opendev.org/750151
[2] https://opendev.org/openstack/nova/src/branch/stable/wallaby/nova/db/sqlalchemy/migration.py#L32

Change-Id: I361431d9aa8c1a06c5d59f479fb161ecd87e2ee2
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2021-08-02 15:46:07 +00:00
Zuul
28dc17d514 Merge "Bug for build helm-toolkit" 2021-03-26 00:17:24 +00:00
jinyuanliu
fd6ad0bab4 Bug for build helm-toolkit
About helm-toolkit chart, you should to path <HELM_CHART_ROOT_PATH> run the script when build helm-toolkit, not here.Otherwise, the old code will not work here.

Change-Id: Ic3ee9209742a74153935faa7de20411461eabef8
2021-03-16 06:10:37 +00:00
jinyuan
876c9a5c1a Fix the error of loops-setup.service
Should be Requires.

Closes-Bug: #1918616
Change-Id: Ia4f59b256ffc6c36b372546968de264a9eceeeb0
2021-03-12 07:18:31 +00:00
Zuul
c659b0fdd6 Merge "Update default overrides for openstack and ubuntu" 2021-03-11 03:53:39 +00:00
Chinasubbareddy Mallavarapu
85627eca0c [ceph] OSH:Make sure loopback devices persistent across reboots
Change-Id: I85e4c29925ac63ea7656901f5b03b919984cf12f
2021-02-22 13:54:39 +00:00
Gage Hugo
01a1ab2ecc Update default overrides for openstack and ubuntu
By default when deploying the openstack AIO, it will deploy
openstack ocata release on ubuntu xenial, which by now is quite
old and largely unsupported. This change updates these default
overrides to train and bionic respectively in order to bring
the default settings to more recent/supported releases.

Change-Id: I9b6e1120101767356413b1341828dc8d39bc9b3c
2021-02-03 19:45:59 +00:00
Andrii Ostapenko
25a02b797f
Add force cron jobs test run
Change-Id: Iba1045e8b8a992c77449c77a16d410589b7778bc
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-09-10 17:15:26 -05:00
Andrii Ostapenko
f3ed377cbc Parallelize helm test run for compute-kit
Depends-On: https://review.opendev.org/742499
Change-Id: Iebc74280f5fd6302723caa325603645a2f9755dc
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-06 00:51:29 +00:00
Zuul
639f15a069 Merge "[CEPH] Update ceph scripts to create loopback devices" 2020-07-29 20:07:24 +00:00
Chinasubbareddy Mallavarapu
59dac81fd4 [CEPH] Update ceph scripts to create loopback devices
This is to update ceph scripts to create loopback devices
in single script and also to update gate scripts.

Change-Id: I937ae79512ffc998d8dbd0b277a611347550044b
2020-07-29 09:51:31 -05:00
Andrii Ostapenko
3aa712e818
Use default stein OPENSTACK_RELEASE for client setup
Change-Id: I07dfb5bb55a86b34ff0c1af3b5c183efdc0c892a
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-27 15:12:52 -05:00
Chinasubbareddy Mallavarapu
385c0775b9 [CEPH] Update dev scripts for ceph to handle loopback devices
This is to update loopback devices creation script to take device names
from developers in case if default devices are busy.

Change-Id: Ie368ebdfdc64ea00ccf62cf61010beddcc2cf4ce
2020-07-21 21:46:18 +00:00
Andrii Ostapenko
dac7c4f8bd Specify OPENSTACK_RELEASE for setup-client.sh constraints
Also include ensure-pip role to functional jobs.

Depends-On: https://review.opendev.org/741485
Change-Id: I68fd85ada78cd41108c2f292a8cb9a237cd79e8d
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-19 00:09:33 +00:00
Tin Lam
918a307427 feat(tls): add tls support to openstack services
This patch set enables TLS for the following OpenStack services: keystone,
horizon, glance, cinder, heat, nova, placement and neutron for s- (stein)
and t- (train) release. This serves as a consolidation and clean up patch
for the following patches:

[0] https://review.opendev.org/#/c/733291
[1] https://review.opendev.org/#/c/735202
[2] https://review.opendev.org/#/c/733962
[3] https://review.opendev.org/#/c/733404
[4] https://review.opendev.org/#/c/734896

This also addresses comments mentioned in previous patches.

Co-authored-by: Gage Hugo <gagehugo@gmail.com>
Co-authored-by: sgupta <sg774j@att.com>

Depends-on: https://review.opendev.org/#/c/737194/

Change-Id: Id34ace54298660b4b151522916e929a29f5731be
Signed-off-by: Tin Lam <tin@irrational.io>
2020-07-10 09:36:31 -05:00
Chinasubbareddy Mallavarapu
a385c18176 [CEPH] OSH: use loopback devices for ceph osds.
- This is to make use of loopback devices for ceph osds since
support for directory backed osds going to depricate.

- Move to bluestore from filestore for ceph-osds.

Change-Id: Ia95c9ceb81f7d253dd582a2e753a6ed8fe60a04d
2020-06-30 17:05:22 -05:00
Gage Hugo
3a3cabc3b8 Add python3-pip to list of installed packages
OSH requires pip3 to install the openstackclient, and a recent
change in infra made the images no longer contain
pip by default. This change adds python3-pip in order to address
this.

Change-Id: I32febc7194ced6ab88794c6ac9fa2aa373909827
2020-06-17 16:02:11 +00:00
Gage Hugo
db79e79788 Remove OSH Authors copyright
The current copyright refers to a non-existent group
"openstack helm authors" with often out-of-date references that
are confusing when adding a new file to the repo.

This change removes all references to this copyright by the
non-existent group and any blank lines underneath.

Change-Id: Ia035037e000f1bf95202fc07b8cd1ad0fc019094
2020-04-03 20:53:32 +00:00
Tin Lam
d0621d83bd [Gate] Fix failure
This patch set moves pip/2 to pip/3. This also removed a cap of
cmd2 package.

Change-Id: Ia0e377092d71416e96926215fe109cfbf54bc4ed
Signed-off-by: Tin Lam <tin@irrational.io>
2020-03-28 03:32:04 -05:00
sg774j
f76a3f5e0a Heat: Add ingress network policy overrides
This patch set adds in default heat ingress overrides.

Change-Id: I4e1f2b6687a05f2bf3ca91c941c2cf11abe68f07
2020-03-19 09:08:14 +00:00
Huang, Sophie (sh879n)
c9f506eee1 Tools: Update test-networkpolicy.sh
This patch set adds ingress network policy testcases for mariadb
in openstack namespace.

Depends-On: https://review.opendev.org/#/c/687162/
Change-Id: Ia2bc596baf623ef3f747fbd0534c8e058e1571f8
2020-03-18 15:40:40 +00:00
sg774j
86ae6d177a Tools: Update test-networkpolicy.sh
This adds network policy testcases for memcached in openstack
namespace.

Depends-On: https://review.opendev.org/#/c/685755/
Change-Id: I99a0598172453692817420ddefd8653f292124d9
2020-03-17 19:16:28 +00:00
songgongjun
9b74750a3c Replace "make all" in setup-client.sh
setup-client.sh is the script which setups the openstack client.
This script is referenced in the installation guide and many CI
jobs. More than installing the openstack client, the script builds
all the charts by calling `make all`. This script is also called in
openstack-helm-infra project CI job[1]. The `make all` may break the
CI at some situations. For example in the following case:

We make some changes of helm-toolkit to enhancement a tool function.
In the enhancement the function parameters are changed. At this
moment, we can't build some up-layer charts, because they call the
function with old parameters.

Actually, we don't have to make all in the setup-client.sh as we
build every single chart when we install the component. We just need
to build the helm-toolkit here. So this patch is to replace the
`make all` with `make helm-toolkit`

[1] https://github.com/openstack/openstack-helm-infra/blob/master/zuul.d/jobs.yaml#L314

Story: 2007291
Task: 38822

Change-Id: If5efb1a108a36281f2459594ba6424491d909580
Signed-off-by: songgongjun <gongjun.song@intel.com>
2020-02-24 17:07:59 +08:00
Gayathri Kathiri
6c65d21e94 Add Glance ingress network policy overrides
This patch set introduces the ingress network policy overrides
for Glance.

Change-Id: I2b28445dd6f0d2f1f8238d0d4bc1804136c92346
2020-01-09 12:06:14 +00:00
Tin Lam
5057052c70 Fix feature gate envvar overriding
Currently using envsubst to perform substitution of value overrides in
the feature gate caused conflicts as gotpl gets templated into those
overrides. This adds in '%%%REPLACE_${var}%%%' and uses sed to perform
the substitution instead to address the issue.

This is to achieve parity with OSH-infra patch in [0].

[0] https://review.opendev.org/#/c/697749/

Depends-On: https://review.opendev.org/#/c/697749

Change-Id: I3ed504c65900e7b84728019f3acdf706a40c0427
Signed-off-by: Tin Lam <tlam@omegaprime.dev>
2019-12-17 09:49:38 +00:00
Tin Lam
a25eccb7cb Implements egress network policy
This patch set adds in the egress policy for core OpenStack Services.

Depends-On: https://review.opendev.org/#/c/679853/

Change-Id: I585ddabcbd640db784520c913af8eddecaee3843
Signed-off-by: Tin Lam <tlam@omegaprime.dev>
2019-11-22 01:16:49 +00:00
Tin Lam
feb97a2dc3 Add horizon ingress override
This patch set adds in default horizon ingress overrides.

Change-Id: I5a7e8197b84bc5f1ad94d5d6a1d0662257404994
Signed-off-by: Tin Lam <tin@irrational.io>
2019-10-16 02:46:28 +00:00
Huang, Sophie (sh879n)
313fe0ca3e Add keystone ingress netpol
Change-Id: I75874b475039c1f7469f11e02e2231254cc9d8ca
Signed-off-by: Huang, Sophie (sh879n) <sh879n@att.com>
2019-10-08 10:41:38 -05:00
Zuul
24f9b2322a Merge "Add network policy nonvoting checks" 2019-09-27 14:06:26 +00:00
Gage Hugo
c3e085b800 Add network policy nonvoting checks
This change adds two network policy zuul checks, one for the compute-kit,
and one for cinder/ceph, to test network policy for each OpenStack
service. These checks will be non-voting initially.

The network policy rules for each service will initially allow all
traffic. These ingress/egress rules will be defined in future changes
to only explicitly allow traffic between services that are explicitly
allowed to communicate, other traffic will be denied.

Depends-On: https://review.opendev.org/#/c/685130/

Change-Id: Ide2998ebb2af2832f24ca7abc398a82e4a6d70e3
2019-09-26 11:57:15 -05:00
Andrii Ostapenko
09e1f524d4 Use configurable constraints to install clients
Change-Id: Ieb397a688907cc20b8fffafec01416ff9fb68515
2019-09-16 16:39:54 -05:00
Zuul
8b1d5016e8 Merge "Remove network policy override from memcache script" 2019-09-13 18:44:17 +00:00
Gage Hugo
fc5be700a3 Remove network policy override from memcache script
This change removes the network policy overrides that are set in
the common memcache setup script. These override will be implemented
in a future change as part of the rest of the network policy work.

Change-Id: I8954b6d88a650a576208e33b6e6e6ef00bdbef66
2019-09-03 15:12:10 -05:00
Andrii Ostapenko
10ef2bf27a Add components overrides retrieval to developer scripts
Change-Id: Id48c4a920f9463cd0b0283a13b0389e0927851a2
2019-08-30 14:54:56 +00:00
Pete Birley
cede6c0d48 Gate: Simpler multiple distro/over-ride support
This PS indroduces a simpler way to incorp over-rides into gate
runs, and also ensures that they are scoped to a single chart, rather
than all of the charts deployed within a gate run.

Depends-On: https://review.opendev.org/666957

Change-Id: I49edf52cc1fc5ec60ee9754c28880c9c0c54492e
Signed-off-by: Pete Birley <pete@port.direct>
2019-06-25 13:16:37 +00:00
Jiří Suchomel
295475481f Report the reason why the script hits a timeout.
Also small code cleanup and bit more consistency to the commands
and variables.

Change-Id: I7bb1a9e3bafc105c17010dc145adfb3a166e945e
2019-03-04 15:53:58 +01:00
Steve Wilkerson
e8e0d30e7b Use minikube deployment for single node gates
This updates the single node jobs to use the recently
added minikube deployment, with the intent to reduce
overall runtime for the single node jobs

Change-Id: I6efdbf890d86bf916cef2d1a3b7eba1f6132c2f9
2018-12-04 12:36:57 -06:00