637 Commits

Author SHA1 Message Date
Andrii Ostapenko
dac7c4f8bd Specify OPENSTACK_RELEASE for setup-client.sh constraints
Also include ensure-pip role to functional jobs.

Depends-On: https://review.opendev.org/741485
Change-Id: I68fd85ada78cd41108c2f292a8cb9a237cd79e8d
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-19 00:09:33 +00:00
Zuul
8c9b9a63bf Merge "Refactor to support jobs invocations from other projects" 2020-07-16 15:31:11 +00:00
Andrii Ostapenko
f305793243 Fix security context for glance rally tests
Also enable glance helm tests for gates.
Temporary replaces cirros url to mirror due to [0]

[0] https://bugs.launchpad.net/rally/+bug/1887705

Change-Id: I21ceba857c375c1de054e69cf84449e02881b0ce
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-15 18:36:48 +00:00
Andrii Ostapenko
67acec14cd Refactor to support jobs invocations from other projects
Switch osh fuctional jobs to osh-infra-job-runner playbook inheriting
from openstack-helm-infra-functional.
Specify gate_scripts_relative_path var for each job to support the
case when corresponding jobs defined in osh are invoked from another
project to allow playbook know where to look for gate scripts.

Depends-On: https://review.opendev.org/740557
Change-Id: I315f04ef7bdf5bf97d09843de8f878e2d15377dc
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-12 03:19:39 +00:00
Andrii Ostapenko
44d263b2bf Enable templates linting
- braces
- brackets
- colons
- commas
- comments
- hyphens
- indentation
- key-duplicates

with corresponding code changes.

Also disable enforcement for document-(start|end) rules and
disables warnings to increase readability.

* Unrestrict octal values rule since benefits of file modes readability
  exceed possible issues with yaml 1.2 adoption in future k8s versions.
  These issues will be addressed when/if they occur.

Change-Id: Ic5e327cf40c4b09c90738baff56419a6cef132da
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-07-11 00:52:51 +00:00
Tin Lam
918a307427 feat(tls): add tls support to openstack services
This patch set enables TLS for the following OpenStack services: keystone,
horizon, glance, cinder, heat, nova, placement and neutron for s- (stein)
and t- (train) release. This serves as a consolidation and clean up patch
for the following patches:

[0] https://review.opendev.org/#/c/733291
[1] https://review.opendev.org/#/c/735202
[2] https://review.opendev.org/#/c/733962
[3] https://review.opendev.org/#/c/733404
[4] https://review.opendev.org/#/c/734896

This also addresses comments mentioned in previous patches.

Co-authored-by: Gage Hugo <gagehugo@gmail.com>
Co-authored-by: sgupta <sg774j@att.com>

Depends-on: https://review.opendev.org/#/c/737194/

Change-Id: Id34ace54298660b4b151522916e929a29f5731be
Signed-off-by: Tin Lam <tin@irrational.io>
2020-07-10 09:36:31 -05:00
Zuul
135e2c8b64 Merge "Add TungstenFabric compatibility to charts" 2020-07-08 13:47:49 +00:00
Chinasubbareddy Mallavarapu
a385c18176 [CEPH] OSH: use loopback devices for ceph osds.
- This is to make use of loopback devices for ceph osds since
support for directory backed osds going to depricate.

- Move to bluestore from filestore for ceph-osds.

Change-Id: Ia95c9ceb81f7d253dd582a2e753a6ed8fe60a04d
2020-06-30 17:05:22 -05:00
OlegBravo
4f2eb8cac6 Add TungstenFabric compatibility to charts
The charts changes are required for deployment
of various clouds based on Tungsten Fabric SDN.
Right now it's tested for Airship-in-a-bottle.

The code cannot be tested currently in
OpenStack Helm project because of absence of
tests and platform for that.

This patchset doesn't have Heat-related changes,
they'll be added later.

Change-Id: I73f2ced2b09dbb93146334b59fe4571fa13dbfb0
Depends-On: https://review.opendev.org/#/c/734635/
2020-06-26 10:39:20 +03:00
Andrii Ostapenko
41a6fa26e4
Fix developer compute-kit.sh script
Release overrides are not applied in component script if invoked from
developer ceph one because OSH_EXTRA_HELM_ARGS_NOVA is not empty.

Change-Id: Ic4eb1cf6115b740b59922272a789e37b683cb44e
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-06-25 21:56:35 -05:00
Ahmad Mahmoudi
0a91e260bc (fix) Changed pip to pip3
Changed pip to pip3 to address zuul gate issues.

Change-Id: I811fdefa258550b569977000e9b974d17e7be333
2020-06-18 05:20:14 +00:00
Gage Hugo
3a3cabc3b8 Add python3-pip to list of installed packages
OSH requires pip3 to install the openstackclient, and a recent
change in infra made the images no longer contain
pip by default. This change adds python3-pip in order to address
this.

Change-Id: I32febc7194ced6ab88794c6ac9fa2aa373909827
2020-06-17 16:02:11 +00:00
KHIYANI, RAHUL (rk0850)
d6a3a62c54 adding python3-pip package to installation script
python3-pip package is required to support openstack-client

Change-Id: Iccfc52d8ec0577f656c5d06fef43240b33c49c4d
2020-06-12 16:07:30 +00:00
Gayathri Devi Kathiri
16ea83e11c Remove remaining test pods before new test run
If the test pod still exists, then the new test run
fails with ERROR: pods "abc-test" already exists

So, Removing remaining test pods before new test run

Change-Id: I447d2b56b1419086b99df47b6605d0a95e1a9239
Closes-Bug: #1882030
2020-06-04 08:52:51 +00:00
Zuul
ae9632177f Merge "feat(tls): add additional parameters to chart deployment" 2020-06-02 19:08:16 +00:00
Tin Lam
19f79aba19 feat(tls): add additional parameters to chart deployment
This patch set adds in two additional parameters to:

a. establish ownership between certificate and secret so secrets can be
   cleaned up when the certificate is deleted as part of a helm release
b. add the ability to always issue new tls.key as part of the key
   rotation when the secret gets regenerated for any reason.

This also adds linebreaks for readability.

Change-Id: Id40d504251bbd98c32a7d9baa3dbe9858ad495cb
Signed-off-by: Tin Lam <tin@irrational.io>
2020-06-02 10:15:47 -05:00
diwakar thyagaraj
477602f2e7 Enable Apparmor to osh test Pods
Change-Id: I0a67f66cc4ed8a1e3a5c3c458b7c1521f9169160
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-06-01 18:32:51 +00:00
Tin Lam
3da6d34ff2 feat(tls): update cert-manager version
This patch set updates the cert-manager.io version from v1alpha2 to
v1alpha3.

Change-Id: Ib9904f9f2c1f3fa426c852b012307cf7aed266e7
Signed-off-by: Tin Lam <tin@irrational.io>
2020-05-23 05:10:50 -05:00
Zuul
3af196f578 Merge "feat(tls): adding cert manager to gate" 2020-05-21 16:05:39 +00:00
Tin Lam
26c795aa0d feat(tls): adding cert manager to gate
Change-Id: I913c9de3bd405ecd4482c6d455c9c7399e64f95a
Signed-off-by: Tin Lam <tin@irrational.io>
2020-05-20 19:59:58 +00:00
Tin Lam
e70e85ecbc chore(images): remove duplicate images
All the Dockerfiles have been moved to openstack-helm-images project
where it is better supported. The old Dockerfiles in the tools/images
folder should be removed to reduce confusion. Users should be using
the ones in openstack-helm-images project.

Change-Id: Ife430a54806885220d25f426bac68ef87b9035d3
Signed-off-by: Tin Lam <tin@irrational.io>
2020-05-20 02:33:39 +00:00
Zuul
302310b802 Merge "Separate placement deployment for Stein" 2020-05-20 01:33:34 +00:00
Andrii Ostapenko
750bb939d9 Add proper chart path for ingress deployment script
Change-Id: I79058dc00764494d6ea37d430529b1c06b49434f
2020-05-18 18:07:57 -05:00
diwakar thyagaraj
a61050c2b3 Enable Apparmor to init containers for Heat Components
Also added Ingress apparmor Fix.

Change-Id: I6f4a1e6778b16c855072c0d6583e61af86f252a6
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-05-07 08:30:28 -05:00
Tin Lam
0d36c8c081 Separate placement deployment for Stein
This patch changes the default stein deployment to use a
separate placement service chart deployment, rather than
using nova.

Change-Id: I73fe9577468e28a129332a1415b877a505ac204e
Signed-off-by: Tin Lam <tin@irrational.io>
2020-05-03 13:00:42 +00:00
Andrii Ostapenko
8ecc724788 Reuse component compute-kit.sh in developer installation
Change-Id: I18fa34d1ae59165c2b851946cf21112beac22958
2020-04-08 16:41:56 +00:00
Gage Hugo
db79e79788 Remove OSH Authors copyright
The current copyright refers to a non-existent group
"openstack helm authors" with often out-of-date references that
are confusing when adding a new file to the repo.

This change removes all references to this copyright by the
non-existent group and any blank lines underneath.

Change-Id: Ia035037e000f1bf95202fc07b8cd1ad0fc019094
2020-04-03 20:53:32 +00:00
Tin Lam
d0621d83bd [Gate] Fix failure
This patch set moves pip/2 to pip/3. This also removed a cap of
cmd2 package.

Change-Id: Ia0e377092d71416e96926215fe109cfbf54bc4ed
Signed-off-by: Tin Lam <tin@irrational.io>
2020-03-28 03:32:04 -05:00
Zuul
2a05d4ec05 Merge "Heat: Add ingress network policy overrides" 2020-03-19 23:05:11 +00:00
Zuul
c7c7ab00bd Merge "Disable seperate placement deployment in stein" 2020-03-19 16:17:35 +00:00
sg774j
f76a3f5e0a Heat: Add ingress network policy overrides
This patch set adds in default heat ingress overrides.

Change-Id: I4e1f2b6687a05f2bf3ca91c941c2cf11abe68f07
2020-03-19 09:08:14 +00:00
Huang, Sophie (sh879n)
c9f506eee1 Tools: Update test-networkpolicy.sh
This patch set adds ingress network policy testcases for mariadb
in openstack namespace.

Depends-On: https://review.opendev.org/#/c/687162/
Change-Id: Ia2bc596baf623ef3f747fbd0534c8e058e1571f8
2020-03-18 15:40:40 +00:00
rajesh.kudaka
280da52425 Disable seperate placement deployment in stein
This commit is to deploy placement service as a part
of nova chart for stein release. This also enables
seperate placement chart deployment for train release.

Change-Id: Ie22dbf85a3ed42bc0cd13579218e03d5912e67ea
2020-03-18 09:43:31 +00:00
sg774j
86ae6d177a Tools: Update test-networkpolicy.sh
This adds network policy testcases for memcached in openstack
namespace.

Depends-On: https://review.opendev.org/#/c/685755/
Change-Id: I99a0598172453692817420ddefd8653f292124d9
2020-03-17 19:16:28 +00:00
Gage Hugo
1d81e56bdf Define ceph-mon in overrides
This ps overrides the ceph-mon in the ceph-ns-activate script
to fix a current issue with the cinder gates.

Change-Id: I29a69fd7bbf19a7a4890c76366592a44528e3cc1
2020-03-06 10:28:51 -06:00
Zuul
f24e4dd0e5 Merge "Replace "make all" in setup-client.sh" 2020-03-02 18:00:16 +00:00
Zuul
a5ffce4327 Merge "Add placement chart" 2020-02-28 20:14:30 +00:00
songgongjun
9b74750a3c Replace "make all" in setup-client.sh
setup-client.sh is the script which setups the openstack client.
This script is referenced in the installation guide and many CI
jobs. More than installing the openstack client, the script builds
all the charts by calling `make all`. This script is also called in
openstack-helm-infra project CI job[1]. The `make all` may break the
CI at some situations. For example in the following case:

We make some changes of helm-toolkit to enhancement a tool function.
In the enhancement the function parameters are changed. At this
moment, we can't build some up-layer charts, because they call the
function with old parameters.

Actually, we don't have to make all in the setup-client.sh as we
build every single chart when we install the component. We just need
to build the helm-toolkit here. So this patch is to replace the
`make all` with `make helm-toolkit`

[1] https://github.com/openstack/openstack-helm-infra/blob/master/zuul.d/jobs.yaml#L314

Story: 2007291
Task: 38822

Change-Id: If5efb1a108a36281f2459594ba6424491d909580
Signed-off-by: songgongjun <gongjun.song@intel.com>
2020-02-24 17:07:59 +08:00
zhipengl
4925e1c47e Add placement chart
This commit adds a helm chart to deploy placement.

Related test pass on simplex and multi-node setup

Story: 2005799
Task: 33532

Depends-On: https://review.opendev.org/#/c/672678/

Change-Id: Ife908628c6379d2d39d15f72073da3018cc26950
Signed-off-by: zhipengl <zhipengs.liu@intel.com>
Co-Authored-By: Jean-Philippe Evrard <jean-philippe@evrard.me>
2020-02-20 08:27:51 +00:00
Gage Hugo
5a50a9c136 Map LDAP groups in keystone
This change adds in the mapping for LDAP groups to be mapped
to groups within keystone. Also adds a group list check to make
sure that groups are correctly mapped.

Change-Id: Ib3b00d3f801ba975202a921643510fcb642e0a90
2020-02-17 18:58:25 +00:00
Zuul
a7fcc03112 Merge "Move apparmor to use feature gates" 2020-02-04 17:31:04 +00:00
Gage Hugo
a1fc694ae9 Move apparmor to use feature gates
This change refactors the apparmor job to utilize the feature
gates system instead of relying on separate scripts.

Also disabled barbican running in the apparmor job temporarily
until the correct profile gets used and it can deploy
succesfully.

Change-Id: Iadacd214de3fdb06e4acde4433c5fa86973371d5
2020-01-31 22:24:55 +00:00
Tin Lam
b17b378390 Add rally clean up script
This patch set adds in a script that cleans up orphaned or
lingering rally helm test pods.

Depends-On: https://review.opendev.org/#/c/683759/

Change-Id: I94fc8d067b421248cf74fe40b2e8520f63d4417c
Signed-off-by: Tin Lam <tin@irrational.io>
2020-01-31 19:18:01 +00:00
Phil Sphicas
1355197820 barbican: add a deployment script
Adds a barbican deployment script that picks up the desired overrides.

Change-Id: I020632ad6a33d29a657164cf0e32baef6b670d5a
2020-01-16 17:59:09 -06:00
Zuul
9ded66d17f Merge "Add Glance ingress network policy overrides" 2020-01-13 21:07:29 +00:00
Gayathri Kathiri
6c65d21e94 Add Glance ingress network policy overrides
This patch set introduces the ingress network policy overrides
for Glance.

Change-Id: I2b28445dd6f0d2f1f8238d0d4bc1804136c92346
2020-01-09 12:06:14 +00:00
Pete Birley
c31f561641 Gate: Support AIO deployments when multiple default routes present
This PS updates the gateway setup script to support deployments where
multiple default routes may be present, eg when connecting to a vpn.

Change-Id: I5fe86e9471ecb6a9c80e1e4f942822cac00da669
Signed-off-by: Pete Birley <pete@port.direct>
2020-01-08 20:36:55 +00:00
Tin Lam
bf434ffd67 Add capability for using FQDN in nova compute
This patch set adds in a capability for the user to defaultly use a
FQDN for the nova compute hostname and the hypervisor hostname when
the host is not explicitly specified in the .Values.conf override.

Change-Id: I3243068dfe91ebb97b3885002296a0f454822ec5
Co-authored-by: Drew Walters <andrew.walters@att.com>
Signed-off-by: Tin Lam <tin@irrational.io>
2020-01-01 20:01:25 +00:00
Zuul
bea2073200 Merge "Add capability to wait on compute nodes" 2019-12-17 17:32:42 +00:00
Tin Lam
5057052c70 Fix feature gate envvar overriding
Currently using envsubst to perform substitution of value overrides in
the feature gate caused conflicts as gotpl gets templated into those
overrides. This adds in '%%%REPLACE_${var}%%%' and uses sed to perform
the substitution instead to address the issue.

This is to achieve parity with OSH-infra patch in [0].

[0] https://review.opendev.org/#/c/697749/

Depends-On: https://review.opendev.org/#/c/697749

Change-Id: I3ed504c65900e7b84728019f3acdf706a40c0427
Signed-off-by: Tin Lam <tlam@omegaprime.dev>
2019-12-17 09:49:38 +00:00