186 Commits

Author SHA1 Message Date
Steve Wilkerson
0e1dec39d1 Add heat to compute kit and apparmor jobs
This adds the deployment of heat to the compute kit and apparmor
job in order to provide a simple mechanism for booting vms to
validate a functional cloud deployment

Change-Id: I1a0b0fd4fd708a045e82781cfe3990e23d2af581
2019-04-11 20:46:10 +00:00
Steve Wilkerson
61ddb2d87a Add Armada job for testing update of chart passwords
This adds both a periodic and experimental job for deploying Ceph
and the OSH components via Armada. This job will then generate new
passphrases for the OSH components, render an updated manifest for
the OSH components including the new passphrases, then applies the
updated OSH manifest to validate the ability for all deployed
charts to update those passphrases successfully
Change-Id: I42d19bbf8161b60311c4b8101217cdcfbdf6b568
2019-02-06 16:20:16 -06:00
Steve Wilkerson
7c283e7b5d OSH: Add Armada job for testing update of release uuids
This adds both a periodic and experimental job for deploying Ceph
and the OSH components via Armada. This job will then generate a
new release uuid, render an updated manifest for all previously
deployed releases, then apply that manifest to validate the
ability for all deployed charts to update successfully with the
new release uuid annotation

Change-Id: I6f2125f3505904c4714688e7a9900b8d6bea49b4
2019-02-05 08:32:22 -06:00
Zuul
5648754f50 Merge "Update openstack-helm Armada job" 2019-02-04 20:17:16 +00:00
Steve Wilkerson
dc1ef4c138 Update openstack-helm Armada job
This updates the openstack-helm Armada job to instead deploy
only Ceph, the OpenStack service charts, and their dependencies.
This is dependent on the addition of the Armada job for Ceph and
the LMA components to openstack-helm-infra. This also updates the
jobs definition to use the osh-gate-runner playbook instead, as
well as sets the job both to a periodic and experimental job

Depends-On: https://review.openstack.org/#/c/634676/
Depends-On: https://review.openstack.org/#/c/633067/
Change-Id: I7e191a153f123e04e123acc33fb691d8117062a9
2019-02-04 16:46:22 +00:00
Gage Hugo
482dbcac29 Scan templated python files with bandit
This change adds a zuul check job to export any templated python
contained in the helm charts and scan it with bandit for any
potential security flaws.

This also adds two nosec comments on the instances of subprocess
used as they currently do not appear to be malicious, as well
as changing the endpoint_update python code to prevent sql
injection, which satisfies bandit code B608.

Change-Id: I2212d26514c3510353d16a4592893dd2e85cb369
2019-01-22 20:53:52 +00:00
Steve Wilkerson
4822aa729c Armada: Manifest updates for Ocata release
This patchset updates the chart configuration overrides to account
for functionality supported with the move to Ocata over Newton.
This includes updating the OpenStack service logging configuration
to leverage the fluent handler/formatter that was introduced in the
Ocata release, updating Fluentd's configuration to filter out
duplicate logs, tagging logged events with their log level, and
creating separate indexes for the different log types created by
the elasticsearch templates. This also adds support for leveraging
ceph-radosgw's s3 API for Elasticsearch snapshots.

This also removes the barbican chart deployment from the
armada gate, to help alleviate resource consumption.

Change-Id: I45128bf102909e1762b832fc16ad04bedcfe4f00
2018-12-17 10:14:51 -06:00
Steve Wilkerson
8879e6110f Disable gnocchi, ceilometer, mongodb from multinode jobs
This disables the deployment of gnocchi, ceilometer and mongodb
from the multinode job until we can determine the root cause of
the failures in these charts

Change-Id: I8c936cae0b814841da12aabd6d3f95e902912bda
2018-12-14 13:39:51 -06:00
Steve Wilkerson
e633b33e78 Update upgrade host playbook in osh to match osh-infra
This updates the upgrade host playbook in openstack-helm to match
the playbook used in openstack-helm-infra. The recent addition of
adding an apparmor profile to the calico chart requires us to
do the same setup on hosts in the openstack-helm jobs before
attempting to deploy calico

Change-Id: I264ba4ee8a2f24ffcbb36e28f6b91bbc114b406d
2018-12-11 12:10:20 -06:00
Steve Wilkerson
1b7f673d8f Update openstack-helm checks/gates
This begins the reordering of the openstack-helm gates. This
deprecates the single node checks/gates that deployed the entire
stack in favor of single node checks/gates that are focused on
deploying charts with only their dependencies to reduce the
number of checks/gates required for a particular change. This also
moves the armada check to experimental, and moves the multinode
checks/gates to run as periodics. This will be followed up by
additional efforts to streamline these changes and incorporate
previous work targeting the same.

Change-Id: I63b87aceefc79a7a42c325669f2b4e3abb0c961c
2018-12-04 08:39:13 -06:00
Tin Lam
29f32a07ac Enable network policy enforcement
This patch set updates the gate to by default uses network policy
for all components and enforces them in Openstack-helm.

Change-Id: I70c90b5808075797f02670f21481a4f968205325
Depends-On: I78e87ef3276e948ae4dd2eb462b4b8012251c8c8
Co-Authored-By: Mike Pham <tp6510@att.com>
Signed-off-by: Tin Lam <tin@irrational.io>
2018-10-23 14:58:13 +00:00
Jean-Philippe Evrard
05d0e2b4b8 Revert "Update OSH Author copyrights to OSF"
This reverts commit b1755c399341388627a668ab9fd6f43b7416f65a.

Change-Id: I215a172f2ff4220340292b95f5323847944baeb7
2018-08-28 17:25:13 +00:00
Matt McEuen
b1755c3993 Update OSH Author copyrights to OSF
This PS updates the "Openstack-Helm Authors" copyright attribution
to be the "OpenStack Foundation", as decided in the 2018-03-20
team meeting:
http://eavesdrop.openstack.org/meetings/openstack_helm/2018/openstack_helm.2018-03-20-15.00.log.html

No other copyright attributions were changed.

Change-Id: I167ceedab8fadee28c19514fad6f125d0a521caf
2018-08-26 17:17:41 -05:00
Pete Birley
a9d23fbb6e Gate: allow OS release version to be used in scripts
This PS updates the gate playbooks to both be slightly more
uniform in their instantiation, and also exposes the targeted
openstack release as an env var in scripts ran.

Change-Id: I4a2ab99bd3b1586703bf53e54231b0f08623a7d8
Signed-off-by: Pete Birley <pete@port.direct>
2018-07-29 19:38:53 +00:00
chenlx
052ac34e38 Replace deploy jq role name
We should replace role name from deploy-yq to deploy-jq.

Depends-On: https://review.openstack.org/578703
Change-Id: I5deb4fecbee9f70e6be63189d4afa81e5c71ad4b
2018-06-28 15:15:24 +08:00
Steve Wilkerson
3a86bc9a64 Fix task names in dev deploy playbooks
The task names in the dev deploy playbooks for deploying k8s
were mistakenly named after the previous tasks. This fixes them
appropriately

Change-Id: Ifc9c1ceda5b62532a44b83733aad9755165f5b55
2018-05-19 17:04:45 +00:00
Zuul
bc4712f121 Merge "Gate: Use defaults from within roles" 2018-05-15 04:17:51 +00:00
Pete Birley
4ba2dec634 Gate: Enable API access from VMs in the gate and development envs
This PS enables API access from VMs in the gate and development env

Change-Id: I0639e43dc88cbe8bf4cfe102320e2a8bf9025073
Depends-On: I32c8e752675b037610f77c8baee1c1636d5a032e
Signed-off-by: Pete Birley <pete@port.direct>
2018-05-14 01:38:49 -05:00
Pete Birley
71bc7ae09d Gate: Use defaults from within roles
This PS uses the defaults contained within the roles used in the
gate.

Depends-On: I5ad1b593a711ffe353b012394d54044dede0691d
Change-Id: I52730474cefb917a23b679f4ff0703afd2b44989
2018-05-14 06:17:38 +00:00
Pete Birley
d342ac40cb Ceph: Setup radosgw with increased swift support.
This PS updates the cephs config to deploy radosgw with greater
swift compatibility. Allowing clients to use RGW as though it
were a real swift deployment.

Change-Id: Id0a27b42b7f9c0c9e4b5a197ef50feb612e6adfc
2018-05-12 12:58:03 -05:00
Pete Birley
69b2540e25 Gate: Use infra mirrors for kubeadm-aio
This PS moves to use the infra mirrors for kubeadm-aio when built
in openstack-infra.

Depends-On: Id9a4bf2b13051dfcf5aea688511da24cd245de9c
Change-Id: I26a728fda937900406192be8a7301c3874abc934
2018-05-11 22:40:11 -05:00
Pete Birley
95763c3d44 Gate: add basic cinder tests to gate
This PS adds basic tests for cinder to the OSH gates.

Change-Id: Idfd2a738fe4ac69eda0ebc85a10d2e408127c0de
2018-05-02 01:33:33 +00:00
Zuul
7f5869f868 Merge "Change zuul path" 2018-04-30 20:24:15 +00:00
Darla Ahlert
bdfd78b4e7 Add Tempest Chart
Add basic functioning tempest chart for testing of
OpenStack services.  This also adds an experimental
gate for running a multinode deployment with tempest

Change-Id: Id4bb3447345719133e5862514dfd5bc5bac5677d
2018-04-25 16:22:35 -05:00
Tin Lam
3af7c353df Change zuul path
This patch set updates the paths so OSH-addons gate
can take advantage of the paths set up here.

Change-Id: I4f0f6ebb19042d035bd70deb26b557814cc0d2d1
Signed-off-by: Tin Lam <tin@irrational.io>
2018-04-25 14:45:15 +00:00
Steve Wilkerson
ab3626190d osh-gate: Move to use roles from openstack-helm-infra
This moves to consume the roles from openstack-helm-infra
in the openstack-helm gates

Depends-On: https://review.openstack.org/559836
Change-Id: I3ed721333b899f8dde812f1843a9fcb074c63121
2018-04-10 09:57:29 -05:00
Zuul
0b5cbc89c4 Merge "Add gate for rbd storage backend." 2018-03-30 20:35:51 +00:00
Pete Birley
a9bd125f69 Gate: Update heat templates and enable cinder in ceph dev pipeline
This PS updates the heat templates, reducing the size of the
launched vm. In addition cinder is enabled in the ceph dev
pipeline, this is possible due to the resources no longer
consumed by the test vm.

Change-Id: I9efe6fe643c636b660dd54b60dfe7c8785d7fec2
2018-03-30 05:25:08 +00:00
Jaesang Lee
2b5f2d97e0 Add gate for rbd storage backend.
This PS allows to test rbd storage backend when apply glance. Currently,
only radosgw is verified after ceph distribution.

Change-Id: Ia3c2c915a2e9a65b09123b8e1c47892069c9ae1b
Blueprint: add-rbd-gate
2018-03-27 06:22:20 +00:00
Tin Lam
93757adee7 Add LDAP-backed domain gate
This patch set adds a nv-gating with an OpenLDAP server with some sample
data loaded for development or testing use using a bootstrap job.
This patch set also adds confirming authentication works using  domain-
specific configuration for keystone.

Consolidated change from: https://review.openstack.org/#/c/552976/
Co-Authored-By: Gage Hugo <gagehugo@gmail.com>

Change-Id: I1aeccffc018d0fcefc8e2b15a4ac6b83cb2be8b6
Signed-off-by: Tin Lam <tin@irrational.io>
2018-03-14 23:25:54 -05:00
Pete Birley
a6d34e7272 Gates: Simplify kolla image gates to use common deploy playbook
This PS simplifys the gates to use the same playbook for loci and
kolla base deployments.

Change-Id: Ia0d84a04e2a7f438115d5294f76eb36147edfd50
2018-02-28 14:59:00 +00:00
Pete Birley
340a9ec434 Networking: dynamic backend support
This PS allows the neutron and nova charts to dynamicly adapt to
various backends.

Depends-On: I0ec13f45fd4561fec59d08b08eb78390a3866156

Change-Id: I1891af4b0e49237e229ff5e61e907dc3e413cf87
2018-02-26 13:16:25 +00:00
Steve Wilkerson
53144971e4 Split out Armada tasks in armada gate and add validation
Splits the armada fullstack deploy playbook out to put each armada
action into its own script, and includes the validation action to
the tasks performed on each manifest

Change-Id: I600d74e3d44d0c0ea0432b20204bfdf4d97baa7a
2018-02-21 13:49:57 -06:00
Zuul
30b05e7a6c Merge "Gate: Deploy remaining services in multinode gate" 2018-02-20 06:18:06 +00:00
Zuul
e52ac99ef3 Merge "Dev-Deploy: move to k8s DNS addr for private network" 2018-02-19 22:21:25 +00:00
portdirect
ec4e747064 Gate: Deploy remaining services in multinode gate
This PS deploys the remaining OSH charts in the multinode gate.

Change-Id: I66b412c5e2d987e5d071f37829be9c2fbbea29e4
2018-02-19 16:35:19 -05:00
portdirect
c6b7fc2764 Dev-Deploy: move to k8s DNS addr for private network
This PS moves the DNS nameservers used in the smoketest heat
template to use the k8s DNS on the dev host.

Change-Id: I3a5f9eb2689f01ee2ef216843b80fbe2607eb5bc
2018-02-19 14:26:26 +00:00
Chris Wedgwood
00093f1b3f gate: utility container
Use a utility container for ipcalc on all platforms; this avoids
having to find the package on platforms where it's not easily
available and we avoid argument differences.

Change-Id: I6c6e719f8eeb8d4214ebb0111e9d8f8b659db396
2018-02-19 07:23:41 +00:00
portdirect
2cb634789d Images: Move default to LOCI and Kolla newton gate
This PS moves the default image in OSH for most services to use LOCI
and also provides a Kolla gate for newton openstack.

Change-Id: Ice6cb9f89bc3ce6e8280e580d215aedda9e71904
2018-02-16 17:06:15 -05:00
Steve Wilkerson
0ad2b5ed7a Add checks for armada fullstack deployment
This adds a check to openstack-helm for deploying the full osh +
lma stack with armada. It deploys a manifest that will install
a rabbitmq and memcached per openstack service

Depends-On: Id58f85f150054d82c047bd360258ebe9e571360f
Change-Id: Ie2cb29279a7e47570b7faee82828f7ec753ab73f
2018-02-09 01:08:28 +00:00
Pete Birley
70d010d63a Ironic: chart and initial gate scripts
This PS adds a chart, and checks, for OpenStack Ironic.

Change-Id: I9632885e5a0ca18e4e425c6b163f73d0d1e5649d
2018-02-06 22:48:49 +00:00
portdirect
b7cb097dac Docs/Gate: NFS Support
This PS adds gated documentation for a NFS developer environment.

Change-Id: I64488f5e4ef3202e11eff79685a63e16286d5db7
2018-01-17 20:14:47 +00:00
portdirect
2d2e10bfb7 Gate: Update heat templates to export floating IP
This PS updates the heat template to output the Floating IP, which
makes the gate scripts compatible with the current master clients
when used with newton images.

Change-Id: I8e429b504ede521612c91d7563a8c5e4953bdbb4
2018-01-17 03:40:51 +00:00
portdirect
a72db2e8ff Gate: Add barbican
This PS adds barbican to the multinode gate

Change-Id: I20ebee8dac7bc56bb194c179fb3491ab957680ef
2018-01-15 14:41:26 +00:00
portdirect
9d40323eb1 Gates: Remove legacy zuulv2 scripts
This PS removes the legacy v2 scripts from OSH.

Change-Id: I02ee7654765d90b71632b0042930f4a8d71f648b
2018-01-15 01:22:43 -05:00
Zuul
ddfc940afe Merge "Gate: 5 Node basic gate" 2018-01-14 06:11:32 +00:00
Pete Birley
0f86dbdc27 Gate: 5 Node basic gate
This PS adds a 5 node basic gate for OSH, using the same format as the
dev-deploy guide. Follow on commits will:
 * Remove redundant gate scripts
 * Add documentation, in the same format as the AIO guide
 * Add all remaining services in OSH
 * Enable Helm test for all services

Change-Id: I7b72dc4777e88cae2b8a4d842c41a17a526079a2
Depends-On: Ie9b23174fade3df4a87f2b771ea654e2081b4f4e
2018-01-14 02:50:17 +00:00
dave kormann
7b6685befd Disable cephfs_provisioner deployment in openstack namespace
As with the rbd_provisioner deployment, cephfs_provisioner should
only be deployed to the ceph namespace.  This change just disables
that deployment in the openstack namespace.

Change-Id: Idfec8fbdd9408bd292d8770a3690b1b77de2b22d
2018-01-12 13:46:19 -05:00
Zuul
c9dbf745d4 Merge "RabbitMQ 3.7 with native k8s clustering" 2018-01-05 18:21:32 +00:00
portdirect
0c51d813b3 RabbitMQ 3.7 with native k8s clustering
This PS moves to use RabbitMQ with native k8s clustering.

Change-Id: I6a93c8168bc7dce6b73871aa1fd4d637e6192975
2018-01-05 04:14:54 -05:00