219 Commits

Author SHA1 Message Date
Zuul
46ff6c3037 Merge "Gate: Permit ceph deployment from outside the cluster" 2019-03-22 01:32:10 +00:00
Zuul
7373425d2a Merge "Rabbit: Add netpolicy to allow clustering and rabbit clients to connect" 2019-03-21 16:39:45 +00:00
Pete Birley
e500334130 Gate: Permit ceph deployment from outside the cluster
This PS extends the gate scripts to allow ceph to be deployed from
a workstation external to the k8s cluster.

Change-Id: I4940de18a53fb79c905fd307a04a1d19833e79b7
Signed-off-by: Pete Birley <pete@port.direct>
2019-03-21 09:30:21 -05:00
Pete Birley
a2a5d15dca Rabbit: Add netpolicy to allow clustering and rabbit clients to connect
This PS allows rabbit compoents, eg other rabbit servers, tests, and jobs
to connect to rabbit.

Change-Id: I61cca52072940e31c093e4895a1c6406b15456bf
Signed-off-by: Pete Birley <pete@port.direct>
2019-03-20 22:32:01 +00:00
Steve Wilkerson
31f403bbcc OSH: Add/Update Armada timeouts, update config overrides
This adds the test timeout field to all charts with helm tests
defined in the OSH Armada manifest, and also updates the release
timeouts for releases known to take longer than usual

This also updates chart overrides to achieve parity between the
standard multinode job and the Armada periodic jobs to reduce the
potential for issues arising from configuration deltas

Change-Id: Id9ba223fbd35ee213db346bbc230a844632e15d2
2019-03-20 10:59:06 -05:00
Steve Wilkerson
2277902726 Armada: Fix openstack-helm update password job
The armada update password job was attempting to invoke a script
that didn't exist for sourcing the passwords. This updates the
path appropriately

Change-Id: Ieb0b85c18ed4f2a589ee3a3ba251317350dc4b81
2019-03-15 10:55:47 -05:00
Chinasubbareddy M
ff146ea9fd OSH: Add ingress netpol for ceph-rgw pods
This is to enable ingress netpol for ceph-rgw pods

Depends-On: https://review.openstack.org/#/c/632567/

Change-Id: I542a38a08101b031633bfcb0810e00904ae58df5
2019-03-06 19:57:06 +00:00
leledashenqi
52aac83b44 Add the CentOS system to Ceph related configuration file.
To use RBD devices with CentOS system, multinode deployment script has
already been modifed.

Change-Id: I8a1ac13b0ec124b14b2bdd06ea3b0a9c081d468c
Story:2004640
Task:28577
2019-03-06 03:10:03 +00:00
Zuul
01cb93c471 Merge "Report the reason why the script hits a timeout." 2019-03-05 01:44:10 +00:00
Jiří Suchomel
295475481f Report the reason why the script hits a timeout.
Also small code cleanup and bit more consistency to the commands
and variables.

Change-Id: I7bb1a9e3bafc105c17010dc145adfb3a166e945e
2019-03-04 15:53:58 +01:00
Pavlo Shchelokovskyy
55645c7e73 Explicitly set datefmt for logging
the defaults in Python [0] and oslo.log [1] are such that when using
separate config file for logging configuration (log-config-append)
the log fomat of dates containes miliseconds twice (as in sec,ms.ms)
which is exactly what is currently seen in logs of OpenStack services
deployed by openstack-helm.

When not provided with datefmt log formatter option, Python effectively
uses '%Y-%m-%d %H:%M:%S,%f' [0] as a default time formatting string to
render `%(asctime)s`, but the defaults in oslo.log add another `.%f`
to it [1].

Since `log-date-format` oslo.log option has no effect when using
log-config-append, we need to explicitly set date format to avoid double
miliseconds rendering in date of log entries.

[0] 6ee41793d2/Lib/logging/__init__.py (L427-L428)
[1] http://git.openstack.org/cgit/openstack/oslo.log/tree/oslo_log/_options.py?id=7c5f8362b26313217b6c248e77be3dc8e2ef74a5#n148

Change-Id: I47aa7ce96770d94b905b56d6fe4abad428f01047
2019-02-21 08:28:35 +00:00
Zuul
710db97513 Merge "Add Armada job for testing update of chart passwords" 2019-02-16 00:59:19 +00:00
Steve Wilkerson
61ddb2d87a Add Armada job for testing update of chart passwords
This adds both a periodic and experimental job for deploying Ceph
and the OSH components via Armada. This job will then generate new
passphrases for the OSH components, render an updated manifest for
the OSH components including the new passphrases, then applies the
updated OSH manifest to validate the ability for all deployed
charts to update those passphrases successfully
Change-Id: I42d19bbf8161b60311c4b8101217cdcfbdf6b568
2019-02-06 16:20:16 -06:00
Matthew Heler
edee4245eb [CEPH] Enable helm tests for RGW gate job
Enable the RGW helm tests for the multinode gate job

Depends-On: https://review.openstack.org/#/c/635192/
Change-Id: I899a945487032bdfafa1cf91156d40dac794a5a9
2019-02-06 14:31:03 -06:00
Steve Wilkerson
7c283e7b5d OSH: Add Armada job for testing update of release uuids
This adds both a periodic and experimental job for deploying Ceph
and the OSH components via Armada. This job will then generate a
new release uuid, render an updated manifest for all previously
deployed releases, then apply that manifest to validate the
ability for all deployed charts to update successfully with the
new release uuid annotation

Change-Id: I6f2125f3505904c4714688e7a9900b8d6bea49b4
2019-02-05 08:32:22 -06:00
Steve Wilkerson
99b3062315 Armada manifest: Add timeout to nova and neutron
This adds wait timeouts to nova and neutron to circumvent timeout
issues with deploying those two releases

Change-Id: I3fcc9ef5f16ecbc6dc33fc52df22c2d5ff504fb7
2019-02-05 08:31:41 -06:00
Steve Wilkerson
dc1ef4c138 Update openstack-helm Armada job
This updates the openstack-helm Armada job to instead deploy
only Ceph, the OpenStack service charts, and their dependencies.
This is dependent on the addition of the Armada job for Ceph and
the LMA components to openstack-helm-infra. This also updates the
jobs definition to use the osh-gate-runner playbook instead, as
well as sets the job both to a periodic and experimental job

Depends-On: https://review.openstack.org/#/c/634676/
Depends-On: https://review.openstack.org/#/c/633067/
Change-Id: I7e191a153f123e04e123acc33fb691d8117062a9
2019-02-04 16:46:22 +00:00
Steve Wilkerson
47d9c8a72c Armada Check: Add release uuid value to charts
This simply adds the release uuid value to the chart overrids in
the Armada manifests, which allows for validation that the release
uuid is appropriately added as an annotation to the resulting pods

Change-Id: I53dc31ed9849ea321064184817549c0e90c34378
2019-01-30 08:50:58 -06:00
Deokjin Kim
d8f9d2dd35 Fix wrong chart name and env-variable's name in deployment-script
1. Chart name : change from "ceph" to "ceph-rgw"
2. Postfix of environment variable's name
   : change from "OPENSTACK" to "CEPH"

Change-Id: I03a4e12457cec1811b6fa03367811f74e4bb8b83
Signed-off-by: Deokjin Kim <deokjin81.kim@samsung.com>
2019-01-29 14:25:57 +00:00
Evgeny L
b5803ad5a8 Neutron parameter min_l3_agents_per_router was removed in Ocata
This parameter has been deprecated in Newton and removed [1]
in Ocata.

[1] https://review.openstack.org/#/c/385604/

Change-Id: Ib80cc6634d0fba8ddd2a8e5c9d26a6a0524164b8
2019-01-18 22:50:17 +00:00
Chinasubbareddy M
13277440d7 OSH: Ceph charts cleanup
This is  to clean ceph charts for unused variables and left over from
ceph chart split

Change-Id: If5c8a5a2cf590154ff712695d409ca83d81e8197
2019-01-16 21:06:46 +00:00
Steve Wilkerson
f915a85f2b Armada: Update LMA configuration overrides in manifest
This updates the Armada LMA manifest to include overrides for
recent changes to the LMA services in osh-infra

Change-Id: Ib1ec2c23570a86d63df35a9f0d690d9e625f1dd0
2019-01-08 13:31:22 -06:00
Sreejith Punnapuzha
34ace3b7bf Add missing libvirt.yaml to the libvirt deployment script
Change-Id: I3d6998b84d5ecea52c4c0af5f95d83cd11009c9f
Signed-off-by: Sreejith Punnapuzha <Sreejith.Punnapuzha@outlook.com>
2019-01-03 16:49:38 -06:00
Zuul
c0418b0fd0 Merge "[gate] Support python-openstackclient as found in Ubuntu 16.04" 2018-12-28 18:12:50 +00:00
Zuul
42d6c251cc Merge "Armada: Manifest updates for Ocata release" 2018-12-27 18:05:00 +00:00
Chris Wedgwood
ee84b32f9d [gate] Support python-openstackclient as found in Ubuntu 16.04
Support python-openstackclient 2.3.1-0ubuntu1 - this is the version
found in Ubuntu 16.04.

Change-Id: I0494b01e875ae122374bf2d6efd2fba52d43e4f1
2018-12-18 22:12:40 +00:00
Steve Wilkerson
4822aa729c Armada: Manifest updates for Ocata release
This patchset updates the chart configuration overrides to account
for functionality supported with the move to Ocata over Newton.
This includes updating the OpenStack service logging configuration
to leverage the fluent handler/formatter that was introduced in the
Ocata release, updating Fluentd's configuration to filter out
duplicate logs, tagging logged events with their log level, and
creating separate indexes for the different log types created by
the elasticsearch templates. This also adds support for leveraging
ceph-radosgw's s3 API for Elasticsearch snapshots.

This also removes the barbican chart deployment from the
armada gate, to help alleviate resource consumption.

Change-Id: I45128bf102909e1762b832fc16ad04bedcfe4f00
2018-12-17 10:14:51 -06:00
Mike Pham
95a6a2e875 Enable Egress policy enforcement
This PS is enable the Egress policies
and enforces them in Openstack-helm.

Depends-On: Icbe2a18c98dba795d15398dcdcac64228f6a7b4c
Change-Id: I6ef3cd157749fd562acb2f89ad44e63be4f7e975
2018-12-17 14:38:29 +00:00
Jean-Philippe Evrard
7a42e7c383 Add local override for ingress
Without this patch it is not possible to have an override of
the helm values for the ingress controllers.

This is a problem, as this is inconsistent with other components
and this has reduced flexibility.

This patch solves the problem by exposing two extra overrides
for ingress: $OSH_EXTRA_HELM_ARGS_INGRESS_ceph and
$OSH_EXTRA_HELM_ARGS_INGRESS_openstack, next to the usual
$OSH_EXTRA_HELM_ARGS

Change-Id: I5b56941a6e9a585b9398099c632df349414112fa
2018-12-13 11:14:52 +00:00
Steve Wilkerson
e8e0d30e7b Use minikube deployment for single node gates
This updates the single node jobs to use the recently
added minikube deployment, with the intent to reduce
overall runtime for the single node jobs

Change-Id: I6efdbf890d86bf916cef2d1a3b7eba1f6132c2f9
2018-12-04 12:36:57 -06:00
Steve Wilkerson
1b7f673d8f Update openstack-helm checks/gates
This begins the reordering of the openstack-helm gates. This
deprecates the single node checks/gates that deployed the entire
stack in favor of single node checks/gates that are focused on
deploying charts with only their dependencies to reduce the
number of checks/gates required for a particular change. This also
moves the armada check to experimental, and moves the multinode
checks/gates to run as periodics. This will be followed up by
additional efforts to streamline these changes and incorporate
previous work targeting the same.

Change-Id: I63b87aceefc79a7a42c325669f2b4e3abb0c961c
2018-12-04 08:39:13 -06:00
Matthew Heler
502a7e9bb9 Enable the cronjob checkPGs job for gates
Depends-On: https://review.openstack.org/#/c/614839/

Change-Id: If2f670fa4a03f3fc1e48ce2653b8baa73f09bcfd
2018-11-12 16:50:50 +00:00
Zuul
5a9ba5c066 Merge "VBMC: remove from osh and update ironic gate setup script" 2018-10-24 23:42:22 +00:00
Pete Birley
f0edbafb78 VBMC: remove from osh and update ironic gate setup script
This PS removes the vmbc image from osh, and also fixes some linting
issues with the ironic gate setup script.

Depends-On: https://review.openstack.org/608689
Change-Id: I2f95445a49dfaced19cab058f94966f11c4a8877
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-23 16:53:35 +00:00
Tin Lam
29f32a07ac Enable network policy enforcement
This patch set updates the gate to by default uses network policy
for all components and enforces them in Openstack-helm.

Change-Id: I70c90b5808075797f02670f21481a4f968205325
Depends-On: I78e87ef3276e948ae4dd2eb462b4b8012251c8c8
Co-Authored-By: Mike Pham <tp6510@att.com>
Signed-off-by: Tin Lam <tin@irrational.io>
2018-10-23 14:58:13 +00:00
Tin Lam
3cd4d0898a Upgrade default from newton to ocata
This patch set moves the default deployment to ocata from newton.
Newton zuul job is now moved into its separate job.

Change-Id: Ic534c8ee02179f23c7855d93a4707e5a2fd77354
Signed-off-by: Tin Lam <tin@irrational.io>
2018-10-13 04:18:46 +00:00
Steve Wilkerson
eb0fa9f7a4 Armada: Add Elasticsearch admin password to nagios chart
This adds the Elasticsearch admin password to the nagios chart
document overrides to account for the Elasticsearch plugin for
alerting on queries to Elasticsearch for particular logged events

Change-Id: I589fabf94a537730c3bfe86a6aa2af2c6fc3c88a
2018-10-09 15:56:36 +00:00
Steve Wilkerson
821256da3a Armada: Use single rabbitmq deployment
This moves to use a single rabbitmq deployment for the openstack
services in the armada gate to reduce the resources required for
this check to run.

Change-Id: I81bba3c9a4d9cdaad6ddcaa066441a70f1908415
2018-10-08 13:45:36 +00:00
Steve Wilkerson
f97e644aa6 Glance: Disable registry service template in manifests
This updates the glance chart to disable the service for the
glance registry by default, as we disable the other glance
registry templates by default. This updates the gates to enable
the service when newton is deployed

Change-Id: I453d28d9c552754b66e94d9da2e2b9ea6549a5aa
2018-10-01 09:17:30 -05:00
Steve Wilkerson
64842660ff Gate: Update tempest deployment script
This updates the Tempest deployment script for the experimental
checks. Executing make pull-images isn't required, as the initial
setup-client step should verify the Tempest chart lints correctly

Change-Id: I6e5ead298737fd34824ffa97d4d9396f5a8173a4
2018-09-27 07:41:54 -05:00
Zuul
a06490e9f6 Merge "Gate: Update use it script to be more flexible" 2018-09-14 03:30:03 +00:00
Zuul
cda53c1edc Merge "Gate: Fix make command for osh-infra charts" 2018-09-13 07:33:17 +00:00
Pete Birley
36e97f9404 Gate: Update use it script to be more flexible
This PS updates the use it script to be more flexible

Change-Id: I7c1ee3308a6e7605fc6908dfa7e9429c8a8a7a80
Signed-off-by: Pete Birley <pete@port.direct>
2018-09-13 01:00:09 -05:00
Zuul
dc1ac1c196 Merge "Gnocchi: Move chart to openstack-helm-infra" 2018-09-13 00:38:34 +00:00
Steve Wilkerson
75f6c9bb1b Gate: Fix make command for osh-infra charts
This updates the make command for the osh-infra charts in the
deployment scripts to account for the charts residing in
openstack-helm-infra instead of the openstack-helm working
directory

Change-Id: I9f492e586f69b0caf908366a9cae2b55da0d4cfc
2018-09-12 23:58:13 +00:00
Zuul
946cc3fa97 Merge "Libvirt: Fix make command in deployment scripts" 2018-09-12 20:11:31 +00:00
Zuul
4c6ac5ef46 Merge "Libvirt: Move chart to openstack-helm-infra" 2018-09-12 20:09:26 +00:00
Steve Wilkerson
c10a74b6ec Gnocchi: Move chart to openstack-helm-infra
This moves the gnocchi chart to openstack-helm-infra as part of
the effort to move charts to appropriate repositories

Change-Id: Ic1b230c389f51fe8ce9eddf77dbad12ab45e5e29
Depends-On: https://review.openstack.org/#/c/602064/
2018-09-12 09:36:28 -06:00
Steve Wilkerson
b913cb6443 Libvirt: Fix make command in deployment scripts
This updates the make command for the libvirt chart to account for
the libvirt chart residing in openstack-helm-infra instead of the
openstack-helm project directory

Change-Id: I1cb37e7c094e31ca93f1fa5d1ff531645308a563
2018-09-10 15:47:51 +00:00
Steve Wilkerson
2a390de7ea Libvirt: Move chart to openstack-helm-infra
This moves the libvirt chart to openstack-helm-infra as part of
the effort to move charts to their appropriate repositories

Depends-On: https://review.openstack.org/#/c/599715/
Change-Id: I50850725604c3fc9d5dfd04a40c95d3346ccae34
Story: 2002204
Task: 21723
2018-09-10 09:46:47 -06:00