10 Commits

Author SHA1 Message Date
Steve Wilkerson
61ddb2d87a Add Armada job for testing update of chart passwords
This adds both a periodic and experimental job for deploying Ceph
and the OSH components via Armada. This job will then generate new
passphrases for the OSH components, render an updated manifest for
the OSH components including the new passphrases, then applies the
updated OSH manifest to validate the ability for all deployed
charts to update those passphrases successfully
Change-Id: I42d19bbf8161b60311c4b8101217cdcfbdf6b568
2019-02-06 16:20:16 -06:00
Steve Wilkerson
7c283e7b5d OSH: Add Armada job for testing update of release uuids
This adds both a periodic and experimental job for deploying Ceph
and the OSH components via Armada. This job will then generate a
new release uuid, render an updated manifest for all previously
deployed releases, then apply that manifest to validate the
ability for all deployed charts to update successfully with the
new release uuid annotation

Change-Id: I6f2125f3505904c4714688e7a9900b8d6bea49b4
2019-02-05 08:32:22 -06:00
Zuul
5648754f50 Merge "Update openstack-helm Armada job" 2019-02-04 20:17:16 +00:00
Steve Wilkerson
dc1ef4c138 Update openstack-helm Armada job
This updates the openstack-helm Armada job to instead deploy
only Ceph, the OpenStack service charts, and their dependencies.
This is dependent on the addition of the Armada job for Ceph and
the LMA components to openstack-helm-infra. This also updates the
jobs definition to use the osh-gate-runner playbook instead, as
well as sets the job both to a periodic and experimental job

Depends-On: https://review.openstack.org/#/c/634676/
Depends-On: https://review.openstack.org/#/c/633067/
Change-Id: I7e191a153f123e04e123acc33fb691d8117062a9
2019-02-04 16:46:22 +00:00
Gage Hugo
482dbcac29 Scan templated python files with bandit
This change adds a zuul check job to export any templated python
contained in the helm charts and scan it with bandit for any
potential security flaws.

This also adds two nosec comments on the instances of subprocess
used as they currently do not appear to be malicious, as well
as changing the endpoint_update python code to prevent sql
injection, which satisfies bandit code B608.

Change-Id: I2212d26514c3510353d16a4592893dd2e85cb369
2019-01-22 20:53:52 +00:00
Steve Wilkerson
f546dad007 Reinstate openstack-helm checks
A change was merged that had commented out the check jobs. This
simply uncomments them so checks run against changes to
openstack-helm

The change can be found here: https://review.openstack.org/#/c/591808/48

Change-Id: Ia100f1248ebe783d154420c543a9b19fb1ba4ccc
2019-01-02 11:27:58 -06:00
Steve Wilkerson
4822aa729c Armada: Manifest updates for Ocata release
This patchset updates the chart configuration overrides to account
for functionality supported with the move to Ocata over Newton.
This includes updating the OpenStack service logging configuration
to leverage the fluent handler/formatter that was introduced in the
Ocata release, updating Fluentd's configuration to filter out
duplicate logs, tagging logged events with their log level, and
creating separate indexes for the different log types created by
the elasticsearch templates. This also adds support for leveraging
ceph-radosgw's s3 API for Elasticsearch snapshots.

This also removes the barbican chart deployment from the
armada gate, to help alleviate resource consumption.

Change-Id: I45128bf102909e1762b832fc16ad04bedcfe4f00
2018-12-17 10:14:51 -06:00
Steve Wilkerson
1b7f673d8f Update openstack-helm checks/gates
This begins the reordering of the openstack-helm gates. This
deprecates the single node checks/gates that deployed the entire
stack in favor of single node checks/gates that are focused on
deploying charts with only their dependencies to reduce the
number of checks/gates required for a particular change. This also
moves the armada check to experimental, and moves the multinode
checks/gates to run as periodics. This will be followed up by
additional efforts to streamline these changes and incorporate
previous work targeting the same.

Change-Id: I63b87aceefc79a7a42c325669f2b4e3abb0c961c
2018-12-04 08:39:13 -06:00
Jean-Philippe Evrard
e46d98bf05 Prepare migration of base jobs to OSH-infra
Without this patch, openstack-helm-functional and
openstack-helm-multinode are a repetition of the
openstack-helm-infra-functional and openstack-helm-infra-multinode
jobs.

This is a problem, as multiple patches are required to change a base
job, and can lead to inconsistencies.

Instead the abstract jobs should be defined in only one place, the
openstack-helm-infra repositories. This will therefore be the location
of the openstack-helm project lint, functional, and multinode "base"
jobs.

From that point, openstack-helm-infra and openstack-helm can implement
their own job variants should this be required.

This patch fixes the link dependency between the two repositories by
ensuring all the OSH jobs are using their own local job definition
("-temp" jobs) during the migration.

Change-Id: I3d3193415ba65d58c5dd9bbb1fc515f5399edece
Depends-On: https://review.openstack.org/610482
Depends-On: https://review.openstack.org/610488
Depends-On: https://review.openstack.org/611239
2018-10-21 16:18:20 +00:00
Jean-Philippe Evrard
7646b85160 Use the openstack-helm-lint job from central location
This moves the job definitions into a single location, the zuul.d
folder, like it is done in the openstack-helm-infra repository.

The job playbooks and definitions of this repository will be moved
away to the openstack-helm-infra repository in a later commit.

This patch implements the first job reuse with the job
openstack-helm-lint from openstack-helm-infra's repository.

Change-Id: I233da952548d69f040771007455955131139e860
Depends-On: https://review.openstack.org/#/c/608662/
2018-10-15 09:21:42 +00:00