100 Commits

Author SHA1 Message Date
Pete Birley
ff8744a9b9 Licence: Remove licence header from rendered files
This PS removes the licence header from rendered output from tiller,
significantly reducing the configmap size of charts deployed to the
cluster.

Change-Id: I5d1b246f2068f3b83bf59ba79fe8b88bbc9a6161
2017-08-07 17:16:13 -05:00
Pete Birley
35601e2bd3 Charts: make manifests optional for all OpenStack elements
This PS allows the rendering of manifests to be controlled. It enables
both increased control over deployment when required but also makes
development of a feature easier to target.

Change-Id: I1716e8ee23fe5c53f935bd739ea283bc4a2a9963
2017-08-07 14:59:48 -05:00
Jenkins
075d9957af Merge "fix to avoid crash loop on glance clean job" 2017-08-07 14:47:26 +00:00
Pete Birley
8f8a80019a Jobs: Add labels to all jobs
This PS adds labels to all jobs in OpenStack-Helm, allowing them to be
found by label searches. This makes management of large clusters using
tools like Armada easier.

Change-Id: I49b2cb7a94fab96958f187ca11e2c2a0c80ff843
2017-08-05 20:17:12 +00:00
Dae Seong Kim
f45da069e4 fix to avoid crash loop on glance clean job
glance clean job tries to delete a image. but if there's no the image,
the job falls in CrashLoopBackOff status when helm delete.

Change-Id: I3b9c3057b9da8780ca27f1cb18dcd5541f3bcabc
Closes-bug: 1708581
2017-08-04 16:21:32 +09:00
Robert Choi
f84716f43e Glance: Add paste_deploy values
Glance bootstrap job fails due to missing 'paste_deploy' values.
This PS solves the issue by adding the values to glance chart.

Change-Id: I850863fe29c25aab9cf57eee62098e2b5d23a7f8
Closes-Bug: 1705421
2017-08-02 14:23:01 +09:00
Pete Birley
f30cbcf108 Update pod affinity to allow customisation
This PS updates the pod affinity function to allow customisation by
operators at the point of deployment.

Change-Id: I8b7b2f584e990e068051d9a6d5cc7b1e1adb5aa5
2017-07-28 15:02:47 +00:00
Jaesang Lee
d0146ba4c6 Remove bootstrap image of glance when deleting glance chart.
If you re-install glance chart with fixed bootstrap image id
in your own ceph environment, glance chart can't create bootstrap
image because of same object is exist in ceph.
This patch add job-clean that remove bootstrap image when you
delete glance chart.

Change-Id: I4ca55f0500479cbc48eff4133c7ac1683a76e60f
Closes-Bug: #1705386
2017-07-20 16:47:12 +09:00
Pete Birley
cbae720d1d Values: Move mounts to pod key
This PS moves the mounts key to be under the pod key in the values.
It brings further consolation of related configuration params to be
nested under common keys across all charts.

Change-Id: If9963e4f8b438847e2fcad3bdd8c0d71ca9ecdd8
2017-07-14 10:44:35 -05:00
Pete Birley
4d066332a7 Values: Move replicas to pod key
This PS move s the replicas key to be under the pod key in the values.
It brings further consolation of related configuration params to be
nested under common keys across all charts.

Change-Id: I420b06debd0a62ba5d83497be43ff6c49c49d339
2017-07-13 23:08:08 -05:00
Pete Birley
20527cb57c Move k8s pod params under common key
This PS moves K8s pod params under a common key.

Change-Id: Ib4e72e82a4f1540fa800c39d0dcc91b286d96c93
2017-07-11 23:28:47 +00:00
Tin Lam
670a78bcbe Fix file permission and readOnly flag
This patchset enforces stricter file permission on *-etc configmap and
sets readOnly flag to true in a number of charts.

Change-Id: I233689a5d56dd1352e0d81997a94b4cdd6bed5d2
Signed-off-by: Tin Lam <tin@irrational.io>
2017-07-08 13:24:14 -05:00
Pete Birley
fecac47b5a Cleanup: fix neutron db-job manifest and rally pod permissions.
This PS removes the duplicate command key in the Neutron DB-Job
manifest and corrects the rally pod permisions.

Change-Id: I97b9a9ab54609696ac763f3a319f6df78fe5d73c
2017-07-06 14:56:09 -05:00
Pete Birley
ac06f49849 Unify and normalise K8s Resources and Upgrade Strategy
This PS unifies and normalises Kubernetes resource allocation and
update strategy across all OpenStack-Helm elements.

Change-Id: Ia41fc453cb5191fa447ca6e1aa0f5b431c939dc8
2017-07-06 17:48:16 +00:00
Pete Birley
c221fa5248 Secret and endpoint standardisation.
This PS moves keystone credentials to the endpoints section within
the values.yaml, and also adds a 'secrets' key, allowing standardiation
of secrets and credential management across OpenStack-Helm.

Change-Id: I86a21e625afd822379ac11351603b2c606a3769f
2017-07-05 12:22:04 -05:00
Jenkins
2d7fe938c0 Merge "Fix MultiOpt options in gen-oslo-openstack-helm" 2017-07-05 13:46:14 +00:00
Michał Dulko
9eaa08678c Fix MultiOpt options in gen-oslo-openstack-helm
gen-oslo-openstack-helm generated configuration file templates in
incorrect form, causing setting mulitple values in Values.yaml to
produce something like:

  foo=barfoo=baz

This commit fixes this in the generator and updates config file
templates to generate configs correctly:

  foo=bar
  foo=baz

Change-Id: Iea661dcf1710987b2e111d7141ba888f01c44a50
Closes-Bug: 1699581
2017-07-04 17:26:06 +02:00
Pete Birley
c5bbc97ab7 Soft pod anti-affinity for all pods
This PS adds soft anti-affinity to all pods in OS-H. By doing so
resiliancy is improved by attempting to ensure that pods are created
on seperate nodes.

Change-Id: I0c1092498f7a1e44218ef785ca3f73fa9f49819c
2017-07-03 14:15:40 -05:00
Pete Birley
22da29c2be Logging: Disable debug logging by default
This PS disables debug logging for all services that had it on, and
removes the key from the default values.yaml. It does however ensure
that the mvp values has the appropriate key to make turning debugging
on simple.

Change-Id: I8ed84d531971cbd7984f029abbebb373af4c7311
2017-06-29 07:10:20 -05:00
Jenkins
e1874a7b1a Merge "Ingress controller for public endpoints" 2017-06-29 05:03:19 +00:00
Pete Birley
c0cf2337a2 Ingress controller for public endpoints
This PS provides the framework for Ingress controller based access to
public APIs.

Services covered:
 * Barbican
 * Cinder
 * Glance
 * Heat
 * Horizon
 * Keystone
 * Magnum
 * Mistral
 * Neutron
 * Nova
 * Senlin

Change-Id: I82d55f6ca41859ebed3312ec7d95b353df09e772
Implements: blueprint api-ingress
External-Tracking-Id: OSH-58, OSH-62
2017-06-28 17:37:10 -05:00
Jenkins
9201234dc6 Merge "Add image id to glance bootstrap for tempest test" 2017-06-28 12:06:58 +00:00
Pete Birley
8ef5d94674 Refactor Ceph secret generation
This PS refactors the ceph chart and secret generation process.
The updated chart replaces the existing "bootstrap" chart.
Additionally, Ceph manifests and deployment guides were modified
accordingly.

Change-Id: I6f5bb88fc0f40cfee8865d9dab83859d765e7537
Co-Authored-By: Larry Rensing <lr699s@att.com>
2017-06-27 13:42:03 -05:00
Siri Kim
239a0bbc8e Add image id to glance bootstrap for tempest test
This PS add glance image id to bootstrap, so we can make image
with predefined id for tempest test.

Change-Id: I061af4daa9574f87d82d68fcf3b7a3674436d3cf
Implements: blueprint specify-glance-image-id
2017-06-26 17:38:39 +09:00
Pete Birley
be7ed2b5ab Remove some orphaned values in glance and neutron.
Some unused values were present in glance and neutron that were left
over from the early development of OSH this PS removes them.

Change-Id: I5dbbb1d6e1262e4c06dd6c083724fd213838e5b7
2017-06-23 04:38:13 +00:00
Pete Birley
a7503a7d3f Kubernetes Entrypoint: Lookup service names for dependency checks
The existing entrypoint logic used static names to reolve dependencies.
This prevented the service names, and thus the hostnames of services
being altered. This PS resolves that issue by looking up the service name
from the endpoints specified in the values for a chart.

Partial-Implements: blueprint enhance-entrypoint-dependency-checking
External-Tracking-Id: OSH-21
Change-Id: Ib49490f332f8cd88e98c50d9335dfd314a170936
2017-06-20 08:51:36 -05:00
Tin Lam
8c4e1c0e2d Fix cpu and memory limits for glance
Currently, the memory and cpu limits are identical to the requests.
This patch set ups the limits to be similar to other services
such as nova and neutron.

Change-Id: I597889dd9e19ae672926b772d7ae38947ede26bc
2017-06-18 01:21:39 -05:00
mattmceuen
5a93f0f596 Fixed typo in glance registry node port value name
The value path should have 'registry', not 'register'.

Change-Id: If00d5576757ba483cefad9acbe6f4a61d942eac2
Closes-Bug: #1698595
2017-06-17 18:36:39 -05:00
Pete Birley
81aef1ecea Configmaps: set default mode of files in *-bin configmaps to +x
This PS sets the default modetype of mounts from *-bin configmaps
to 0555, and removes the then unnecessary commands from the manifests.

Change-Id: I93ce0facb06affdf362a58f8520e69ba94ea3034
2017-06-12 00:22:30 -05:00
Pete Birley
e4954a861b Glance: Fix bootstrap image reference
The glance boostrap job used the db_init image. This PS rectifies
that.

Change-Id: I4007de943a7fb97f3ca5ecd23e5533d2e10d97c1
2017-06-11 17:31:54 -05:00
Steve Wilkerson
161170bf96 Move init containers from annotation to official object
With 1.6, init containers are officially part of the kubernetes
API.  This changes the format of the helm template for the
entrypoint container from json to yaml, and updates the
charts accordingly.

Co-Authored-By: Pete Birley <pete@port.direct>

Change-Id: I569566ce4b031d107af2d38483040a26210bec45
2017-06-09 16:31:53 -05:00
Pete Birley
77e02f143c Helm Test: Glance
This PS introduces 'helm test' functionaility to Glance.

Change-Id: I7a25a89f8413aa5e88f28c30f8a040e8d5909bc9
Partial-Implements: blueprint implement-helm-test-for-charts
2017-06-06 18:40:59 -05:00
Pete Birley
0df7427dc4 Refactor start scripts, to support graceful termination
This PS add Barbican support, and moves all potentially container
specific logic into the service start script from the api manifests.

Also fixes a permissions issue with the nova-api, which incorrectly
had the NET_ADMIN capability.

Change-Id: I18fc1ea5d7aa70ea7dabb829361a3da57e905100
2017-06-05 17:37:22 -05:00
Darla Ahlert
c394d22112 Add Graceful Termination to all existing charts
This commit adds graceful termination to all existing charts.
It also adds a setting in the values.yaml file for clarity and
the ability to override if wished.

Change-Id: I42025e4be86d248be467c1d2f0980f864c4d440e
2017-06-05 12:38:26 -05:00
Jenkins
592692fdf8 Merge "Update deployment for kubernetes 1.6" 2017-06-02 15:35:15 +00:00
Darla Ahlert
78dd37efc2 Update deployment for kubernetes 1.6
In Kubernetes 1.6, the deployment API version was changed
from extensions/v1beta1 to apps/v1beta1

Change-Id: I14ee465de381d25866224b9eae3512f0b42588d3
2017-06-02 08:45:08 -05:00
Jenkins
d391a06c70 Merge "Consistency: Move Glance container start commands to scripts" 2017-06-01 23:34:04 +00:00
Jenkins
efc68f4347 Merge "Make remaining volumeMounts readOnly" 2017-06-01 21:40:26 +00:00
Pete Birley
c0651f3e22 Consistency: Move Glance container start commands to scripts
This PS moves the container start commands to scripts. This brings
the service into alignment with others in OpenStack-Helm, and enables
easier debugging and modifcation of the launch commands for services.

Change-Id: I433b5d94d3cfc8c9167a4f4ee75fb460a9c6bd9a
2017-06-01 10:34:42 -05:00
Jenkins
a5420f4290 Merge "Helm-Toolkit: Update naming to be explict and remove old functions." 2017-06-01 14:49:54 +00:00
Pete Birley
8c29949c0d Helm-Toolkit: Update naming to be explict and remove old functions.
This PS updates the way helm-toolkit functions are named to
reference the full path they are loacted at. This should make
development and debugging easier. Addtionally unused functions
have been pruned as well.

Change-Id: I03c553f1d01bccc70c86768b416b147c90d9b2f0
2017-05-31 19:52:02 +00:00
Pete Birley
5e193580ed Pod Disruption Budget: Set default to 0
With pod disruption budget set it is not possible to drain nodes
and perform other expected operations. This PS changes the default
value to 0, restoring the typically expected operation of pods.

Change-Id: I43ef35638c98caee2cf567487173399157000ada
2017-05-31 06:11:58 -05:00
Chris Wedgwood
3e0a00f39a Glance; use /var/lib/glance/images for consistency.
Change-Id: I023c7fa473aab21f81bc7271d389d89824869083
2017-05-27 05:20:52 +00:00
Larry Rensing
ed2b82977b Make remaining volumeMounts readOnly
This cleanup adds a readOnly tag for the remaining volumeMounts
across the project.

Change-Id: I1035c075c2e0c6f2b1b76a14e45094ed4e90a879
2017-05-26 13:46:30 +00:00
Jenkins
78abb8218c Merge "Use the standard Dockerhub MariaDB image" 2017-05-25 21:02:50 +00:00
Chris Wedgwood
b7150eb0b4 Allow glance to use file method
Allow glance to use the "pvc" method, this was previously called file
but has been renamed for clarity.

We now require Kubernetes 1.6 or later; remove the storage annotation
in favor of storageClassName.

Change-Id: I315eaf68937f91b56c1a26954072bda53767c606
2017-05-25 17:22:14 +00:00
Mark Burnett
de20cbb15d Use the standard Dockerhub MariaDB image
Addresses consistency issues that appear with autoincrement fields in
the existing chart, as demonstrated in [1].  It should allow automatic
recovery of 2 out of the 3 (default) cluster members.

It does not address automatic recovery of a complete shutdown of all
cluster nodes.

[1] https://review.openstack.org/#/c/465977/

Change-Id: I84c86e1862f03a6d381bf219b821ea3636049f0b
2017-05-25 08:56:35 -05:00
Jenkins
3bb2c91bdb Merge "Cleanup - Adding volume overrides" 2017-05-22 16:23:32 +00:00
Dae Seong Kim
9672d2b184 hotfix to change cephclientglancekeyring key
cephclientglancekeyring key is removed. so it needs to be changed
to glance-etc.

Closes-Bug: #1692459
Related-Bug: #1691011
Change-Id: Ie4b45648a68069c910dbe47c53c4f091dc424da7
2017-05-22 20:46:31 +09:00
Jenkins
d2de9550f0 Merge "Adding pod disruption budget for glance" 2017-05-19 20:46:26 +00:00