60 Commits

Author SHA1 Message Date
portdirect
2cb634789d Images: Move default to LOCI and Kolla newton gate
This PS moves the default image in OSH for most services to use LOCI
and also provides a Kolla gate for newton openstack.

Change-Id: Ice6cb9f89bc3ce6e8280e580d215aedda9e71904
2018-02-16 17:06:15 -05:00
Zuul
f0ab11eabe Merge "Add prometheus exporters to osh charts" 2018-02-08 20:22:23 +00:00
portdirect
914ffdbfe4 Helm-Toolkit: move keystone service jobs to helm-toolkit
This PS moves the keystone service jobs to be driven by
a helm-toolkit function providing greater consistency
to the charts in OSH, and reduced tech debt.

Change-Id: I36e012854473fcb942d62391d182ee6a8406bb72
2018-02-08 00:31:52 +00:00
Steve Wilkerson
b42cd19bdc Add prometheus exporters to osh charts
This moves the prometheus exporters for services into a directory
in the chart themselves. This keeps the monitoring services
coupled to the services theyre meant to monitor. This changes the
chart directory structure to include a monitoring/ directory to
host any monitoring requirements (not just prometheus exporters)

Change-Id: Ic5f46a7e9a2a773a837ff399b8730782cf89f1de
2018-02-07 15:55:49 -06:00
portdirect
d37ed6ffec RabbitMQ: permit multiple deployments within a single namespace
This PS updates the RabbitMQ chart to permit multiple deployments
within a single namespace.

Change-Id: Idd3f13448b25a88d2b42db565ddb7b6af0a9f3cd
2018-01-19 14:11:46 +00:00
portdirect
0c51d813b3 RabbitMQ 3.7 with native k8s clustering
This PS moves to use RabbitMQ with native k8s clustering.

Change-Id: I6a93c8168bc7dce6b73871aa1fd4d637e6192975
2018-01-05 04:14:54 -05:00
portdirect
fa2620d54b RBAC for OSH
This PS applys RBAC rules to OSH, based off the work
done in https://review.openstack.org/#/c/526464/

Change-Id: I541b0ac1a3972566ef2b66571ae32744dab70c17
2017-12-26 10:24:19 -05:00
Chris Wedgwood
8e82d07fc6 rabbitmq: reasonable timing for readinessProbe
Give things time to start and probe only as needed.  This avoids
premature health warnings such as:

  Normal   Created                14s   kubelet, node-0    Created container
  Normal   Started                14s   kubelet, node-0    Started container
  Warning  Unhealthy              10s   kubelet, node-0    Readiness probe failed:

Change-Id: I224aed14a03a3690f1ba2a07a2d9fad54b7dd550
2017-12-22 17:10:49 +00:00
intlabs
fe6107cf76 Images: Update values to allow simple parse of images being used
This PS updates the values file layout for images to allow simple
parsing of the images in use by charts, allowing them to be queried
and modified much more simply. By moving the image tags to a 'tags'
key, we can extend the options used simply to accomodate extra
options simply (eg prefixing the tag for use with an internal
registry) or pre-pulling the images to reduce chart deploy failure.

Change-Id: I9ec1dbb00d997ab6cb021bf0b698f7aae740e95d
2017-10-23 10:05:20 -05:00
Grzegorz Grasza (xek)
1fe3ca34c9 Change entrypoint version
New kubernetes-entrypoint version was released. K8s-entrypoint
authors maintain images at Quay. The image uses CoreOS, which
is more lightweight than the current Ubuntu image, so it
should lessen the burden on the infrastructure.

Change-Id: Id8c2a4d065550ffbd64476377247cccf213b58e1
Partial-Implements: blueprint entrypoint-namespaces
2017-10-10 15:59:08 +02:00
Seungkyu Ahn
d2190de96e Fix rabbitmq readiness script error in k8s v1.7
In Kubernetes version 1.7.x, /proc/1/fd/2 command in rabbitmq readiness
shell script makes an error. Instead of using /proc/1/fd/2, use /dev/null.

Change-Id: Ia4fb7f3130ec1a8fccc125bf11e997b77935e1ba
Closes-bug: 1719763
2017-09-27 11:47:52 +09:00
Pete Birley
b120667031 Endpoint lookups: fix typo in overrides
This PS fixes a typo in the endpoint lookup function and input.

Change-Id: I6ff6d68bf82e1e1f70438a7017f4e1a6df7f59a7
2017-09-06 11:15:54 -05:00
Grzegorz Grasza (xek)
b21b874051 Configure RabbitMQ management port from values.yaml
Change-Id: I6f3ca1782fc9153220f63cf775993b6ff6aee9ba
2017-09-01 10:28:05 +00:00
Pete Birley
bede94c835 Endpoint lookup namespace and fqdn support
This PS adds namespace and fqdn support to endpoint lookup functions,
it also permits over-riding of the puplic endpoint for ingress.

Change-Id: Ib61c5c00a214d75fe85fbffe9080c2ae88bd8cb9
2017-08-31 19:06:33 +00:00
Jenkins
d5436cc978 Merge "Add management port to RabbitMQ service" 2017-08-18 05:23:46 +00:00
Grzegorz Grasza
a3dcbe91b5 Add management port to RabbitMQ service
Management port exposes a HTTP REST API which can be used to
add virtual hosts and users, gather statistics and other data
about the running cluster. This also turns on the web interface
available on the management port.

Change-Id: I5e4c902d780d99e96fdd160c58227676d4676e87
Partial-Implements: blueprint service-rabbitmq-registration
2017-08-08 12:52:35 +00:00
Pete Birley
ff8744a9b9 Licence: Remove licence header from rendered files
This PS removes the licence header from rendered output from tiller,
significantly reducing the configmap size of charts deployed to the
cluster.

Change-Id: I5d1b246f2068f3b83bf59ba79fe8b88bbc9a6161
2017-08-07 17:16:13 -05:00
Pete Birley
f30cbcf108 Update pod affinity to allow customisation
This PS updates the pod affinity function to allow customisation by
operators at the point of deployment.

Change-Id: I8b7b2f584e990e068051d9a6d5cc7b1e1adb5aa5
2017-07-28 15:02:47 +00:00
Pete Birley
4d066332a7 Values: Move replicas to pod key
This PS move s the replicas key to be under the pod key in the values.
It brings further consolation of related configuration params to be
nested under common keys across all charts.

Change-Id: I420b06debd0a62ba5d83497be43ff6c49c49d339
2017-07-13 23:08:08 -05:00
Pete Birley
20527cb57c Move k8s pod params under common key
This PS moves K8s pod params under a common key.

Change-Id: Ib4e72e82a4f1540fa800c39d0dcc91b286d96c93
2017-07-11 23:28:47 +00:00
Tin Lam
670a78bcbe Fix file permission and readOnly flag
This patchset enforces stricter file permission on *-etc configmap and
sets readOnly flag to true in a number of charts.

Change-Id: I233689a5d56dd1352e0d81997a94b4cdd6bed5d2
Signed-off-by: Tin Lam <tin@irrational.io>
2017-07-08 13:24:14 -05:00
Pete Birley
c5bbc97ab7 Soft pod anti-affinity for all pods
This PS adds soft anti-affinity to all pods in OS-H. By doing so
resiliancy is improved by attempting to ensure that pods are created
on seperate nodes.

Change-Id: I0c1092498f7a1e44218ef785ca3f73fa9f49819c
2017-07-03 14:15:40 -05:00
Jenkins
d37600b172 Merge "Use k8s 1.6 syntax of declaring affinity" 2017-06-20 17:53:35 +00:00
Michał Dulko
a6cd9bac16 Use k8s 1.6 syntax of declaring affinity
K8s 1.6 has affinity/antiaffinity funtionalities as a beta feature. This
means we don't need to declare them using annotations. This commit
switches usages of affinity to 1.6 syntax.

Change-Id: Ia68f4ab28a018617bd44b1295fea58cd30eb4a39
2017-06-20 16:51:07 +02:00
Pete Birley
a7503a7d3f Kubernetes Entrypoint: Lookup service names for dependency checks
The existing entrypoint logic used static names to reolve dependencies.
This prevented the service names, and thus the hostnames of services
being altered. This PS resolves that issue by looking up the service name
from the endpoints specified in the values for a chart.

Partial-Implements: blueprint enhance-entrypoint-dependency-checking
External-Tracking-Id: OSH-21
Change-Id: Ib49490f332f8cd88e98c50d9335dfd314a170936
2017-06-20 08:51:36 -05:00
Pete Birley
0f88893a41 Images: fix references to be explicit, and point to right dep image.
This PS fixes some image references, to bring them inline with the
style and location with other services.

Change-Id: I1c42748875170a5a33bed7566382f3e31438dc7d
2017-06-15 08:59:08 -05:00
Steve Wilkerson
161170bf96 Move init containers from annotation to official object
With 1.6, init containers are officially part of the kubernetes
API.  This changes the format of the helm template for the
entrypoint container from json to yaml, and updates the
charts accordingly.

Co-Authored-By: Pete Birley <pete@port.direct>

Change-Id: I569566ce4b031d107af2d38483040a26210bec45
2017-06-09 16:31:53 -05:00
Tin Lam
5fcb0e3d10 Remove executable flag from Chart.yaml
TrivialFix: Some Chart.yaml's have permission 755; this patchset changes
that to 644 and be consistent with other yaml files.

Change-Id: I6453f91f0cd22330259bf24be9d4c331f2769ec2
2017-06-06 11:43:25 -05:00
Darla Ahlert
78dd37efc2 Update deployment for kubernetes 1.6
In Kubernetes 1.6, the deployment API version was changed
from extensions/v1beta1 to apps/v1beta1

Change-Id: I14ee465de381d25866224b9eae3512f0b42588d3
2017-06-02 08:45:08 -05:00
Jenkins
efc68f4347 Merge "Make remaining volumeMounts readOnly" 2017-06-01 21:40:26 +00:00
Pete Birley
8c29949c0d Helm-Toolkit: Update naming to be explict and remove old functions.
This PS updates the way helm-toolkit functions are named to
reference the full path they are loacted at. This should make
development and debugging easier. Addtionally unused functions
have been pruned as well.

Change-Id: I03c553f1d01bccc70c86768b416b147c90d9b2f0
2017-05-31 19:52:02 +00:00
Larry Rensing
ed2b82977b Make remaining volumeMounts readOnly
This cleanup adds a readOnly tag for the remaining volumeMounts
across the project.

Change-Id: I1035c075c2e0c6f2b1b76a14e45094ed4e90a879
2017-05-26 13:46:30 +00:00
Gage Hugo
dc1ae977a5 Remove all trailing whitespaces
This change removes any trailing whitespaces found while
running:

find . -type f -exec egrep -l " +$" {} \;

Change-Id: Ic1dc8765a0971a32da4c3116871e9450a55b357f
2017-05-19 18:07:06 -05:00
Jawon Choo
1ba7c271df add node type option to rabbitmq clustering
Currently, rabbitmq clustering is using the autocluster plugin,
and NODE_TYPE is set to disc in default. so every nodes join cluster as disc node.
However, since there is a need for disc + ram clustering for the performance.
if change node_type from disc to ram, clustering configured as [disc + ram + ram].

Change-Id: Ie83689b0554f0f993bdffac666f0f56db8082992
2017-05-12 10:59:20 +09:00
Pete Birley
c6ff0dd075 Revert "RabbitMQ: use DNS for cluster discovery, not etcd"
This reverts commit 0982a823e139560fd97ecc9390f0cd249cc7982e.

Change-Id: I59fe221e7ecea54fbfde1b3fee72d59a7b1a1cc2
2017-05-05 21:47:37 +00:00
Mark Burnett
0982a823e1 RabbitMQ: use DNS for cluster discovery, not etcd
Implements: blueprint rabbitmq-dns-discovery

Some useful things to note:

1. This uses a StatefulSet instead of a Deployment.  The reason for this
   is that when RabbitMQ uses DNS for peer discovery, the first thing it
   does when trying to join a node is attempt a reverse-dns lookup.
   This reverse lookup works when using a StatefulSet, but not a
   Deployment.
2. The RabbitMQ configuration was updated to use the new sysctl-style
   format.  It seems that the new format is required to configure the
   new autoclustering features.  Additionally, I found that this
   generate much clearer error messages than the straight erlang format.
3. I removed the `is-node-properly-clustered` test in the liveness and
   readiness probes.  This probe isn't directly supported in 3.7.0,
   and it wasn't clear that a clustering check was appropriate for each
   node.

Change-Id: Ieefbb2205bd77fbac04abcd051fb06fce62e8d97
2017-05-05 09:48:18 -05:00
Pete Birley
b6aed791fb Update chart.yaml to be consistent across repo
This PS updates the chart.yaml to be consistent across the repo, and
changes the description to make clear that they are the OpenStack-Helm
derived versions of the charts while using `helm search`.

Change-Id: Iac3cfd2cddba7130b28a65c3d353712c8a3aa02b
2017-04-16 11:21:07 -05:00
Wil Reichert
7321ded7d5 case replicas to int for comparison, thanks @larryrensing 2017-04-08 06:09:16 +09:00
Wil Reichert
844173049c Don't execute the rabbit cluster readiness check if is there is only 1 replica 2017-04-08 06:04:29 +09:00
Brandon B. Jozsa
e1665cb193 fixes #306: missing rabbitmq image (#308) 2017-03-28 09:30:10 -07:00
Alan Meadows
3886ba09e9 update other entrypoint macrros correctly this time 2017-03-22 12:31:37 -07:00
Alan Meadows
0537f138ac update other entrypoint macrros with empty mounts parameter until they are refactored 2017-03-22 12:30:21 -07:00
Pete Birley
c9df7ff353 Correct default RabbitMQ Credentials 2017-03-19 22:14:19 -05:00
mattmceuen
7462949643 Fixed copyright headers for rabbitmq erlang templates 2017-02-25 11:46:23 -06:00
Brandon B. Jozsa
1ff7bcac7b add license headers to rabbitmq (#226) 2017-02-20 07:10:35 -08:00
Tomasz Paszkowski
e3f1389f60 Add rabbitmq deployment with HA. (#123)
This works is based on http://github.com/openstack-fuel-ccp-rabbitmq and it mostly adjusts this solution
to a helm based deployment.
2017-02-17 10:49:32 -08:00
Pete Birley
116931bb51 Rename common chart, and update all references to functions within it. (#167)
* Rename common chart to helm-toolkit

* Update useage of helpers to include reference to chart they come from.

* Update helm-toolkit function naming

Also catches several functions missed in previous PS

* Update remaining requirements.yaml to use helm-toolbox

* Dep Check container fix for common -> helm-toolbox renaming
2017-02-14 16:52:38 -08:00
gardlt
58c0da8a74 remove-lock-files-from-chart-directories
* removed lockfiles from charts dir

Closes-bug: #180
2017-02-07 10:37:36 -06:00
Marcellin Tchassem
fc21a2e924 Add resources limits and requests for some charts (#163)
* Add resources limits and requests for each chart

* Refactor the resources limits and requests to follow a patern

* Fix some coding issues

* fix issues resulting from feedback on the resources PR

* Reset some variables to a static value in the neutron chart.

* Substituting variable entrypoint by dependency_check in the concerned files

* Few adjustments

* Update deploy-region.yaml

* Update deployment.yaml

* Add resources limits and requests for each chart

Squah all commits in one.

* Add resources limits and requests for some charts

* cleaning

* Fix indendation issue

* Update deployment.yaml

* Update daemonset-ovs-vswitchd.yaml
2017-02-01 19:47:59 -08:00
Alan Meadows
0a481a8ef2 Consistent config map hashing across all existing charts
* These annotations ensure that if configmaps change, the pods
are redeployed according to their upgrade strategy.

* This change excludes glance which has a pull request in progress
to refactor it.
2017-01-09 15:18:58 -08:00