118 Commits

Author SHA1 Message Date
portdirect
8d30e6698e Helm-Toolkit: move keystone endpoint jobs to helm-toolkit
This PS moves the keystone endpoint jobs to be driven by
a helm-toolkit function providing greater consistency
to the charts in OSH, and reduced tech debt.

Change-Id: I06555171ce93a2b0a8798bc891a2990ea9626276
2018-02-07 19:51:41 -05:00
portdirect
914ffdbfe4 Helm-Toolkit: move keystone service jobs to helm-toolkit
This PS moves the keystone service jobs to be driven by
a helm-toolkit function providing greater consistency
to the charts in OSH, and reduced tech debt.

Change-Id: I36e012854473fcb942d62391d182ee6a8406bb72
2018-02-08 00:31:52 +00:00
portdirect
72792a49d4 Keystone: update user jobs to use defaults in dict keys
This PS updates the Keystone user job template to use default
values when not specified via the input dict.

Change-Id: I937e720ab3ab4ba70c33ea981d7693ebfd01c894
2018-02-07 11:03:17 -05:00
portdirect
319fd2cbec Jobs: Apply uniform node selector label to all jobs in OSH
This PS applies a uniform node selector label to all jobs in OSH.

Change-Id: I2efedcea2085b8189bd0bd12dd0ee66e63db0d97
2018-02-07 10:16:06 -05:00
portdirect
f296acf647 Helm-Toolkit: move keystone user jobs to helm-toolkit
This PS moves the keystone user jobs to be driven by
a helm-toolkit function providing greater consistency
to the charts in OSH, and reduced tech debt.

Change-Id: Ic5eb172b0443f61b8ecab8b3a607c764fb145c75
2018-02-07 09:49:04 -05:00
Hyunsun Moon
aba33b3440 Neutron: make metadata proxy work
- corrected the path of "socket" volume, which is used for sharing
  metadata proxy unix socket among the agents
- and give neutron user permission to write to the dir
- set the default nova_metadata_ip to full hostname of metadata
  so that it could be accessed properly via ingress
- removed unnecessary configurations from values

Change-Id: I4d20dc670fecebd9799851d659c5f42edb4821ac
Closes-Bug:1745370
2018-02-03 16:21:05 +00:00
portdirect
4746de33f4 Helm-Test: remove user and tenant creation from test context
This PS removes the user managemnt from the rally driven helm tests
which allows LDAP and other read only sources being used to validate
service functionality, in addition to reducing false -ve results in
the Zuul gates.

Change-Id: I1cc0e99bf74d578648b3cd40eaf60c1804044d88
2018-01-29 02:40:22 +00:00
portdirect
b180d28618 Auth: Update credential keys to reference service specifically
This PS moves all credentials for OpenStack services from 'user' to
the service name. This allows a single yaml snippet to articulate
the credentials for a deployment.

Change-Id: Ic720109f2ba854561b23767cb480bcae91f74b6b
2018-01-15 18:54:13 +00:00
portdirect
5a2f71ebdf Ingress: Allow annotations to be dyanmicly driven
This PS allows the ingress rules to be dynamicly driven from the
values.yaml, permitting the ingress cotnroller to ba changed and
custom rules to be applied: eg whitelisting of clients.

Change-Id: Ica6b4692ff9b6b77d1efe6bae212a1227e56ca66
2018-01-05 00:29:05 -05:00
portdirect
9944b0d84f RBAC: add rules to all remaing helm test pods
This PS adds RBAC rules for all remaining helm test pods
in OpenStack-Helm.

Change-Id: Ib44d5fdc8c147f2cbecec51cc4767116f3adb6b2
2017-12-29 14:09:43 -05:00
portdirect
fa2620d54b RBAC for OSH
This PS applys RBAC rules to OSH, based off the work
done in https://review.openstack.org/#/c/526464/

Change-Id: I541b0ac1a3972566ef2b66571ae32744dab70c17
2017-12-26 10:24:19 -05:00
Steve Wilkerson
5bc7ded909 Update names of helm test pods for openstack services
This updates the names of the helm test pods to give all services
in OSH-infra/OSH a uniform '{{ .Release.Name }}-test' name, which
allows for easier gathering of test results across all deployed
services

Change-Id: I24df7a18d32b99d1ffaad19647ef724316e2fe20
2017-12-14 14:03:12 +00:00
Tin Lam
1c5b5024cf Images: Neutron service specific explicit image names
This patch set makes the service-specific images for neutron
have explicit names, allowing simple over-riding of images
for an entire site.

Change-Id: Ica7e1f77f43936971d44ac0e6645ac656ca83b96
2017-12-01 11:14:30 -06:00
Zuul
f8377b1258 Merge "Kernel Modules: Load via chroot into host" 2017-11-13 20:08:00 +00:00
Hyunsun Moon
0808cf5198 Add option to set external policy to local for openstack services
External traffic policy "local" would be preffered when openstack
service is accessed from external via node port. This option has an
effect only when service node port is enabled.

Change-Id: Ic68cfc59dc39dc842d4790deffa70efe433dd7a6
2017-11-02 15:07:21 +09:00
intlabs
35267bffe4 Kernel Modules: Load via chroot into host
This PS moves the loading of kernel modules required by services to
being perfromed via a chroot on the host, this ensures that the correct
module is found and provides compatibility across distros.

Change-Id: I889fdd047a24bf4b123dadf9f6d6e6e8079d69d1
2017-10-31 23:51:53 +00:00
intlabs
fe6107cf76 Images: Update values to allow simple parse of images being used
This PS updates the values file layout for images to allow simple
parsing of the images in use by charts, allowing them to be queried
and modified much more simply. By moving the image tags to a 'tags'
key, we can extend the options used simply to accomodate extra
options simply (eg prefixing the tag for use with an internal
registry) or pre-pulling the images to reduce chart deploy failure.

Change-Id: I9ec1dbb00d997ab6cb021bf0b698f7aae740e95d
2017-10-23 10:05:20 -05:00
Jawon Choo
121a52dd93 Nova metadata : set clusterIP dynamically
This PS updates nova to set metadata's clusterIP dynamically and
neutron to set nova_metadata_ip from metadata hosts
If specify a clusterIP, it is hard-coded as before also.

Change-Id: Ib0d6df8272bd8494bb59ffc8e6b2cfa36a901f60
Closes-Bug: #1715553
2017-10-15 17:34:25 +09:00
intlabs
e67a8e09bc Neutron: Update tunnel interface loaction logic
This PS update the logic used to determine the default tunnel
interface if one is not specified, as the original method could fail with
complex device names.

Change-Id: Ifec81f517ee29bef0926779591ab9cf5fe0e63c4
2017-10-10 09:49:51 -05:00
Pete Birley
8776a2c785 Config: Move rally test config into values
This PS moves the rally test config into values.

Partially implements: blueprint remove-pregenerated-config-templates

Change-Id: Ic051e762d792308de1d6038c37ca71c3efc9698c
2017-10-04 01:07:07 -05:00
Zuul
a2cc27ea6a Merge "Adding database drop jobs" 2017-09-29 15:07:41 +00:00
Pete Birley
b8cc29f183 Neutron: Move Nova credentials to endpoints in values.yaml
This PS moves the nova credentials from the config section
of the values.yaml to the endpoints section, seperating them from
the service configuration.

Change-Id: Idfc696e0fc907b702a8ca81d81e50cb252cb7af8
2017-09-29 02:50:48 +00:00
Sean Larimore
d1e775547c Adding database drop jobs
Implemented Kubernetes jobs to drop a database for an OpenStack service
on deletion of Helm chart. This job is configurable to be enabled or
disabled in the values.yaml file for each chart.

Change-Id: Ia1a0834cb43c7e883aaf507a7c7683fa1cf4e838
2017-09-27 09:44:28 -06:00
Pete Birley
7ffdd5222b Neutron: remove oslo-genconfig
This PS removes the modified oslo-genconfig from neutron.

Partially implements: blueprint remove-pregenerated-config-templates

Change-Id: I73091b7ad1af74e3a660ff17031f09628b33d17f
2017-09-22 03:16:44 +00:00
Jenkins
a81891a2d9 Merge "Neutron: fix reg exp for finding default tunneling interface" 2017-09-12 15:14:23 +00:00
Artur Korzeniewski
4ed7de8f71 Neutron: fix reg exp for finding default tunneling interface
Grep the output from 'ip route' command matching first word after match.
The OVS was fixed some time ago, but in new linuxbridge the default
tunnel interface was following wrong grep expression.
Making both OVS and linuxbridge to follow the same reg exp.

Change-Id: I222d694b06285d5ec3d848ee157542796dfc1cc7
Closes-Bug: #1700323
2017-09-08 09:38:05 +02:00
Chris Wedgwood
6706735611 Spelling fixes
Change-Id: Iba49ab54f7df0fd73f78141f139a479c882c2216
2017-09-06 19:20:35 +00:00
Artur Korzeniewski
ca05f7ac3c Neutron and OVS: add full name to ovs and lb daemonsets
Add neutron prefix to lb-agent and ovs-agent.
Rename ovs-db and ovs-vswitchd to openvswitch-db and openvswitch-vswitchd.

Change-Id: Iad69b0c00d17e59a9f0eb66003e4512ccaeab128
2017-09-04 13:58:59 +02:00
Pete Birley
bede94c835 Endpoint lookup namespace and fqdn support
This PS adds namespace and fqdn support to endpoint lookup functions,
it also permits over-riding of the puplic endpoint for ingress.

Change-Id: Ib61c5c00a214d75fe85fbffe9080c2ae88bd8cb9
2017-08-31 19:06:33 +00:00
Pete Birley
37b099e320 Neutron: Move OpenVSwitch into its own chart
This PS moves OpenVSwitch into its own chart - decoupling it from neutron,
both making it easier to deploy and use seperately and permitting
use of other network backends.

Partially implements: blueprint split-nova-and-neutron-infra

Change-Id: Ifd637136b950ddf1ba1c26ce76c9bbdeafc232c3
2017-08-30 16:01:29 +00:00
Artur Korzeniewski
aaedb4a150 Neutron: add linuxbridge daemonset and config script
Adding daemonset for Linux bridge. Using node selector
"linuxbridge enabled".

network.backend added in neutron/values.yaml to support scenario for
different SDNs using the same networking software, like OVS is used
for reference Neutron L2 agent, ODL, OVN and SONA. The other option for
network.backend can be linuxbridge and calico.
network.backend impacts configuration of DHCP, L3 and metadata agents.
Those agents are dependent on ovsdb_connection flag (officially it is
placed in openvswitch_agent.ini file).

Added daemonset_lb_agent flag in manifests section. Currently
OVS and LinuxBridge L2 agents can be turned on/off to be deployed.
OVS L2 agent and OVS as a network virtualization SW can be deployed
independently.

Removed conf.neutron.default.neutron.interface_driver, since it was not
used anywhere.

Marked places in neutron/values.yaml where changes are needed in order
to use linuxbridge for:
- neutron.conf interface_driver
- ML2 mechanism driver
- dhcp and l3 agents interface_driver

Added example of neutron values overrides in:
tools/overrides/mvp/neutron-linuxbridge.yaml

Change-Id: I7cdcfaa9a73af392a0d45f7df29b7b3ae3cc4c76
Implements: blueprint support-linux-bridge-on-neutron
2017-08-29 11:51:42 +02:00
Pete Birley
7cfd182929 Security: Make policy fully configurable via helm values
This PS moves the policy.json to be fully driven by gotpl,
allowing full configuration without editing the template.

Nova and Cinder are addressed in the seperate patchsets:
 * https://review.openstack.org/#/c/498215/
 * https://review.openstack.org/#/c/498216/

Change-Id: Ia2be5fb4e460d41034fdadbbefc1e48d0869e023
2017-08-26 17:50:22 -05:00
Jenkins
85b6716c49 Merge "Fix for appending custom volumes" 2017-08-25 15:00:10 +00:00
Jenkins
d04e69c438 Merge "Enable keystonemiddleware cache encryption" 2017-08-25 01:56:10 +00:00
Mateusz Blaszkowski
fc9677f718 Fix for appending custom volumes
Before this change, there was no ability to append custom volume for
any of the services. The reason was a missing new line character, so
the templates were formatted like this:
- name: pod-shared
  mountPath: /tmp/pod-shared - mountPath: /tmp/test2
  name: test2

Apart from that, for some of the services (mostly job-bootstrap) invalid
indentation for custom volumes (and their mounts) was set.

Closes-Bug: 1712745
Change-Id: Ib57c76a34c0e28ad9e67ea47d1fc250b17711a42
Signed-off-by: Mateusz Blaszkowski <mateusz.blaszkowski@intel.com>
2017-08-24 06:24:47 -04:00
Pete Birley
4740486f63 Security: Container user and rootwrap for neutron
This PS adds user control for the service user and rootwrap for
the Neutron chart.

Change-Id: Ibefa3e76c9e64427e97cdcbb93a11d2b2125e171
2017-08-24 05:26:30 +00:00
Pete Birley
1fd7f66783 Helm-Toolkit: Configmap templater
This PS adds a configmap teplater helper to helm-toolkit. It makes it
simpler to write consistent charts that supports over-riding of all
values.

Change-Id: I9a587999859ea02802485eb25a3f0ebec8c712a8
2017-08-23 08:06:38 -05:00
Dae Seong Kim
aacd11e361 Add Tempest script in helm test framework
Now, openstack-helm support "helm test" function, and It execute rally
container.
Rally also can test Tempest itself, so this fix will be add tempest
test in rally container.

Change-Id: I2c2f684f6583f2a3d9c7279a3d85cb242934e90e
Implements: blueprint add-tempest-in-helm-test
2017-08-16 16:56:10 +09:00
Tin Lam
c35f08c4fa Enable keystonemiddleware cache encryption
This patch set enables keystonemiddleware memcache encryption by providing a
random string key into the service configuration file, and setting the
memcache_security_strategy as ENCRYPT.

Change-Id: Ia030f5414308a29096c644bae70047a323eaffde
2017-08-15 22:47:55 -05:00
Pete Birley
0c75f1ab9c Update DNS policy for pods in host network namespace
This PS updates the DNS policy for pods that run in the hosts network
namespace.

Change-Id: I5ff11985459c967e5248d1ce9f62ebfc578e3afb
2017-08-10 16:43:20 -05:00
Pete Birley
ff8744a9b9 Licence: Remove licence header from rendered files
This PS removes the licence header from rendered output from tiller,
significantly reducing the configmap size of charts deployed to the
cluster.

Change-Id: I5d1b246f2068f3b83bf59ba79fe8b88bbc9a6161
2017-08-07 17:16:13 -05:00
Pete Birley
35601e2bd3 Charts: make manifests optional for all OpenStack elements
This PS allows the rendering of manifests to be controlled. It enables
both increased control over deployment when required but also makes
development of a feature easier to target.

Change-Id: I1716e8ee23fe5c53f935bd739ea283bc4a2a9963
2017-08-07 14:59:48 -05:00
Pete Birley
8f8a80019a Jobs: Add labels to all jobs
This PS adds labels to all jobs in OpenStack-Helm, allowing them to be
found by label searches. This makes management of large clusters using
tools like Armada easier.

Change-Id: I49b2cb7a94fab96958f187ca11e2c2a0c80ff843
2017-08-05 20:17:12 +00:00
Pete Birley
cbae720d1d Values: Move mounts to pod key
This PS moves the mounts key to be under the pod key in the values.
It brings further consolation of related configuration params to be
nested under common keys across all charts.

Change-Id: If9963e4f8b438847e2fcad3bdd8c0d71ca9ecdd8
2017-07-14 10:44:35 -05:00
Pete Birley
4d066332a7 Values: Move replicas to pod key
This PS move s the replicas key to be under the pod key in the values.
It brings further consolation of related configuration params to be
nested under common keys across all charts.

Change-Id: I420b06debd0a62ba5d83497be43ff6c49c49d339
2017-07-13 23:08:08 -05:00
Jenkins
956cf735d1 Merge "Fix OVS tunnel interface grep" 2017-07-13 13:28:19 +00:00
Matt McEuen
6b917043c6 Fix OVS tunnel interface grep
Hardened the grep/awk that extracts the default interface for use
as the tunneling interface.  The command failed on multiple
Ubuntu machines as-was.

Change-Id: Ib7d0a8e55e67391d6cb7a58910cfc2ed617a4cbc
2017-07-12 22:52:29 -05:00
Pete Birley
20527cb57c Move k8s pod params under common key
This PS moves K8s pod params under a common key.

Change-Id: Ib4e72e82a4f1540fa800c39d0dcc91b286d96c93
2017-07-11 23:28:47 +00:00
Jenkins
feabb5038c Merge "Fix file permission and readOnly flag" 2017-07-09 19:30:38 +00:00
Tin Lam
670a78bcbe Fix file permission and readOnly flag
This patchset enforces stricter file permission on *-etc configmap and
sets readOnly flag to true in a number of charts.

Change-Id: I233689a5d56dd1352e0d81997a94b4cdd6bed5d2
Signed-off-by: Tin Lam <tin@irrational.io>
2017-07-08 13:24:14 -05:00