57 Commits

Author SHA1 Message Date
Huamin Chen
da9539bb87 Use RBD external provisioner
Currently RBD storageclass uses in-tree provisioner
kubernetes.io/rbd. Since containerized kubernetes controller image
doesn't include rbd binary, in-tree provisioner errors out.

This fix uses external provisioner ceph.com/rbd.

Closes-Bug: #1707937

Change-Id: Iad443a54c0229c0356beb6d872365298248c40c9
2017-08-09 11:24:59 -05:00
Pete Birley
054ac68e92 KubeADM-AIO: update to K8s 1.6.8
This PS udpates the Kubernetes version to v1.6.8

Change-Id: I2170fbaf901e761cb732469dab5ad7bc946ddea5
2017-08-03 23:37:00 -05:00
Michał Dulko
cfab320f26 Add setup and rotate job for credential keys
Keystone is using keys to encrypt credentials saved into the database.
The mechanism is very similar to fernet tokens. This commit implements a
job setting key repository up and rotate job for those keys. All is
based on implementation of fernet tokens.

Change-Id: I88faf1d02d2b317563e8603cebba542f8b133c6a
Closes-Bug: 1693807
2017-08-02 13:22:05 +02:00
Michał Dulko
03543a3d53 Add support for Keystone's fernet tokens
Keystone supports (and that's a default setting since Ocata) using
non-persistent fernet tokens instead of UUID tokens written into the DB.
This setting is in some cases better in terms of performance and
manageability (no more tokens DB table cleanups). OpenStack-Helm should
be able to support it.

General issue with fernet tokens is that keys used to encrypt them need
to be persistent and shared accross the cluster. Moreover "rotate"
operation generates a new key, so key repository will change over time.

This commit implements fernet tokens support by:
* A 'keystone-fernet-keys' secret is created to serve as keys repository.
* New fernet-setup Job will populate secret with initial keys.
* New fernet-rotate CronJob will be run periodically (weekly by default)
  and perform key rotation operation and update the secret.
* Secret is attached to keystone-api pods in /etc/keystone/fernet-tokens
  directory.

Turns out k8s is updating secrets attached to pods automatically, so
because of Keystone's fernet tokens implementation, we don't need to
worry about synchronization of the key repository. Everything should be
fine unless fernet-rotate job will run before all of the pods will
notice the change in the secret. As in real-world scenario you would
rotate your keys no more often than once an hour, this should be totally
fine.

Implements: blueprint keystone-fernet-tokens
Change-Id: Ifc84b8c97e1a85d30eb46260582d9c58220fbf0a
2017-08-02 13:22:05 +02:00
Pete Birley
6600530421 Helm: Update to v2.5.1
This PS updates helm to v2.5.1.

Change-Id: I2b4883ce5abb79afb4ef8be6058edd6c552249f7
2017-07-29 22:16:37 -05:00
Jenkins
95d58a2f22 Merge "Add specs directory to OpenStack-Helm" 2017-07-26 14:25:06 +00:00
Steve Wilkerson
7279be8b85 Add specs directory to OpenStack-Helm
Adds the specs/ directory to openstack-helm for housing future
specifications for the project.  It also includes an appropriate
README with directions for drafting specs, links to the openstack
resources for bp+spec lifecycle, and a template for use in
drafting specifications

Change-Id: Ice23447b358b520a8b4fb703fc836e8f09fa34d1
2017-07-25 11:17:35 -05:00
Alan Meadows
ccea6b4df5 Convert ceph to utilize hostNetworking
This enhances the stability and recovery of ceph by leveraging
hostNetworking for monitors as well as OSDs, and enables the
K8S_HOST_NETWORK variable within ceph-docker.  This enhancement should
allow recovery of monitors from a complete downed cluster.

Additionally, ceph's generic "ceph-storage" node label has been
split out for mon, mds, and osd.

Co-Authored-By: Larry Rensing <lr699s@att.com>
Change-Id: I27efe5c41d04ab044dccb5f38db897cb041d4723
2017-07-14 19:06:57 +00:00
Pete Birley
4d066332a7 Values: Move replicas to pod key
This PS move s the replicas key to be under the pod key in the values.
It brings further consolation of related configuration params to be
nested under common keys across all charts.

Change-Id: I420b06debd0a62ba5d83497be43ff6c49c49d339
2017-07-13 23:08:08 -05:00
Pete Birley
377d870417 Ceph: Update multinode doc
This PS updates the Multinode Doc for Ceph deployemnt now that we
have bootstrap capability within the chart.

Change-Id: I40110db926bbbcbfb5a08300784e6a9735d32955
2017-07-12 11:52:50 -05:00
Pete Birley
7421dcb36f Kubernetes: bump version to K8s v1.6.7
This PS moves the K8s Version to 1.6.7.

Change-Id: I5a2b871119429ac90a5a284ecc79ebca00dea1ff
2017-07-09 17:11:29 -05:00
Jenkins
3af383279c Merge "Cleanup troubleshooting docs" 2017-07-06 19:33:19 +00:00
Larry Rensing
10c9e8a13a Cleanup troubleshooting docs
This PS deletes superfluous documentation and empty files from
the troubleshooting section, and also updates some of the docs
regarding persistent storage troubleshooting.

Change-Id: I60876e40ffe1a1f88ac6c761e8bf10beee92c2a0
2017-07-06 18:14:29 +00:00
Pete Birley
0c36b4354d Helm: Move to Helm v2.5.0
This PS Moves OpenStack-Helm to Helm version 2.5.0.

Change-Id: I79da76875a44a5fb7ff55f8c9a9d114ca5f9c186
2017-07-06 12:45:34 -05:00
Jenkins
2a71a90b22 Merge "Update kubeadm-aio install docs" 2017-07-05 18:42:26 +00:00
Steve Wilkerson
860294f2e7 Update kubeadm-aio install docs
This clarifies some of the steps in the kubeadm-aio guide, which
includes: adding minimum suggested system specs, commands to
verify success of a helm chart installation, and general clean up
and reformatting of the docs

Change-Id: I3f8cac9de7940970754e09bedf4d1d37022e7255
2017-07-05 12:49:41 -05:00
Steve Wilkerson
780afe54e4 Add docs detailing testing and gating requirements
Adds basic expectations and explanations of openstack-helms
testing and gating approaches. This will continue to be expanded
upon but serves to provide a base on which to build

Change-Id: I689446b7124c4e11a92c73ef04e95d1840c6dc0a
2017-07-05 10:11:46 -05:00
Jenkins
8ac7ec6525 Merge "Updating DevRef docs" 2017-07-03 21:01:08 +00:00
Larry Rensing
f7ce1912f7 Updating DevRef docs
Removing superfluous documentation as well as moving changing doc
structure to better reflect contents of documentation.

Change-Id: I6fa798b9c6fc542ef05c954acae8641f69f5cb2b
2017-07-03 15:01:25 -05:00
Jenkins
a995e6ced7 Merge "Cleanup installation docs" 2017-07-03 19:40:18 +00:00
Jenkins
7bc3d6d5fe Merge "Update philosophy docs" 2017-07-03 19:30:21 +00:00
Steve Wilkerson
8846925640 Documentation reorganization and cleanup
This removes empty documentation pages and places the
troubleshooting docs to the top of the docs/source tree. Also
places the pod disruption budget docs to the rest of the
getting-started docs, which are primarily concepts used in
openstack-helm

Change-Id: Ic3f8deefbd873ae5332e14a12351d9967eb22b1b
2017-07-03 12:06:17 -05:00
Larry Rensing
8ce88e52e0 Cleanup installation docs
This PS organizes the installation document tree for easier navigation
and updating relevant content.

Change-Id: I51951d99dfc06bf441bd65ca817119cbca061851
2017-07-03 11:54:29 -05:00
Steve Wilkerson
7aaafc1556 Update philosophy docs
Removes the current philosophy docs for openstack-helm. As the
repo continues to change, we should consider approaching the
philosophy for openstack-helm in a different manner.

Change-Id: I284baa6e50229f020d201875c48e8f27dc5663ca
2017-07-03 11:27:31 -05:00
Larry Rensing
8b90c3386a Change custom kube-controller-manager references
This PS changes the install guide in order to have users pull our
custom kube-controller-manager image prior to initializing their
Kubernetes cluster.  Also changes the reference in the gate to remove
redundant lines.

Change-Id: Ic32742b1df8145a99c8333a3d0711113e3cce30e
2017-06-29 20:05:57 +00:00
Jenkins
c60c29b737 Merge "Docs: Minor fixes to multinode install doc" 2017-06-29 18:30:40 +00:00
Pete Birley
fc55d6b1db Docs: Minor fixes to multinode install doc
This PS makes some adjustments to the multinode install doc, removing
some steps that are no longer required.

Change-Id: I1775057c59ab8cc381398e51bb3487ca307eca83
2017-06-29 08:30:10 -05:00
Pete Birley
728caa3d7d Helm: fix incorrect refences to old version of Helm.
This PS fixes some references to Helm v2.3.1, which has been
replaced by Helm v2.4.1 as the reference version.

Change-Id: I369f4846623932c2420fab2632ac1c0d8aad3cff
2017-06-29 11:49:41 +00:00
Jenkins
e1874a7b1a Merge "Ingress controller for public endpoints" 2017-06-29 05:03:19 +00:00
Pete Birley
c0cf2337a2 Ingress controller for public endpoints
This PS provides the framework for Ingress controller based access to
public APIs.

Services covered:
 * Barbican
 * Cinder
 * Glance
 * Heat
 * Horizon
 * Keystone
 * Magnum
 * Mistral
 * Neutron
 * Nova
 * Senlin

Change-Id: I82d55f6ca41859ebed3312ec7d95b353df09e772
Implements: blueprint api-ingress
External-Tracking-Id: OSH-58, OSH-62
2017-06-28 17:37:10 -05:00
Tin Lam
39c1f5378e Change the documentation table format
As we update the version information in the document, the ascii rst
table easily gets misaligned and causes the doc gate to fail.  This
patch set changes the table structure, while retaining the formatting,
so future update of the document can be done easily without spending
time realigning the table cell border.

Change-Id: I84aeba3604ced255b057b7ce43f1f94a1af19b65
2017-06-27 21:47:39 -05:00
Pete Birley
8ef5d94674 Refactor Ceph secret generation
This PS refactors the ceph chart and secret generation process.
The updated chart replaces the existing "bootstrap" chart.
Additionally, Ceph manifests and deployment guides were modified
accordingly.

Change-Id: I6f5bb88fc0f40cfee8865d9dab83859d765e7537
Co-Authored-By: Larry Rensing <lr699s@att.com>
2017-06-27 13:42:03 -05:00
gardlt
66e2f55dae Docs: removing depricated minikube use
* we are now using the vagrant kubeadm-aio as main development env

Change-Id: I0561216a6a363de7df284d45da58d538f39735bf
2017-06-22 17:48:10 -05:00
Darla Ahlert
7eeb9836c1 Fixing outdated versions and broken links in docs
Change-Id: I81df87c39d3ac8f0ba321b8d37a74f873c9a974d
2017-06-21 13:39:41 -05:00
Michał Dulko
a6cd9bac16 Use k8s 1.6 syntax of declaring affinity
K8s 1.6 has affinity/antiaffinity funtionalities as a beta feature. This
means we don't need to declare them using annotations. This commit
switches usages of affinity to 1.6 syntax.

Change-Id: Ia68f4ab28a018617bd44b1295fea58cd30eb4a39
2017-06-20 16:51:07 +02:00
mattmceuen
cf4c6d50de Clarified a couple documentation points.
Conditionals:  since the developer flag is no longer used by the
glance chart, it's no longer a good example.  However, we want to
keep the flag around for future use if needed.  So, replaced with
a foo/bar example.

gen-oslo-openstack-helm README:  it referred to "this directory",
which doesn't make sense when the README is sourced into the
overall ops guide.  Specified the directory explicitly.

Change-Id: I2ba02bd3efd87e58fcb701c8b7c2bb6af05994ba
2017-06-12 21:38:49 -05:00
Jenkins
b5dcfcef59 Merge "Optimize the link address" 2017-06-12 15:43:52 +00:00
Van Hung Pham
d6a7f743d1 Optimize the link address
Update link address to ensure safety and preciseness

Change-Id: I25d47bfc3869802400f59381a242ac7f170f69e9
2017-06-12 04:38:50 +00:00
Darla Ahlert
ca5619608c Updating docs to be Calico 2.1 for consistency
Change-Id: I252d244dcfc6b81eff213aa2bf13dbd802453238
2017-06-09 10:31:03 -05:00
mattmceuen
b086b3fba9 Fix ceph instructions in multinode guide.
Removed inappropriate quotes from around kube_version in
the controller manager sed command, and clarified version
info for the controller manager.

Change-Id: Ied241a2d36524951942171630647411e2d76644c
Closes-Bug: #1695021
2017-06-06 21:26:26 -05:00
Stacey Fletcher
bf5c643ce1 Move dev directory contents and update VagrantFile
This PS moves the dev contents to the tools directory as well
as updates the VagrantFile to use the existing scripts
for installing kubeadm-aio and deploying helm charts.

Change-Id: I6768d1f96abe6b15f66931d543e9adcc0e82829b
2017-06-02 10:11:04 -05:00
Jenkins
1ca77db357 Merge "Update remaining markdown docs to RST" 2017-06-01 21:32:41 +00:00
Mark Burnett
de20cbb15d Use the standard Dockerhub MariaDB image
Addresses consistency issues that appear with autoincrement fields in
the existing chart, as demonstrated in [1].  It should allow automatic
recovery of 2 out of the 3 (default) cluster members.

It does not address automatic recovery of a complete shutdown of all
cluster nodes.

[1] https://review.openstack.org/#/c/465977/

Change-Id: I84c86e1862f03a6d381bf219b821ea3636049f0b
2017-05-25 08:56:35 -05:00
Michał Dulko
cc243499ec Update remaining markdown docs to RST
There were few remaining README.md files. This commit converts them to
RST.

Change-Id: Ia0be0012fff33b9be5c9db3febc1e45a076701ec
2017-05-22 10:56:51 +02:00
Larry Rensing
2cfabc43bf Add pod disruption budget for keystone
This is the initial pod disruption budget that will serve as the template
for all services in OpenStack-Helm.

Partially-Implements: blueprint add-pod-disruption-budgets

Change-Id: I67eeaa66257e793f77a089f3bc0dd4b700638c63
2017-05-18 21:04:33 +00:00
Jenkins
3116bb024d Merge "[docs] updating-install-multinode" 2017-05-17 13:40:47 +00:00
Tin Lam
6b4d84b216 Fix rtd formatting
This patch set addresses readthedocs.org loading oslosphinx, which results
in some inconsistencies. It should simply use the rtd theme on the rtd
environment.

Change-Id: I35f599416d3764a2ed0961653b3ce45717335e72
2017-05-14 17:54:31 -05:00
gardlt
03de0f267d Doc: fixing the helm install command
Change-Id: Ida0abf1e4d4fd9df1ba5b959aaca536c9069477f
2017-05-08 12:12:36 -05:00
gardlt
ee1ebd448e [docs] updating-install-multinode
* updating docs for multinodes

Change-Id: I723454abc423c3532e45ab4a2fba3d5b03116237
2017-05-05 17:27:10 -05:00
Pete Birley
67d80770e6 Gate: Refactor and setup for integration gating
This PS tidies up the gate and introduces the intial framework
for integration gating.

Change-Id: I0bbdfa2088e9ebbe86640c79df4d8b716d9a9705
2017-05-05 11:33:56 -05:00