190 Commits

Author SHA1 Message Date
Ruslan Khanbikov
e0ed5d2708 RabbitMQ: It adds HA and ttl policy for notificaitons queues
This patchset introduces mirroring "notificaitons.*" queues messages across
rmq cluster nodes and add ttl expiration time for messages, utilizing
rabbitmq helm-toolkit

the configuration example:

rabbitmq:
  policies:
    - name: "test"
      vhost: "nova"
      definition: ".*"
      definition:
        ha-mode: all
  ...

equals:
 rabbitmqctl set_policies -p nova test ".*" "{"ha-mode":"all"}"
Signed-off-by: Ruslan Khanbikov <rk760n@att.com>

Change-Id: I61215de07cfaeb9d896126ef9abc94fcc9e429b9
Depends-On: I85240a50fb64a4d74454768034fe3bdcf25f3019
2018-07-06 18:31:25 +00:00
Zuul
e8f561127f Merge "Add logging.conf files to enabled loggers/handlers/formatters" 2018-06-26 18:02:54 +00:00
Steve Wilkerson
da7bc575ec Add logging.conf files to enabled loggers/handlers/formatters
This introduces a mechanism for generating the logging.conf
file for the openstack services via the values. This allows us to
define loggers, handlers, and formatters for the services and the
modules they're composed of.

This also allows us to take advantage of the oslo fluent handler
and formatter. The fluent handler and formatter give us the
following benefits: sending logs directly to fluentd instead of
routed to stdout/stderr and then through fluentbit to fluentd,
project specific tags on the logged events (enables us to define
more robust filters in fluentd for aggregation if required),
full traceback support, and additional metadata (modules that
created logged event, etc)

Depends-On: https://review.openstack.org/577796

Change-Id: I63340ce6b03191d93a74d9ac6947f0b49b8a1a39
2018-06-26 09:51:14 -05:00
Pete Birley
e19be77f08 Ingress: Add initial TLS Support for core service public endpoints
This PS adds support for TLS on over-ridden fqdn's for public
endpoints for core OpenStack Services. Currently this implementation
is limited, in that it does not provide support for dynamicly loading
CAs into the containers, or specifying them manually via configuration.
As a result only well known or CA's added manually to containers will
be recognised.

Change-Id: I8f1b699af29cbed2d83ad91bb6840dccce8c5146
Depends-On: I535f38a8d92c01280d79926a1f0acd06984aabbf
Signed-off-by: Tin Lam <tin@irrational.io>
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-26 07:15:24 +00:00
Pete Birley
75ecf8fdf4 Gotpl: remove quote and trunc to suppress output
This PS removes the use of the `quote and truncate` approach to
suppress output from gotpl actions in templates and replaces it
with the recommended practice of defining `$_` instead.

Change-Id: I5f35c5f7e70b4f7f461d772e3b72ed1c695c56a8
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-16 18:52:13 +00:00
Zuul
5d4575e0fe Merge "Deployments: Use current kubernetes deployment version" 2018-06-14 15:54:03 +00:00
Pete Birley
67aed694c4 Deployments: Use current kubernetes deployment version
This PS moves to use the current ga version for kubernetes deployments.

Story: 2002205
Task: 21735
Depends-On: Icb4e7aa2392da6867427a58926be2da6f424bd56

Change-Id: I062a8a29dff70427ee9bcf09f595011b3611b0b1
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-13 21:29:59 -05:00
Pete Birley
641cc4a15a Cinder: update functions to live in correct locations
This PS simply moves functions within the chart to their correct location.

Change-Id: I6430304528b964d9babcd54e3336f3016b8efde6
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-13 17:43:47 -05:00
Steve Wilkerson
9c44676649 Ceph-config-helper: Add rgwadmin python package
This adds the rgwadmin python package to the ceph config helper
image, allowing it to be used for creating s3 buckets for radosgw
to be used with elasticsearch

Change-Id: I2c633a4715ef1fdccd833cc8eeaefddbecb0cec4
2018-06-12 18:24:59 +00:00
Pete Birley
cc67153031 Cinder: add deps for rabbitmq job
This PS adds dep checking for the rabbitmq management jobs.

Change-Id: Ib5702e0fa681b51072edc33a518b98fcb45c114e
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-05 17:44:58 -05:00
zhulingjie
eb80c4f7f1 Update the home page for openstack project
Change-Id: I3841873915bb6e10e55375cd170688a7d6810535
2018-05-27 14:01:50 -04:00
Pete Birley
460675bf7f Add image management function to manifests
When removing helm-toolkit from OSH and swithcing to use the
toolkit from OSH-Infra, the image declaration function was missed.

Depends-On: I2f2012590d81ffcb159d49d8a76eedd4441744cd
Change-Id: I0f1118bb748f3fe1b6bb73acfc00e77c5cca9c7d
Signed-off-by: Pete Birley <pete@port.direct>
2018-05-20 10:10:16 -05:00
Pete Birley
3587e1679b Cinder: Use Swift for volume backups by default
This PS changes the default volume backup backend to be swift
as this is both better tested and volume driver backend agnostic,
in addition to permitting easier export of data by tenants.

Change-Id: Ibd9716c07fda5a040dc88d7976816d9e63c581db
2018-05-13 14:53:33 +00:00
Pete Birley
20abcad4d5 Cinder: Use correct service names for api versions
This PS updates cinder to use the correct service names for API
versions

V2:
 * https://github.com/openstack-dev/devstack/blob/stable/newton/lib/cinder#L387
 * https://github.com/openstack-dev/devstack/blob/master/lib/cinder#L381

V3:
 * https://github.com/openstack-dev/devstack/blob/stable/newton/lib/cinder#L395
 * https://github.com/openstack-dev/devstack/blob/master/lib/cinder#L387

The custom value for Nova's cinder catalog_info is also removed, as this was
required to use the incorrect service catalog names.

Change-Id: Ic88826a3c8233e260caca69272cf32021825b48c
2018-05-13 04:00:28 +00:00
Pete Birley
d342ac40cb Ceph: Setup radosgw with increased swift support.
This PS updates the cephs config to deploy radosgw with greater
swift compatibility. Allowing clients to use RGW as though it
were a real swift deployment.

Change-Id: Id0a27b42b7f9c0c9e4b5a197ef50feb612e6adfc
2018-05-12 12:58:03 -05:00
Steve Wilkerson
354b311ec5 Add local-registry image managment to OSH from OSH-Infra
This PS adds the local registry image managment to OSH from OSH-Infra.
With this the delta between helm-toolkits in the Repo's is removed,
allowing the toolkit from OSH-Infra to be used and the one from OSH
to be depreciated.

Change-Id: If5e218cf7df17261fe5ef249d281f9d9637e2f6a
Co-Authored-By: Pete Birley <pete@port.direct>
2018-05-12 14:35:48 +00:00
Pete Birley
45b223d9d1 Ceph/Libvirt/Cinder/Nova: update charts to support OpenStack >= Ocata
This PS updates the charts to suuport Ceph RBD volume attachment, for
Newton to Queens.

Change-Id: I675ee65579e7f9a0b328a03b4064cd85ae5d1de7
2018-05-08 18:32:17 +00:00
Sean Eagan
97ac197a6e Move to v0.3.1 of kubernetes-entrypoint
Move to v0.3.1 of kubernetes-entrypoint which has 2
breaking changes to pod dependencies, and also adds support for
depending on jobs via labels.

Change-Id: I49d2cea11fbe5c5919ae22a020b877ebbb285992
2018-04-25 12:45:50 -05:00
Pete Birley
40a45b9751 RabbitMQ: Add vHost management and improve security
This PS adds vhost management to rabbitmq jobs. It also prevents
sensitive information being displayed in the management job, and
removes the 'administrator' tag from service users.

Change-Id: Id337f763c5e4776bce7269676a8a2dc54dc2e5f8
2018-04-19 08:26:45 -05:00
Hyunsun Moon
7295f308cc Don't mount pvc-ceph-client-key when not used
Closes-Bug: 1755975
Change-Id: I65a2e99cecce63bdae20f6e83cf62edf5327d7c6
2018-04-17 17:14:08 +09:00
Chris Wedgwood
fa85206d8c cinder: yaml indentation fixes
Change-Id: Ia59b2822dbe40ab7431987b2dc55e00067275f86
2018-04-11 21:11:25 +00:00
Pete Birley
44841fbffc Storage: increase robustness of storage clean jobs
This PS increases the robustness of storage cleaning jobs by
precreating the service accounts and roles for the pod to consume,
and removes the potential for race conditions by removing the delete
hook.

Change-Id: I1f3c35fe2bd2a4325430e8025951349526f683af
2018-04-04 21:51:31 -05:00
portdirect
6219bba2c7 Cinder: Move all config to be directly values driven.
This PS moves all the config files to be directly values driven,
both simplifying over-ride and allowing configs to be targeted
to pods in future work.

Change-Id: I286af7434aab6de941f9700a7fbf70c6dd0ee4cb
2018-03-27 19:36:28 +00:00
Zuul
c9a875e9f4 Merge "Ingress: support arbitary hostnames." 2018-03-21 23:24:55 +00:00
Pete Birley
6971143048 Ingress: support arbitary hostnames.
This PS allows arbitary hostnames to be used for public endpoints,
provided the resolve externally to the ingress controllers.

Change-Id: I44411687f756968d00178d487af66c2393e6bde0
2018-03-21 09:39:55 -05:00
Sean Eagan
85587f2f56 Use v0.3.0 of kubernetes-entrypoint
This version is already being used by some charts, so this brings the
rest of the charts in line and allows them to use a new feature,
pod dependencies, that this version provides.

Change-Id: Ie8289eb09b31cd8f98c2c5b4dd5bbe469078e6d8
2018-03-19 10:35:36 -05:00
Zuul
cae75a8a99 Merge "Cinder: Fix default uid for cinder user with loci images" 2018-03-14 18:11:07 +00:00
Zuul
a310524c9d Merge "Cinder: Fix sudoers reference in configmap" 2018-03-14 04:28:24 +00:00
Zuul
32a468178b Merge "Ingress controller service: consolidate to helm-toolkit" 2018-03-14 02:14:22 +00:00
Pete Birley
0ce97b3996 Cinder: Fix default uid for cinder user with loci images
This PS corrects the UID for the cinder user used with loci images
in the cinder chart.

Change-Id: I1001711928fb47e77f01c8e83f88ec317a46498e
2018-03-14 01:29:20 +00:00
Steve Wilkerson
9de56d8fc8 Cinder: Fix sudoers reference in configmap
The cinder_sudoers entry in the cinder configmap-etc was consuming
the neutron_sudoers entry in the values.yaml. This corrects it to
point at cinder_sudoers instead

Change-Id: I214912b3ed4185a201f4f94e82eaa50d6d321018
2018-03-13 17:37:40 -05:00
Pete Birley
507600e898 Ingress controller service: consolidate to helm-toolkit
This PS consolidates the Ingress controller service, that is used
to resolve internal requests to public endpoints correctly, to
helm-toolkit.

Change-Id: If7c7deca1b8289a32709f7dc7c936883469aadfe
2018-03-12 13:48:39 +00:00
Zuul
4f0aeb619d Merge "DB-Drop-Jobs: consolidate to helm-toolkit" 2018-03-10 20:10:23 +00:00
Zuul
b177040b6c Merge "Reduce the number of workers spawned by services" 2018-03-10 15:56:01 +00:00
Pete Birley
6e4bcebcf5 DB-Drop-Jobs: consolidate to helm-toolkit
This PS consolidates the DB-Drop Job to helm-toolkit.

Change-Id: Ia2b035d730bf612086a9fd9b5d14aba494f56dc7
2018-03-09 14:25:15 +00:00
Pete Birley
02767f6d76 Reduce the number of workers spawned by services
This PS reduces the number of processes spawned by services, as
with Kubernetes load distribution can be better managed by a larger
number of single threaded pods (up to a certain point) and doing so
also provides both increased avilibility, leading to smoother rolling
updates. In addtion when running single replicas resource consuption
is reduced.

Change-Id: Ifb7494a0804913d843a072e10d26c6ec53c3bd16
2018-03-09 06:39:02 +00:00
Pete Birley
e8219bc6d8 Cinder: allow Ceph RBD pool params to be tuned
This PS exposes the Ceph RBD pool params to the cinder chart, allowing
them to be tuned.

Change-Id: I615e999928948193b24cc4978efb31bd1b36f8f7
Closes-Bug: #1754535
2018-03-09 01:56:32 +00:00
Hemanth Nakkina
8c9ac9f5df Remove Api version constraint for CronJob
Cronjob resource is deprecated in batch/v2alpha1 from
k8s 1.8 and batch/v1beta1 is enabled by default. All the
CronJobs are already using batch/v1beta1 but there is condition
to check if api version have batch/v2alpha1.

Remove the api version constraint on batch/v2alpha1

Partial-Bug: #1753524
Change-Id: I7eeb7d6cc2630311ec5d613b9e059824daae0620
2018-03-06 08:46:22 +05:30
Zuul
4884dd228c Merge "Keystone Authtoken Cache: allow universal secret key to be set" 2018-03-05 19:26:37 +00:00
portdirect
1c85fdc390 Keystone Authtoken Cache: allow universal secret key to be set
This PS allows a cache secret key for all instances of keystone
middleware to be defined in a single location.

Change-Id: I3d5c78732d8a8bb9110117130f0d886fea609526
Partial-Bug: 1753251
2018-03-05 08:49:24 -05:00
Pete Birley
af92423d60 Cinder: use endpoints section and lookups to set port
This PS moves cinder to use the endpoints section and lookups to
set the port it serves on.

Change-Id: Ib95c89f1ff4d20eb3bb57aad325ae31f0ec52532
2018-03-03 15:50:37 +00:00
Renis
1ecc905b65 Rabbitmq Credential Management
- This PS implements job to create new user
for each chart

Change-Id: I7335ba4ad4bc9f70871100dbd9e6f030049abe07
2018-02-26 17:44:44 -08:00
Pete Birley
f57972b5b6 dependencies: move static dependencies under a 'static' key
This PS moves static dependencies under a 'static' key to allow
expansion to cover dynamic dependencies.

Change-Id: I38990b93aa79fa1f70af6f2c78e5e5c61c63f32c
2018-02-23 12:31:15 -08:00
Pete Birley
49aacc2030 Ingress rules: consolidate to helm-toolkit
This PS consolidates ingress rules to helm-toolkit.

Change-Id: I38a4de939e1ec65fed1630a53787d363f2ec78f6
2018-02-21 10:21:16 -08:00
Chris Wedgwood
6b844382ad yaml cleanup: trim multiline strings
Change-Id: Ice615c1d252651793dfa09b8e85a5b4228d68737
2018-02-20 16:39:52 +00:00
Zuul
9bbd48362f Merge "Helm-Tests: Target pods by node-labels" 2018-02-20 15:28:43 +00:00
Zuul
e4313c86c7 Merge "remove unnecessary calls to quote" 2018-02-20 14:53:21 +00:00
portdirect
c7e2eb9e25 Bootstrap jobs: move template to helm toolkit
This PS moves the templates for bootstrap jobs to helm-toolkit.

Change-Id: I0fc0f7722cfc87b00e26510dee7ba79d2139a171
2018-02-19 22:53:34 -05:00
Chris Wedgwood
4f6a9983f5 remove unnecessary calls to quote
Change-Id: I1099c3f56b1d81b97033a8653d6bf1b9ea4d04e7
2018-02-19 18:55:46 +00:00
portdirect
f19f0873f0 Helm-Tests: Target pods by node-labels
Change-Id: Ie71ef58fb7eb530fd49512e10d7666ec08d99609
2018-02-19 12:25:45 -05:00