223 Commits

Author SHA1 Message Date
Pete Birley
e0f076b658 Neutron: Ensure agent processes are reaped
This PS moves the neutron agents to run as child processes of either
the pause container or use the hosts init system (for k8s <1.10)
to prevent defunct process sprawl.

Change-Id: I3392bdc957144c1aa83314583d57183d35279336
Co-Authored-By: Hyunsun Moon <hyunsun.moon@gmail.com>
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-26 18:26:00 +00:00
Zuul
e8f561127f Merge "Add logging.conf files to enabled loggers/handlers/formatters" 2018-06-26 18:02:54 +00:00
Steve Wilkerson
da7bc575ec Add logging.conf files to enabled loggers/handlers/formatters
This introduces a mechanism for generating the logging.conf
file for the openstack services via the values. This allows us to
define loggers, handlers, and formatters for the services and the
modules they're composed of.

This also allows us to take advantage of the oslo fluent handler
and formatter. The fluent handler and formatter give us the
following benefits: sending logs directly to fluentd instead of
routed to stdout/stderr and then through fluentbit to fluentd,
project specific tags on the logged events (enables us to define
more robust filters in fluentd for aggregation if required),
full traceback support, and additional metadata (modules that
created logged event, etc)

Depends-On: https://review.openstack.org/577796

Change-Id: I63340ce6b03191d93a74d9ac6947f0b49b8a1a39
2018-06-26 09:51:14 -05:00
Pete Birley
e19be77f08 Ingress: Add initial TLS Support for core service public endpoints
This PS adds support for TLS on over-ridden fqdn's for public
endpoints for core OpenStack Services. Currently this implementation
is limited, in that it does not provide support for dynamicly loading
CAs into the containers, or specifying them manually via configuration.
As a result only well known or CA's added manually to containers will
be recognised.

Change-Id: I8f1b699af29cbed2d83ad91bb6840dccce8c5146
Depends-On: I535f38a8d92c01280d79926a1f0acd06984aabbf
Signed-off-by: Tin Lam <tin@irrational.io>
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-26 07:15:24 +00:00
Pete Birley
9fbd4fe793 Neutron: Use internal endpoint for nova communication
This PS moves to use the internal endpoint for nova interaction.

Change-Id: Ifb796fb80314c97bc117d82a93a9cd0cfa95591e
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-25 18:40:32 +00:00
Zuul
0163d9c17d Merge "Dynamic dependencies: remove unused variable" 2018-06-17 16:51:47 +00:00
Zuul
a3475ae9c8 Merge "Gotpl: remove quote and trunc to suppress output" 2018-06-17 07:14:10 +00:00
Pete Birley
75ecf8fdf4 Gotpl: remove quote and trunc to suppress output
This PS removes the use of the `quote and truncate` approach to
suppress output from gotpl actions in templates and replaces it
with the recommended practice of defining `$_` instead.

Change-Id: I5f35c5f7e70b4f7f461d772e3b72ed1c695c56a8
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-16 18:52:13 +00:00
Pete Birley
b1e515529f Dynamic dependencies: remove unused variable
This PS removes an unused variable from the resolution of
dynamic pod dependencies.

Change-Id: I95728a7b91d5143c2a44566179ef8066727020af
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-16 14:19:26 +00:00
Pete Birley
5cfa1501a2 Daemonsets/Deployments: Use current kubernetes api version
This PS moves to use the current ga version for kubernetes daemonsets,
additionally any remaining deployments that were using the
`extensions/v1beta1` have been updated to `apps/v1`.

Story: 2002205
Task: 21735
Depends-On: If9703162dc472af1e6096bf2b9062802fd5ce8ab

Change-Id: Iba4e3d2798c54639e077b80999e669c79b616c6f
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-15 14:35:31 -05:00
Zuul
5d4575e0fe Merge "Deployments: Use current kubernetes deployment version" 2018-06-14 15:54:03 +00:00
Pete Birley
67aed694c4 Deployments: Use current kubernetes deployment version
This PS moves to use the current ga version for kubernetes deployments.

Story: 2002205
Task: 21735
Depends-On: Icb4e7aa2392da6867427a58926be2da6f424bd56

Change-Id: I062a8a29dff70427ee9bcf09f595011b3611b0b1
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-13 21:29:59 -05:00
Pete Birley
f0937065ed Neutron: Increase default number of RPC workers
This PS increases the number of default RPC works to a more
sane value - even with a large number of replicas a single worker
thread has difficulty keeping up.

Change-Id: I9a4ce7a88983b52c506b6a5f6253688f8a3aa61e
Depends-On: I705f2ddf3facfe56838f606f88cfb15b822d18a5
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-13 13:17:27 +00:00
Zuul
0031c382ed Merge "neutron: use defaults to be appropriate "good enough" for most users" 2018-06-05 22:57:39 +00:00
zhulingjie
eb80c4f7f1 Update the home page for openstack project
Change-Id: I3841873915bb6e10e55375cd170688a7d6810535
2018-05-27 14:01:50 -04:00
Chris Wedgwood
f1ed9027ff neutron: use defaults to be appropriate "good enough" for most users
Change-Id: Id9923de748e73704f46d215f6687c66e50d28b8d
2018-05-25 19:11:11 +00:00
Pete Birley
460675bf7f Add image management function to manifests
When removing helm-toolkit from OSH and swithcing to use the
toolkit from OSH-Infra, the image declaration function was missed.

Depends-On: I2f2012590d81ffcb159d49d8a76eedd4441744cd
Change-Id: I0f1118bb748f3fe1b6bb73acfc00e77c5cca9c7d
Signed-off-by: Pete Birley <pete@port.direct>
2018-05-20 10:10:16 -05:00
Pete Birley
fc9a6610d5 Neutron: Queens support
There is a neutron bug in Queens that needs resolved for now, if we cannot
even get the version of neutron-sanity-check, skip this validation.

see: https://bugs.launchpad.net/neutron/+bug/1769868

Change-Id: Id41625f0073f197fcf8fe6170696977b8025dc7f
Signed-off-by: Pete Birley <pete@port.direct>
2018-05-17 14:59:03 -05:00
Pete Birley
9258649674 Neutron: provide config support for queens
This PS updates the neutron config to support up to the queens
release of OpenStack.

Change-Id: I02ffbb1d85134605e665b6bef4379d45af134b58
Signed-off-by: Pete Birley <pete@port.direct>
2018-05-17 06:30:26 +00:00
Hyunsun Moon
896fc6b8d2 ovs,neutron: use auto_bridge_add for external bridge and interface
Also changed ovs-agent-init to take care of configuring default external
bridge and interface for cosistency with lb-agent.

Change-Id: I1d893b73a784f55594c30f17ef022348d68f0f1b
2018-05-15 14:20:22 +00:00
Zuul
ab5776299c Merge "Start using nova_metadata_host" 2018-05-13 06:23:55 +00:00
Steve Wilkerson
354b311ec5 Add local-registry image managment to OSH from OSH-Infra
This PS adds the local registry image managment to OSH from OSH-Infra.
With this the delta between helm-toolkits in the Repo's is removed,
allowing the toolkit from OSH-Infra to be used and the one from OSH
to be depreciated.

Change-Id: If5e218cf7df17261fe5ef249d281f9d9637e2f6a
Co-Authored-By: Pete Birley <pete@port.direct>
2018-05-12 14:35:48 +00:00
Zuul
1f458b2057 Merge "neutron: default to OVSHybridIptablesFirewallDriver firewall driver" 2018-04-27 20:00:17 +00:00
Chris Wedgwood
2f0383eed1 neutron: default to OVSHybridIptablesFirewallDriver firewall driver
Default to using the hybrid iptables driver as the openvswitch
firewall driver is considered experimental and less well tested.

https://docs.openstack.org/neutron/pike/admin/config-ovsfwdriver.html

Change-Id: I76815685f31627dadd7d7b45f1527e051d9cbb89
2018-04-27 01:37:24 +00:00
Sean Eagan
97ac197a6e Move to v0.3.1 of kubernetes-entrypoint
Move to v0.3.1 of kubernetes-entrypoint which has 2
breaking changes to pod dependencies, and also adds support for
depending on jobs via labels.

Change-Id: I49d2cea11fbe5c5919ae22a020b877ebbb285992
2018-04-25 12:45:50 -05:00
Hyunsun Moon
6c9b4df6fe openvswitch: allow setting ovsdb connection using vsctl
Also changed neutron agents to use default, ptcp:6640:127.0.0.1.

Change-Id: Id43c376851f0c408da4684c219dc79ef4a1c157b
Closes-Bug: 1761117
2018-04-24 11:01:31 +09:00
Pete Birley
5bb772cf50 Neutron: Enable sharing of network namespaces with host
This PS enables sharing of network namespaces with the host,
allowing for hitless upgrades of agents, and much simpler debugging.

It does however require mount propogation to be enabled in kubernetes
which is a alpha gated feature introduced in 1.8, and enabled by default
as a beta feature in 1.10.

Depends-On: I7a37f45ff6061b144c6f04233712cd84fccb3e83
Change-Id: I2a191a343fe637cbfd9e4af5277f9784af736dd1
2018-04-22 22:23:09 +00:00
Pete Birley
5b9f231788 Neutron: Update rootwrap for distros where python2 is the default
This PS updates rootwrap to account for distros where python2 is
the default entrypoint for python 2.7 as opposed to either python
or python2.7.

Change-Id: Ia67768985133242e0aef10bb6ce54028eabfe1cf
2018-04-19 20:29:11 -05:00
Pete Birley
40a45b9751 RabbitMQ: Add vHost management and improve security
This PS adds vhost management to rabbitmq jobs. It also prevents
sensitive information being displayed in the management job, and
removes the 'administrator' tag from service users.

Change-Id: Id337f763c5e4776bce7269676a8a2dc54dc2e5f8
2018-04-19 08:26:45 -05:00
Chris Wedgwood
b642d44833 neutron: yaml indentation fixes
Change-Id: I579091fa21fcd0429bdc13df6cb2dfbeb8ae4a8e
2018-04-11 21:11:44 +00:00
portdirect
ceca6ad96c Neutron: Move all config to be directly values driven.
This PS moves all the config files to be directly values driven,
both simplifying over-ride and allowing configs to be targeted
to pods in future work.

Change-Id: Ifcbc19b17aa1d145f12ed1aed8b15a69ca045bb7
2018-03-27 13:25:17 -04:00
Zuul
757378fb7f Merge "fix typos in documentation" 2018-03-26 17:26:15 +00:00
Zuul
3ba1ccc06e Merge "Nova: Update endpoint path to 2.1" 2018-03-24 01:13:54 +00:00
Pete Birley
2f998bfb12 Nova: Update endpoint path to 2.1
This PS updates the Nova endpoint to use v2.1, which makes tempest
happy.

Change-Id: I1fbda225820cdc3b40be27198cc44caa15fac156
2018-03-23 11:34:06 -04:00
melissaml
205c50cd5d fix typos in documentation
Change-Id: Idb156b0141e177041de5c79b2118d682808d45aa
2018-03-23 08:38:21 +08:00
Pete Birley
5e153c3823 Neutron: SR-IOV agent template fix
This PS fixes the template rendered in the neutron SR-IOV agent
manifest.

Change-Id: Ib221213c8df94613a2dcf12e2615442db0684794
2018-03-22 15:21:11 -05:00
Zuul
80bd216d31 Merge "Neutron: agent host targetting" 2018-03-22 16:01:53 +00:00
Pete Birley
a7193c37d4 Neutron: agent host targetting
This PS adds the ablity to target different configs to different
hosts for the nutron agents, in the same manner as nova-compute.

Change-Id: Iebd87e30014d6cac2127c7e1a14259b10d74fbf8
2018-03-21 17:47:29 -04:00
Pete Birley
6971143048 Ingress: support arbitary hostnames.
This PS allows arbitary hostnames to be used for public endpoints,
provided the resolve externally to the ingress controllers.

Change-Id: I44411687f756968d00178d487af66c2393e6bde0
2018-03-21 09:39:55 -05:00
Zuul
c8af030287 Merge "Use pod dependencies in neutron chart" 2018-03-17 01:36:16 +00:00
Sean Eagan
3e877eac78 Use pod dependencies in neutron chart
Changes neutron chart to depend on pod labels instead of daemonsets.

Change-Id: Ieaa2f2863864229a4f6587c3e66fa661b9b7ef81
2018-03-16 09:29:11 -05:00
Brian Haley
594b428929 Start using nova_metadata_host
nova_metadata_ip was deprecated in Pike and is being
removed in Queens, update its usage.

Change-Id: I347720dc8c90f78dbaef7565c091d1367a29d7c4
2018-03-15 17:15:00 -04:00
Chris Wedgwood
8591b1c0c2 neutron: allow creation of ovs bridges with no ports
it's valid to create a bridge and not add ports; this restores that
ability

Change-Id: I46881fe3ee48a56a796abe8cf2036eba9e4064e1
2018-03-15 18:48:55 +00:00
Pete Birley
86be88e1d9 Neutron: SR-IOV support
This PS adds SR-IOV Support to OSH.

Change-Id: Ia744c6d7c4a45be7728bba3213b50f1246b897db
2018-03-14 18:13:13 -05:00
Zuul
32a468178b Merge "Ingress controller service: consolidate to helm-toolkit" 2018-03-14 02:14:22 +00:00
Pete Birley
507600e898 Ingress controller service: consolidate to helm-toolkit
This PS consolidates the Ingress controller service, that is used
to resolve internal requests to public endpoints correctly, to
helm-toolkit.

Change-Id: If7c7deca1b8289a32709f7dc7c936883469aadfe
2018-03-12 13:48:39 +00:00
Zuul
4f0aeb619d Merge "DB-Drop-Jobs: consolidate to helm-toolkit" 2018-03-10 20:10:23 +00:00
Pete Birley
6e4bcebcf5 DB-Drop-Jobs: consolidate to helm-toolkit
This PS consolidates the DB-Drop Job to helm-toolkit.

Change-Id: Ia2b035d730bf612086a9fd9b5d14aba494f56dc7
2018-03-09 14:25:15 +00:00
Pete Birley
02767f6d76 Reduce the number of workers spawned by services
This PS reduces the number of processes spawned by services, as
with Kubernetes load distribution can be better managed by a larger
number of single threaded pods (up to a certain point) and doing so
also provides both increased avilibility, leading to smoother rolling
updates. In addtion when running single replicas resource consuption
is reduced.

Change-Id: Ifb7494a0804913d843a072e10d26c6ec53c3bd16
2018-03-09 06:39:02 +00:00
Zuul
4884dd228c Merge "Keystone Authtoken Cache: allow universal secret key to be set" 2018-03-05 19:26:37 +00:00