45 Commits

Author SHA1 Message Date
Steve Wilkerson
5bc7ded909 Update names of helm test pods for openstack services
This updates the names of the helm test pods to give all services
in OSH-infra/OSH a uniform '{{ .Release.Name }}-test' name, which
allows for easier gathering of test results across all deployed
services

Change-Id: I24df7a18d32b99d1ffaad19647ef724316e2fe20
2017-12-14 14:03:12 +00:00
Zuul
2c89386765 Merge "Image puller: fix user and location in gate." 2017-11-14 21:46:35 +00:00
intlabs
4d0492a9fc Image puller: fix user and location in gate.
This PS fixes the location of the image pull command in the gate
and also moves the position it is run at to after docker is
installed.

Change-Id: I45573ae18147a44e99698bfac208fe1f2dcf6128
2017-11-14 19:23:45 +00:00
Zuul
f8377b1258 Merge "Kernel Modules: Load via chroot into host" 2017-11-13 20:08:00 +00:00
intlabs
35267bffe4 Kernel Modules: Load via chroot into host
This PS moves the loading of kernel modules required by services to
being perfromed via a chroot on the host, this ensures that the correct
module is found and provides compatibility across distros.

Change-Id: I889fdd047a24bf4b123dadf9f6d6e6e8079d69d1
2017-10-31 23:51:53 +00:00
Vlad Naboichenko
a168c44949 Modify DockerFile to support multiple k8s versions
- service-node-port-range changed to support extended port range

Change-Id: Ia3d70504ffe1ac93df816b9798e8341dde9b65bb
2017-10-31 18:43:30 +00:00
intlabs
a89ee54171 Images: add pull all images to makefile
This PS adds a `pull-all-images` target to the makefile, which
requires yq to operate.

Change-Id: I58b871b99f48cbd636b3db66db812be3dfc1a204
2017-10-23 12:26:28 -05:00
Artur Korzeniewski
ece78c448d Ceph subnet_range calculation improvement
Gate scripts are trying to calculate the SUBNET_RANGE basing on IP address
of default interface. There is ipcalc tool used.
The issue is that based on infra datacenter selected to run the VM gate,
the default interface can have address with /32 network.

If IP has /32 network, the ipcalc would not calculate the network address,
for example 192.168.0.0/24, which is needed for ceph to be configured.

As a workaround, try to change the /32 to /24 after getting the IP of the
default interface, and then calculate the network address.

Change-Id: Ia2858c6a2b4c56fbc42ef06b5f157625a56beb3c
2017-10-10 18:19:10 +02:00
Pete Birley
a3f6838c72 Fedora: fix gate script on F25
This PS re-enables support for F25 in the gate scripts.

Change-Id: Icbaac6c568ac917ae24971ca0ce207d4b1a2b138
2017-09-22 22:56:50 +00:00
Pete Birley
285959c863 Disk targeting
This PS adds a disc targeting framework for OSH Components for
services like Ceph, Swift, and Cinder (LVM) to use when targeting
phsical discs. It uses the bus ID of the attached device to simplfy
management of large quanitites of physical hardware.

Change-Id: I1cb227e43ed5394d4c68c6156047889574a0e869
2017-09-22 20:32:21 +00:00
Chris Wedgwood
22488a5c14 gate: add a second upstream DNS server
We get transient DNS failures, having a second DNS server should help.

Change-Id: I8307ba0c2b8f2b12eb714dfd8b7034c7645ff288
2017-09-21 17:52:31 +00:00
Chris Wedgwood
e6cdfcdd07 gate: expose timeouts for node and pod startup
Change-Id: I98da4768c438cb1801cf481a229a1a0f74df1415
2017-09-20 21:36:13 +00:00
Chris Wedgwood
30f63c349d gate: Introduce POD_START_TIMEOUT (default 480s)
Change-Id: I29a56527bfb00f9953cdc37b5fafb8e98f6334ed
2017-09-13 22:51:16 +00:00
Artur Korzeniewski
3653128bd3 Preparation for Neutron Linuxbridge gate
Added new variable SDN_PLUGIN to handle gate behavior when using ovs or
linuxbridge.

By default SDN_PLUGIN is set to ovs.

To enable testing linuxbridge, new gate have to be created, with
SDN_PLUGIN set to linuxbridge.

Change-Id: I014307ae497374b5b6fa00946b01fa5d93c3056f
Implements: blueprint support-linux-bridge-on-neutron
2017-09-12 10:23:57 +02:00
Jenkins
198162a073 Merge "Fix some typos" 2017-09-03 04:47:48 +00:00
Pete Birley
0251c099ba Nova: Support Cinder Volume Attachement using Ceph Backend
This PS enables cinder volume attachment for nova when used with ceph.

Change-Id: I9772f38fb3a1a9af26bd92ee18a651d3372de64c
2017-08-25 14:07:34 -05:00
Pete Birley
ff6e6d19f9 Gate: Heat functional test
This PS adds a functional test of heat in the OSH gates, it also moves
most params to a seperate file - making config of the gate in non-zuul
environments simpler.

Change-Id: I37a1bc0dcc8000c5da8067a8d376c78f7cd6f7ab
2017-08-21 13:55:53 -05:00
Pete Birley
0c715b8b3c Gate: Add heat to single node checks and to Armada checks
This PS adds heat to the single node and Armada based deployment
checks in the gate scripts. Additionally it moves the client calls
in the check scripts to use the heat engine pod.

Change-Id: Iccc996fb2b2140ed19c6708d6033b4a9dd1bfc46
2017-08-20 13:20:48 -05:00
Tin Lam
8e76f32407 Add barbican helm test
This patch set adds basic barbican test using the OpenStack Client.  This
patch set also addressed an issue where the href contains a duplicate
version in the path, e.g. http://URL:xxxx/v1/v1/secrets in secret path.

Change-Id: Ie66d00d5a0b02721ba41e6bf4b5e784fb49adce8
2017-08-15 05:08:20 -05:00
lidong
75a2639a48 Fix some typos
Correct some spelling errors in files : 
mariadb/templates/etc/_00-base.cnf.tpl,tools/gate/funcs/kube.sh


Change-Id: Ie6d7f2b90a8d569663452d00565af2789bbb377e
2017-08-08 03:39:06 +00:00
Steve Wilkerson
9fa445ab44 Fix -- Ceph in multinode gate
This fix aims to address the multinode gate issues for IPs on the
same subnet.

Change-Id: If158f78acf4d5e32eb495354307a0e3e5343ef6e
2017-08-07 17:11:11 -05:00
Jenkins
dbfbbda826 Merge "Ceph: Fix Multinode Gates" 2017-08-07 16:28:17 +00:00
Pete Birley
59dfea0e58 Ceph: Fix Multinode Gates
This PS should make the multinode gate more reliable for ceph.

It's not perfect in that is uses the default route IPs in zuul, which
has a performance hit. The bash is also ugly as sin - but it gets us
moving again until somone has time to implement a more eligant solution
that works both in infra supplied nodes and other CI systems.

Change-Id: Ie1326f048c43d04a945ca155bde8824d17ddcbec
2017-08-07 03:39:37 +00:00
Pete Birley
fdbe8eb60d Gate: Loopback device support
This PS adds loopback device support to the gate scripts.
Rather than using simple loopback devices we use iscsi to
allow is to target the created devices via the bus they are
connected to. An arbitary number of devices of a desired size
can be created, and controlled via env vars.

Change-Id: I05fb7f3a1564bc36903aed2c46ed996bb8cc57c8
2017-07-31 17:12:20 -05:00
Pete Birley
04e015e49b Zuul: Gate script tidy
This PS cleans up some of the worst offenders in the gate scripts.

Change-Id: If310ae798c9572e8bde4834e5a4af5f97196efea
2017-07-29 23:58:08 -05:00
Pete Birley
09ff02a2d6 Install helm template plugin using helm
This PS removes the workaround required by older versions of helm to
install the template plugin.

Change-Id: I35fb80b0841fb0d0be260694bd94580a7df1cc45
2017-07-29 10:07:50 -05:00
Alan Meadows
ccea6b4df5 Convert ceph to utilize hostNetworking
This enhances the stability and recovery of ceph by leveraging
hostNetworking for monitors as well as OSDs, and enables the
K8S_HOST_NETWORK variable within ceph-docker.  This enhancement should
allow recovery of monitors from a complete downed cluster.

Additionally, ceph's generic "ceph-storage" node label has been
split out for mon, mds, and osd.

Co-Authored-By: Larry Rensing <lr699s@att.com>
Change-Id: I27efe5c41d04ab044dccb5f38db897cb041d4723
2017-07-14 19:06:57 +00:00
Pete Birley
66686005e5 DNS: add helper chart to OSH for setting up hosts resolv.conf
This PS adds a chart to setup the resolv.conf on hosts running
openstack-helm. The purpose of this is to reduce friction when
performing basic deployments of OS-H.

Change-Id: I6c6348afb01869cff9a90328ede795d92a91fb12
2017-07-10 11:11:14 -05:00
Steve Wilkerson
9797750fd2 Add support for helm tests in multiple namespaces
Originally, the function to execute helm tests expected the helm
release to be in the openstack namespace. This changes the
function to get the namespace directly from the helm releases to
allow for the gathering of logs and removal of resources from the
namespace a release was installed to

Change-Id: Ic9d1215f363a6251bcc33bead311aba1ba67a658
2017-07-01 17:00:07 -05:00
Jenkins
c4c1b937dd Merge "Gate: fix multinode support for running outside of zuul" 2017-06-29 23:20:35 +00:00
Pete Birley
5fd358f0ba Gate: fix multinode support for running outside of zuul
This PS fixes multinode operation when run outside of zuul.

Change-Id: I66fecae7c14fa4022882235d656f5c0ac97c12bc
2017-06-29 17:27:59 -05:00
Larry Rensing
8b90c3386a Change custom kube-controller-manager references
This PS changes the install guide in order to have users pull our
custom kube-controller-manager image prior to initializing their
Kubernetes cluster.  Also changes the reference in the gate to remove
redundant lines.

Change-Id: Ic32742b1df8145a99c8333a3d0711113e3cce30e
2017-06-29 20:05:57 +00:00
Pete Birley
8ef5d94674 Refactor Ceph secret generation
This PS refactors the ceph chart and secret generation process.
The updated chart replaces the existing "bootstrap" chart.
Additionally, Ceph manifests and deployment guides were modified
accordingly.

Change-Id: I6f5bb88fc0f40cfee8865d9dab83859d765e7537
Co-Authored-By: Larry Rensing <lr699s@att.com>
2017-06-27 13:42:03 -05:00
Pete Birley
960613e5c6 Boot VM's and basic functional test in Zuul Checks
This PS adds basic vm booting and functional testing to the single node
Zuul gates. Multinode testing will be once we have ceph running in zuul.

Change-Id: Ifcbdcaa4a30dee4088e369d4410dd737ef6f12cd
2017-06-22 14:23:26 -05:00
Pete Birley
979591af87 KubeADM-AIO: Make init more stable and support multiple PVC backends
This PS makes the init of the KubeADM environment more stable by ensuring
all kube-system pods are up before trying to launch tiller. the NFS PVC
provider is now made optional but enabled by default, so that Ceph (and
other more complex providers) can be supported in future. Finaly the
scripts to bring up k8s/helm are refined to not bring in the clients if
already present with the correct versions on the host.

Change-Id: I4d7ceb6196e8fd5e3350ec99f09fbe6bb5fe01f6
2017-06-14 20:30:51 -05:00
Tin Lam
39d12c6d77 Remove temporary folder copying logic
This patch set removes the need to create a temporary directory
brought up in patch set [0].

[0] https://review.openstack.org/#/c/472451/

Change-Id: I57448d9722a33bb63fca5576d19b61f3015828ec
2017-06-12 23:02:12 -05:00
Jenkins
0a8dfeb517 Merge "Checks: Run the helm template plugin against charts" 2017-06-12 22:44:05 +00:00
Jenkins
374752131d Merge "N-Node gate, and improved logging" 2017-06-09 20:50:21 +00:00
Pete Birley
de656ea7f2 N-Node gate, and improved logging
This PS sets up the check scripts to support a N node gate in zuul
it also adds more comprehensive logging of OS-H.

Change-Id: Id2af01c688a438eeec348f221fb05b09401c80a0
2017-06-09 15:00:29 -05:00
Alan Meadows
a3972f6e5d Ensure gate failure summary shows node assigned to each pod
Change-Id: Ic765a423eddcd13961b395cbcee7b86c5fd07760
2017-06-09 08:10:15 -07:00
Pete Birley
8ec335cbfd Checks: Run the helm template plugin against charts
This PS runs the helm template plugin against charts in the linter
gate.

Change-Id: I660588707a4e2b49d9661222b590dfea67b74fb1
2017-06-08 17:23:41 -05:00
Pete Birley
97f781d6c3 Helm Test: Framework & Keystone
This PS introduces 'helm test' functionaility to keystone and
provides the basic framwork for charts to use.

Change-Id: Ie84a6ca0ed007fb55e10d503d1c3e49788908eec
Partial-Implements: blueprint implement-helm-test-for-charts
2017-06-06 16:52:34 -05:00
Pete Birley
1ca8efa3a6 KubeADM-AIO: Update Image to support Multinode Operation Natively
This PS also pins the remaining components of the kubelet, moves
the K8s version to 1.6.4 and restores CentOS 7 operation.

Change-Id: Ia32c9e02dbf9451c13addce436f6e36f5a0a622f
2017-06-05 18:09:16 -05:00
Pete Birley
f68b0306ab Gate: CentOS, Fedora and local use support
This PS adds support for CentOS, Fedora and running the gate locally
on a developers machine. It also expands on the original gate scripts
by setting up dns access to the OpenStack cluster from the host's
running OpenStack-Helm using a daemonset.

Change-Id: I99c573a44a73452d558e612fc020e22e7f41ade7
2017-05-18 17:49:05 -05:00
Pete Birley
67d80770e6 Gate: Refactor and setup for integration gating
This PS tidies up the gate and introduces the intial framework
for integration gating.

Change-Id: I0bbdfa2088e9ebbe86640c79df4d8b716d9a9705
2017-05-05 11:33:56 -05:00