631 Commits

Author SHA1 Message Date
Duong Ha-Quang
2d3866c6a4 Specify 'become' for only necessary tasks (default roles)
Add become to only neccesary tasks in roles:
- glance
- heat
- horizon
- keystone
- neutron
- nova
- openvswitch

Gate is also updated to use 'become' feature

Change-Id: I2f3f27306e9f384148e1ad4d54d8da2ebef34d00
Partial-Implements: blueprint ansible-specific-task-become
2017-10-31 02:55:31 +00:00
Jeffrey Zhang
cdd125117f Optimize zuul v3 jobs
- move check container failure from post.yml to run.yml
- add binary related jobs
- use static kolla-ansible src dir, which is helpful for kolla project
  to use.
- generate correct /etc/hosts by using private ip address and hostname
- fix the wrong api interface in global.yml file

Change-Id: Idfdee6dfe18f0fa2d4f984df59b57553122ce298
2017-10-26 09:58:29 +08:00
Zuul
e2301f0717 Merge "Add support for --skip-tags argument" 2017-10-19 20:41:58 +00:00
Jeffrey Zhang
baa9319a75 Move to zuul v3 in project jobs
Partial-Bug: #1720601
Change-Id: Ibc20a6ae8c645ff82f3c14a6286073dffd4cfae2
2017-10-18 12:31:52 -07:00
Mark Goddard
c3e91725e2 Add support for --skip-tags argument
This allows for skipping tasks which match the provided tags, using
the ansible-playbook argument of the same name.

This can be useful in combination with --tags, to skip reconfiguration
of the common tasks:

kolla-ansible reconfigure --tags nova --skip-tags common

Change-Id: I766552f7ae4099da3d174759f4a609ffe8b4d89f
2017-10-17 09:31:20 +01:00
Jenkins
8808c8a6e0 Merge "Add support for vault passwords" 2017-10-08 11:24:57 +00:00
Eduardo Gonzalez
fa06dcd37b Fix ci gate failure
This patch includes three unrelated fixes.

Make qemu use nova user in centos
Libvirt 3.2.0 (latest version in centos) seems to
have changed behavior of dynamic_ownership.

Pin ansible to <2.4 to make ara work in gates
ARA does not work yet with ansible 2.4, this change
pins to lower version to make gates work.
Revert once ara works with 2.4

Disable selinux for oraclelinux and centos.

Co-Authored-By: wanghongxu <wang19930902@gmail.com>
Co-Authored-By: Jeffrey Zhang <jeffrey.zhang@99cloud.net>
Change-Id: Iac8bec19437192cd198d58f71c6ed0a65a76f820
Closes-bug: #1718541
2017-09-23 09:03:52 +08:00
Eduardo Gonzalez
684194ff9d Add support for vault passwords
This change adds vault arguments to kolla-ansible
to allow usage of vault encrypted  files.

Change-Id: I1dbae6e949543585d11c21e67e82f559d343b4ad
2017-09-19 17:45:55 +02:00
Christian Berendt
15e2e39ba4 Remove validate-maintainer.sh script
This script is only required in the kolla repository.

Change-Id: I80109d28dc196f489f4a6a73f970a279a9070ce1
2017-09-12 09:31:00 +02:00
Jenkins
9a520e0906 Merge "Fix gates out of disk space" 2017-08-31 13:52:26 +00:00
Eduardo Gonzalez
894e73146c Fix gates out of disk space
Sometimes gates fails due lack of disk space,

This change mounts a second disk in opt and moves
registry data to opt.
Disk format commands are excepts from devstack-gate:
dc49f9e6eb/functions.sh (L306)

Change-Id: I606aa491b8cbf678e83281bad1a0ff39d3920ff2
Closes-Bug: #1713652
2017-08-29 09:11:56 +01:00
Surya Prakash Singh
7aec5a2823 Changed as per the standard convention set to use "."
When we have to source a script file use . instead of source
For Reference follow below link:
https://docs.openstack.org/contributor-guide/writing-style/code-conventions

Change-Id: Ia170ccf245131463e3179dd75ccc66142521bc5f
2017-08-28 16:15:13 +05:30
Sean Mooney
781d84658d introduce playbook to ovs with dpdk
- This change creates a new role to
  support deploying ovs with dpdk.
- This change introduces an enable_ovs_dpdk
  variable to enable ovs with dpdk as part of
  the deploy action.
- This change extends the ovs-dpdkctl.sh tool
  to correctly deploy ovs-dpdk on Ubuntu and CentOS
  hosts.
- This change extends the cleanup-host tool
  to correctly uninstall ovs-dpdkctl.sh tool and its
  systemd files if present on the host.
- This change automatically configures userspace
  kernel drivers.

partial-implementes: bp/ovs-dpdk
Change-Id: I55858d81df437e8258705b75426f61ab9b907c7d
2017-08-09 18:43:06 +00:00
David Moreau-Simard
77f1812e00 Dynamically retrieve the location of ARA to work on both py2 & py3
Remove the hardcoded callback path with python2.7 and use the
virtualenv python to determine the path where ARA is installed so
that no matter if we're running py2 or py3, it will work.

Change-Id: Ica0b94aeebabaeca8416a9768fadd12d3925e7b2
2017-07-22 23:13:16 -04:00
Mark Goddard
922eb494e6 Make Ironic inspector honour inventory
Ironic inspector should honour the Ansible inventory group
ironic-inspector. Ironic inspector may not be required at all. If
Ironic inspector is required then it should only run on a single
node, and this should be reflected by the inventory.

This change makes a number of Ironic inspector-related tasks dependent
upon the host's membership of the ironic-inspector group. Also, we
couple the ironic-dnsmasq container with the ironic-inspector group
rather than ironic-conductor, as the service is for inspector rather
than Ironic.

Change-Id: Ifd90753b0fe1a55c11b7723c28e1d14ab3d32737
Closes-Bug: #1665257
2017-07-19 08:24:21 +01:00
Jenkins
7333ae330f Merge "Upgrade from docker-py to docker" 2017-07-19 03:19:33 +00:00
Jenkins
2cb46ffbae Merge "Allow tmp path to download registry" 2017-07-14 17:38:20 +00:00
Jenkins
29211e317a Merge "Fix tools/cleanup-images script error" 2017-07-14 13:25:52 +00:00
Jenkins
a981b9e325 Merge "Fix depends-on kolla gates" 2017-07-13 10:07:38 +00:00
Michal (inc0) Jastrzebski
50735ff1bb Allow tmp path to download registry
Required for dockerhub publisher

Change-Id: I0231bd07415ef05b3f4f937e32a9df4cd0643672
2017-07-12 14:34:02 -07:00
Michal (inc0) Jastrzebski
2f00c64616 Enable proxy cache for tarballs download
Lately, after we increased number of jobs, infra started to experience
network traffic issues due to us downloading registries. This
per-nodepool cache should help and also speed up actual gate.

Change-Id: I621a9c91e4508ef208a28137a736fd8468388219
Depends-On: I527d32f9b43dabb7640bfb056e2bf828b7c1dfa9
2017-07-12 11:50:44 -07:00
Hongbin Lu
3daeea37ea Upgrade from docker-py to docker
The pypi package 'docker-py' [1] has been renamed to 'docker' [2].
It is better to move to the new 'docker' package because the old
package will be deprecated and all the new features will go into
the new package only.

Package 'docker' has been added to requirements [3]. The old
package 'docker-py' is still allowed to be in the global requirements
during the transition period but it should be removed after all or
most of the projects finsih the migration.

[1] https://pypi.python.org/pypi/docker-py
[2] https://pypi.python.org/pypi/docker
[3] https://review.openstack.org/#/c/423715/

Change-Id: Ibcd5a57a1fbf55dcc5a690e41f20917f95b63da0
2017-07-10 14:19:28 +00:00
Bertrand Lallau
f5624b21f9 Fix tools/cleanup-images script error
When cleanup-images is launch without parameters the following error is
triggered:
./cleanup-images: line 72: break: only meaningful in a `for', `while',
or `until' loop

This patch fix it.

Change-Id: Ie8c63420a4e9b0d49a4e6be4172c8f0be912b556
Closes-Bug: #1702496
2017-07-10 13:53:23 +00:00
jimmygc
f70dfc5dc3 Make glance filesystem_store_datadir configurable.
User can use custom directory to store images.
For example using a shared file system as backend.

Change-Id: Iab7a9a51e619bdbf8f7bd4626ebe4d703e6d4819
2017-07-10 14:46:22 +01:00
Eduardo Gonzalez
378ec1f1fe Fix depends-on kolla gates
When using depends-on, gates will not build cinder
and ceph images, causing ceph deploy gates to fail.

Change-Id: I441c742251754db27374331f774041c214678eba
2017-07-10 11:28:42 +00:00
Jeffrey Zhang
ae79f7bb7c Use latest docker engine in gate
Kolla support latest docker engine right now.

Closes-Bug: #1661549
Change-Id: I5074fd16bdd158df8e97f909dead0a59a14fdf42
2017-07-07 17:25:08 +08:00
Jeffrey Zhang
065b64feaf Fix add cleanup images cli options release note folder
Change-Id: Ie206f0f245648df855ceb6140e60de664dac74fc
2017-07-04 10:44:54 +08:00
Jenkins
450b8df39f Merge "Add cli options to cleanup-images" 2017-06-27 05:19:37 +00:00
Michal (inc0) Jastrzebski
339b27c7fe Enable multi-scenario gates
First non-trivial scenario we'll be testing in gates will be cinder +
ceph. This patchset is supposed to create framework to easily add new
testing scenarios.

Change-Id: I6790eaf5cf3297af04a64e4169a39b6e2cd1890f
2017-06-19 10:14:33 -07:00
Jenkins
fca0b3702d Merge "Removing ovs bridge before destroying container" 2017-06-16 10:51:44 +00:00
Paul Bourke
5cb375645c Add a Kolla 'devstack' mode
Add a new variable 'kolla_devmode', which when enabled, clones and
bindmounts service source code into the containers.

This commit adds the relevant changes for Heat, more services can be
added and built upon.

Usage:
* Set 'kolla_devmode: yes'

* Code is cloned to /opt/stack/{{ project_name }} on target
  node(s)

* Users can develop in these repos, and simply restart the container to
  pick up / test changes.

Debugging can be done from the host via 'remote_pdb'[0].

[0] https://pypi.python.org/pypi/remote-pdb

Implements: blueprint mount-sources
Change-Id: Ic0431b10d723bf84eeefc72039376fe0058dd902
2017-06-08 09:55:54 +01:00
Jenkins
f8c40a4588 Merge "Fix unrecognized --limit option" 2017-06-07 13:30:57 +00:00
Michal (inc0) Jastrzebski
f5354f55b1 Enable multinode gate
This patches changes deploy_gate quite a bit so in reality all
deployments will now assume multinode (even if it's single node). After
that we will refactor it even further to enable easy addition of new
scenerios.

Change-Id: I1faada46e6a7aa026128b2f01d77eabb04759439
2017-06-05 11:35:20 -07:00
Jenkins
77041db66e Merge "[Trivial] Fix two typos in kolla-ansible." 2017-06-04 14:55:34 +00:00
Jeffrey Zhang
94a882babe Enable port_security in gate to fix the neutron broken
Revert this when neutron bug[0] is fixed.

[0] https://bugs.launchpad.net/neutron/+bug/1694420

Change-Id: Id9f84608826351b9675cd6a6f2a183e91ce33bf6
Partial-Bug: #1694420
2017-06-04 09:01:49 +08:00
Eduardo Gonzalez
973145f88f Fix unrecognized --limit option
Kolla-ansible does not have as its allowed parameters
ansible's limit.

Change-Id: I86821fe39e6f0f61e513a0677bf177234c203103
Closes-Bug: #1693801
2017-06-02 15:52:12 +02:00
Jenkins
e8c0ed8b7e Merge "Add kolla-ansible bash completion script" 2017-06-02 11:05:44 +00:00
Jenkins
b10ab47592 Merge "Fix some wording issues on a comment" 2017-06-02 09:48:35 +00:00
David Moreau-Simard
dc71ebe267 gzip the ARA report after generating it
ARA behaves well gzipped and shaves a lot of the size due to it being
composed mostly of text.

Change-Id: I7a3f21af365d13ba783d200a75d18b50429a1488
2017-05-25 16:25:45 -04:00
Chen
c6c75e578b Fix some wording issues on a comment
Change-Id: If81fb5a7f7e87f1b6d15b09437353a5264364ef1
2017-05-22 18:21:20 +09:00
liyingjun
479d567177 Removing ovs bridge before destroying container
Change-Id: I0fac4cef9e961b1d64f269bfc27804e77f4ea842
Closes-bug: #1689422
2017-05-19 10:46:12 +08:00
leiyashuai
e8e64f1c83 [Trivial] Fix two typos in kolla-ansible.
Change-Id: I9665338318f8ad4690e4908748065623d0537741
2017-05-16 19:32:36 -07:00
jimmygc
94c5cc570a Add kolla-ansible bash completion script
Make command line more friendly. :)

Change-Id: I8113c72aa00b1c07cb2b77c73e7dd8c7ee833bcc
2017-05-12 09:06:36 +08:00
Jenkins
6db0c9292b Merge "Remove /etc/fstab Swift references during cleanup-host" 2017-05-11 07:59:04 +00:00
jeckxie
4bb722b440 Remove /etc/fstab Swift references during cleanup-host
During cleanup-host, we need remove swift references from fstab.

Change-Id: I18e9a84b0664eb834cf397bcf6d2406abcab47a7
Closes-Bug: #1689285
2017-05-08 19:24:23 +08:00
Eduardo Gonzalez
ba6e3249d2 Change ssh/config permissions to 600
ssh/config permissions are 664 currently, causing error
`Bad owner or permissions on /home/jenkins/.ssh/config`

http://logs.openstack.org/68/461368/1/check/gate-kolla-ansible-dsvm-deploy-centos-binary-centos-7-nv/0a94da7/console.html#_2017-05-01_12_06_08_440775

config file should only be writen by owner.

Closes-Bug: #1687408
Change-Id: Id804f11a91858fa297e5236beb2110e3511eabec
2017-05-01 14:21:24 +00:00
Eduardo Gonzalez
029de18d0b Add ssh-keyscan to unblock kolla-ansible gate
As a change to remove puppet from infra nodepool,
ssh-keyscan is needed for each node.[0]

Host key checking was disabled by default by jenkins
user. [1]

Refs:
[0] http://lists.openstack.org/pipermail/openstack-dev/2017-April/116036.html
[1] https://review.openstack.org/#/c/460731/
Change-Id: I0f4000f18b7a2b3266c95c3f7a5109e3603c94a7
2017-04-28 13:16:20 +00:00
Jenkins
60b5b495a2 Merge "Fix the remove mariadb volume failed" 2017-04-24 12:53:52 +00:00
Eduardo Gonzalez
f6f99db4a2 Add cli options to cleanup-images
Allow remove all kolla images
Allow remove specific kolla version images
Allow remove dangling images
Allow remove single images, all images matched

Usage examples:
   * cleanup-images --all
     - Remove all kolla images
   * cleanup-images --image-version 4.0.0
     - Remove all images matching 4.0.0 kolla_version
   * cleanup-images --dangling
     - Remove all dangling images
   * cleanup-images --image nova
     - Remove all nova images
   * cleanup-images --image nova-scheduler
     - Only remove nova-scheduler image

Implements: blueprint add-cleanup-images-cli-options
Change-Id: I997272098879350e13e0ac00762ae3485e618355
2017-04-24 14:53:24 +02:00
Jenkins
4545fcb420 Merge "fix typo" 2017-04-12 07:42:35 +00:00