98 Commits

Author SHA1 Message Date
Rick Box
116867f117 Adds in Playbook and inventory for Ubuntu 16.04 roles
Building on from the previous commit https://review.openstack.org/427869
this playbook calls all the roles and contains the required data to
deploy the pxe build environment.

Change-Id: I1a319b68558a4823832693f38f40921a72be783e
2017-02-13 08:09:35 +00:00
Rick Box
a8a44e2002 Adds in proxy role - Ubuntu 16.04
Building on from the previous commit https://review.openstack.org/427869
this add in a proxy role which sets up the environment and apt in case
this machine is based behind some form of proxy.

Change-Id: I1f2266f6443354aa954438801c0ddc84e78d6994
2017-02-13 08:09:15 +00:00
Rick Box
952f91f004 Adds in network config - removes hardcoded values
172.29 has the potential to conflict with internal addressing schemes.
Rather than have this hard coded these changes are to allow this to be
configured. Variables file has also been added to allow customization of
defined values.

Change-Id: I0b3e68443e7331b02794c3a54478e131d23fd5ec
2017-02-10 15:27:12 +00:00
Rick Box
f8fef621cb Adds in TFTP Configure role - Ubuntu 16.04
Building on from the previous commit https://review.openstack.org/427869
this adds in TFTP configure role which handles all the pre-seed
templates and sets up all the PXEBoot files.

Change-Id: Ibdf7bfac9bc2c5b5cabdc79ce8584112b2ae0678
2017-02-03 04:19:39 +00:00
Rick Box
088d941d22 Adds in DHCPD role - Ubuntu 16.04
Building on from the previous commit https://review.openstack.org/427869
this adds in DHCPD role to provide DHCP to the virtual machines which
are booting up and point them towards our TFTP server.

Change-Id: I73649562096a659dee7227b0cfb84f2c4a4f5ec4
2017-02-03 04:16:44 +00:00
Rick Box
e0381502e3 Adds in Apache2 role - Ubuntu 16.04
Building on from the previous commit https://review.openstack.org/427869
this adds in Apache2 role to host the pre-seed files and some Ubuntu
install files.

Change-Id: Ib0c2469e25f5e7a03c7c79efc201cd51f673966e
2017-02-03 04:10:12 +00:00
Rick Box
49ccdbeb2c Adds in ATFTPD role - Ubuntu 16.04
We have done an amount of work making the Multinode AIO work with Xenial
on both the deployment host and the booted virtual machines.  Sadly
Cobbler was a large complex system which required poking and prodding to
make it work properly on Xenial. Instead we have created a small system
which is a PXE environment with TFTPboot, DHCPD server and various
pre-seeds.

This work is virtually complete and working, this is a first commit of
many to get this merged in. Starting with a small commit to get one of
the few Ansible roles we have in place. After this has been checked over
and merged in, we will push all the rest of the work making sure any
amendments or recommendations are made to the rest of our work.

This first commit is simply an Ansible Role to install and configure
ATFTP on Ubuntu 16.04 deployment host, and does not currently affect
other items.

Change-Id: I9bfd88d81d27d5a6af7b297b9a4426f5e6200baf
2017-02-02 13:13:53 +00:00
Jenkins
3d0ab1bef5 Merge "Added leap upgrade tooling" 2017-02-01 17:29:30 +00:00
Kevin Carter
2438ad03ab Added leap upgrade tooling
This change adds upgrade tooling that will take a Juno based
OpenStack-Ansible cloud and upgrade it to Newton. The tooling
will run a deployment through all of the needed steps upgrading
the environment and skipping all of the OpenStack releases in
between.

**This tooling should be considered experimental at this time**

Change-Id: I1880794717b9e47786ae255ea1afa57d805cde8e
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2017-02-01 14:27:07 +00:00
Weezer Su
0bf6407914 Grab the ubuntu release version from VMs
Grab the ubuntu release version from VMs, then feed the VMs with
right sources.list file.

Change-Id: Iaf89716af1248676fbf2b735dd705a285e6cdf8b
2017-01-31 21:13:05 +00:00
Weezer Su
e96b57d8d6 Typo on MD5SUM5 should be MD5SUMS
fix the typo. and put it into silent mode.

Change-Id: I3bdb7184d4c565de88b9aab936d9df718778657f
2017-01-30 13:40:39 -06:00
Jenkins
e2cf647aac Merge "Install python2.7 on xenial" 2017-01-30 19:09:27 +00:00
Jenkins
75ed6b5388 Merge "Add the md5 check on image" 2017-01-30 19:08:35 +00:00
Weezer Su
413d20267a Add the md5 check on image
Add the md5 image hash check, if the image exists, check the md5
hash, if the hash is not the same, remove the old image and download
new one.

Change-Id: I2232129a814e89aaac9bf54ee16ede983fff5b48
2017-01-27 15:29:33 -06:00
Weezer Su
10bc36ed80 Install python2.7 on xenial
Starting in 16.04 Ubuntu no longer installs python v2.7 by default.
Instead the default version of python is v3.5.  If you still need v2.7
then add the `python` package to this list

Change-Id: Ieb47e319ef2124570cc72acf1219c5b9d9fc9814
2017-01-27 14:27:47 -06:00
Kevin Carter
e786c69b15 Added Cinder storage pools data
This change adds the cinder storage pools data to the influx metric
collection system as a plugin.

Change-Id: I632b53aa09d69c6df28b86988629242a26ab9b50
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2017-01-27 17:38:28 +00:00
Nish Patwa
f0b26e6301 Added kapacitor scripts
Added kapacitor tickscripts to trigger alerts based on certain
thresholds.

Change-Id: I66d1b1e58d279405637d9a2f06b3aae19fa29cc3
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2017-01-26 22:10:45 +00:00
Melissa Kam
6c45b23c4a Set SSH key in cobbler setup
SSHKEY is originally set in setup-host.sh, so this allows
setup-cobbler.sh to run independently of that script.

Change-Id: I4793e6a5db7359bec0eaa7b6a66efa7d58084126
2017-01-23 16:29:21 -06:00
Jenkins
25a865588f Merge "Add instruction of the option for Operation system for VMs" 2017-01-19 09:24:09 +00:00
Weezer Su
93d7492496 Replace the tilde with /tmp
the tilde symbol may cause problem when VMs don't have the same
folder path as the host, replace it with tmp will resolve this
issue.

Change-Id: I14114d018fa9dc9fa332f1e34077f88d75995f21
2017-01-18 21:44:59 +00:00
Weezer Su
7daef611b9 Add instruction of the option for Operation system for VMs
Add the DEFAULT_IMAGE instruction into README.rst

Change-Id: I77e1b43a2533638af50d7430195f6162763126cd
2017-01-18 13:51:14 -06:00
Weezer Su
289f884795 Add the xenial support to the multi-node-AIO
Starts from Newton release, Openstack needs ubuntu 16.0.4(xenial)
as the operation system to depoy openstack. add the xenial image
will help people to test or develop openstack projects.

Change-Id: Ida3a2102664abc4a69e8d94f6c8d6cc177a8c4c3
2017-01-16 21:18:17 -06:00
Jenkins
bbfa748698 Merge "Import osa-gate-profile" 2017-01-14 17:43:51 +00:00
Kevin Carter
229739377d Added kvm_virsh to telegraf plugins
The KVM virsh plugin already existed however the setup was not using the
new playbook plugin system. This change moves the kvm vish plugin into
that system and updates the plugin to use the influxdb line format
instead of the json format which was recently deprecated.

Change-Id: Ib23a0a231044389aab5669dc0c467175cd220423
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2017-01-10 18:02:49 +00:00
Weezer Su
4f64e92864 Sort out the hosts.json.
Make it clean and tidy, and easy to work with the add node capacity
scripts.

Change-Id: Ifc3463e6f56bbe3dc287a5fe5a58ed2a2ed96d83
2017-01-06 12:12:43 -06:00
Kevin Carter
5b93b9a2c2 Added nova quota plugin
This change adds a second plugin to the telegraf setup. A change is
being made to the telegraf config file to allow for more than one
external plugin to be executed and to allow for full plugin execution
between telegraf reporting intervals.

Each plugin will potentially account for up to 8 seconds of runtime with
the telegraf agent now using a dynamic reporting interval based on the
number of plugins a given agent is needing to execute.

Change-Id: I652e8e2f13bd4fb9135280b76f2344177a14eaf7
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2016-12-15 15:19:50 +00:00
Kevin Carter
76ad4f52da Add ironic to the metric collection plugins
Change-Id: Ia2e9f19b284ba48beeee8a5d0c4b2a0bd34dd798
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2016-12-15 14:48:11 +00:00
gecong1973
00c1e31805 Delete deprecated Hacking in tox.ini
Some hacking have been removed,so we can delete them.
More details:
     https://github.com/openstack-dev/hacking/blob/master/setup.cfg

Change-Id: I7e6fa8f08fef2cb474811fe2b48fb8e8e626d1c4
2016-12-04 10:31:02 +08:00
OpenStack Proposal Bot
d35b14bde1 Updated from global requirements
Change-Id: Ib395e19ab1bcd4e9dd7cd52cc49626ee411e0569
2016-12-02 05:10:32 +00:00
Jean-Philippe Evrard
cb4c9d6a8b Point roles docs bugs to openstack-ansible LP
Currently when clicking on the small bug in the roles'
docs, we land on openstack-manuals launchpad.

This should solve it.

Change-Id: Iba8332b8623204cc88ab07f56c5c4773cebe380d
2016-12-01 14:20:12 +00:00
Flavio Percoco
3b87ecd346 Show team and repo badges on README
This patch adds the team's and repository's badges to the README file.
The motivation behind this is to communicate the project status and
features at first glance.

For more information about this effort, please read this email thread:

http://lists.openstack.org/pipermail/openstack-dev/2016-October/105562.html

To see an example of how this would look like check:

https://gist.github.com/a49fa6aca317a8bfa3ec347314f1bb92

Change-Id: Idc9fdd1ad09a05bea5d41cb97062d9e0b28365a0
2016-11-25 16:29:05 +01:00
Jenkins
926dd95918 Merge "Adding influx relay to make the existing monitoring stack highly available" 2016-11-17 13:40:58 +00:00
Nish Patwa
17450f35f3 Adding influx relay to make the existing monitoring stack highly available
Added Influxdb relay to make the existing monitoring stack highly
available. Relay replicates the data to multiple database instances.
Also added configutation in HAProxy that load balances the read queries
to influxdb instances and write queries to influxdb relays

        ┌─────────────────┐
        │writes & queries │
        └─────────────────┘
                 │
                 ▼
         ┌───────────────┐
         │               │
┌────────│ Load Balancer │─────────┐
│        │               │         │
│        └──────┬─┬──────┘         │
│               │ │                │
│               │ │                │
│        ┌──────┘ └────────┐       │
│        │ ┌─────────────┐ │       │┌──────┐
│        │ │/write or UDP│ │       ││/query│
│        ▼ └─────────────┘ ▼       │└──────┘
│  ┌──────────┐      ┌──────────┐  │
│  │ InfluxDB │      │ InfluxDB │  │
│  │ Relay    │      │ Relay    │  │
│  └──┬────┬──┘      └────┬──┬──┘  │
│     │    |              |  │     │
│     |  ┌─┼──────────────┘  |     │
│     │  │ └──────────────┐  │     │
│     ▼  ▼                ▼  ▼     │
│  ┌──────────┐      ┌──────────┐  │
│  │          │      │          │  │
└─▶│ InfluxDB │      │ InfluxDB │◀─┘
   │          │      │          │
   └──────────┘      └──────────┘

This patch is dependent on this patch:
https://review.openstack.org/#/c/392328/

Change-Id: I05bdaa0e2fb251b48df1d26d09ad63942872293a
2016-11-10 15:54:56 +00:00
Logan V
afe1a99f74 Import osa-gate-profile
A few cobbled together scripts to perform analytics on OSA gate check
timings based on console logs retrieved from logstash.openstack.org.

Change-Id: I5f7664482751386cca2697954573a55be06e6b9b
2016-11-07 08:19:06 -06:00
Jean-Philippe Evrard
03c48e2357 Use apt_repository update_cache feature
With ansible 2.2, apt_repository update_cache feature has
been fixed. When a new repo will be added, apt-get update
will be run after the addition if update_cache is set to yes.

This combined with the apt module now properly checking the
cache validity, we can now have proper updating of the cache
with registering variables.

Change-Id: Ic9788156a88223dc0d27fafa2a798f396135f990
2016-11-04 16:51:31 +00:00
Weezer Su
ff9002ba36 Add PRE_CONFIG_OSA option and move the RUN_OSA to the run playbook part
Add PRE_CONFIG_OSA to set up the user_variable and all the other
parameters for OSA powered cloud, and move the RUN_OSA to the playbook
part.

Change-Id: Ia962e42466dd2a123e30b1a9c37e60a371710842
2016-11-02 11:53:40 -05:00
OpenStack Proposal Bot
7a8d7abf48 Updated from global requirements
Change-Id: I91d262ab862253d51b6e31891eec64a9927e8efb
2016-11-02 15:37:27 +00:00
Joshua Hesketh
66b017144f Replace github with git.o.o
Change-Id: Id1ec52d14ecac9fd68b261c2be0e1dcdabbf7d81
2016-11-02 12:16:10 +11:00
Kevin Carter
baf0553a36 Remove deprecated ansible_ssh_host variable
This changes 'ansible_ssh_host' to 'ansible_host'. The 'ansible_ssh_host'
variable has been deprecated as noted here: [0].

[0] - http://docs.ansible.com/ansible/intro_inventory.html#hosts-and-groups

Change-Id: Ie34bb924b55d4e1c7b4568c2eadd2a7a1a60a821
Related-Bug: #1636606
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2016-10-25 19:43:24 +00:00
Weezer Su
c8f1af0bcf Remove the expired key and opensuse repo after cobbler being installed
Remove the opensuse expired key and opensuse cobbler repo after
cobbler being installed. OSA deployment doesn't need it.

And fix a typo and a link of README.rst

Change-Id: I24f5d823806f039d879dd69762b2eac3a6005628
2016-10-20 16:13:46 -05:00
Jenkins
1b4cb5699a Merge "Add remove known_hosts in the instruction for Multi-Node AIO" 2016-10-20 19:14:44 +00:00
Weezer Su
62178b010e Enhanced the setup-cobbler.sh
Replace the service xinetd stop and start to service xinetd restart
, the stop will cause the unknow instance error and stop the
rebuild

Change-Id: I1a8a7a72f51b3d4dcdca3b0158f7771efd567032
2016-10-20 12:46:23 -05:00
Weezer Su
22501ca02a Add remove known_hosts in the instruction for Multi-Node AIO
Add the rm ~/.ssh/known_hosts for the Rerunning the build script
part in the instruction.

Change-Id: Iba7610e00f07bb61cd8b11892e208ea4c67a1d75
Closes-Bug: #1635037
2016-10-19 16:04:28 -05:00
Jenkins
213884ebb8 Merge "Add an option for deploying OSA or other OSA powered cloud" 2016-10-19 15:24:48 +00:00
Weezer Su
9b5320dcb9 Add an option for deploying OSA or other OSA powered cloud
Add an option $RUN_OSA to the deploy-osa.sh to let user have more
choices, if user want to deploy another OSA powered cloud on AIO-
multinode, he can switch it to false and then use the existing env
to deploy the cloud he wants to.

Change-Id: Ief8c701f596595607d3b86ac03f17d6690f5954f
Closes-Bug: #1634582
2016-10-18 16:38:00 -05:00
Kevin Carter
f337e4aec1 Implement automatic flavor create
This change is needed because nova no longer provides flavors.

Change-Id: Icaf97d94007aef7fd54691174cab6ed2db89404b
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2016-10-18 04:55:04 +00:00
Jenkins
bf09a35de7 Merge "Updated deploy-osa section to setup more production like" 2016-10-07 11:26:49 +00:00
Jenkins
47b50cf118 Merge "roll the network hosts into the infra hosts" 2016-10-07 11:26:30 +00:00
Kevin Carter
6fb0879ab7 Updated deploy-osa section to setup more production like
This change simple makes the system deploy a network stack and create
various images in a more production like fashion.

Change-Id: Ib316d5fcab08aa31f2965175a4fb31f1d3566228
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2016-10-07 00:29:29 -05:00
Kevin Carter
82f1994067
roll the network hosts into the infra hosts
By default we generally deploy the network agents onto the infra hosts.
This patch simply forces the multi-node-aio to follow that process which
is being done to lower resource consumption.

Change-Id: I6612a85cb669596893dbd3ee0a858a8ee5476729
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2016-10-06 16:19:26 -05:00