Kevin Carter 814622cc6c
Improve logstash and elasticsearch performance
The logstash and elasticsearch performance can be improved by using
async index options, pulling back the refresh interval, and by not
fingerprinting every document.

* Async translog allows elasticsearch to using run fsync in the
  background instead of blocking
* the refresh interval will now be 5x the number of replicas with a cap
  of 30. This integer is representitive of the seconds between index
  refresh calls which greatly lowers the load generated across the
  cluster.
* All documents were fingerprinted before writting to the cluster. This
  was a costly operation as elasticsearch will do a forward lookup on all
  documents with a preset ID resulting in 100's, if not 1000's, of extra
  reads. The purpose of the fingerprint function is to limit repeading
  writes so to keep some of this functionality the fingerprint function is
  now only added to documents with messages.
* G1 garbage collection is now enabled by default when the heap size is
  > 6GiB. Early versions of elasticsearch did not recommend this setting
  however its since stabalized in recent releases.
* JVM options have been moved into the elasticsearch and logstash roles
  allowing these tasks to trigger service restarts when changes are made.

Change-Id: I805129b207ad4db182ae6e59b6ec78eb3e246b54
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
2018-09-21 21:47:07 -05:00
2018-02-13 11:02:27 +00:00
2018-04-13 10:31:34 -05:00
2018-04-21 09:03:47 +08:00
2018-04-11 03:11:44 -05:00
2018-04-26 16:41:51 -05:00
2018-04-24 21:43:03 +00:00
2018-09-19 10:52:32 -05:00
2016-11-07 08:19:06 -06:00
2018-09-11 11:29:44 -05:00
2018-08-13 10:17:03 +02:00
2018-08-10 16:45:39 +00:00
2018-09-11 10:34:39 -06:00
2018-03-28 10:28:54 +01:00
2016-05-27 11:57:18 +00:00
2016-06-14 15:32:40 +00:00
2018-08-28 08:45:55 +02:00
2017-03-02 11:51:26 +00:00

Team and repository tags

image

OpenStack-Ansible Operator Tooling

This repository is a collecting point for various scripts and tools which OpenStack-Ansible Developers and Operators have found to be useful and want to share and collaboratively improve.

The contents of this repository are not strictly quality managed and are only tested by hand by the contributors and consumers. Anyone using the tooling is advised to very clearly understand what it is doing before using it on a production environment.

Documentation for the project can be found at:

https://docs.openstack.org/openstack-ansible-ops/latest/

Release notes for the project can be found at:

https://docs.openstack.org/releasenotes/openstack-ansible-ops/

The project source code repository is located at:

https://git.openstack.org/cgit/openstack/openstack-ansible-os_ops

The project home is at:

https://launchpad.net/openstack-ansible

Galaxy roles

OpenStack Ansible backup

This role will perform backups for OpenStack-Ansible deployments and it needs to run on the deploy node. It will backup data on container and then synchronize backup files to the deploy node.

Description
Operations-related content for OpenStack-Ansible
Readme 15 MiB
Languages
Jinja 82.1%
Shell 12.1%
Python 4.7%
PHP 1.1%