1956 Commits

Author SHA1 Message Date
Elizabeth Krumbach
5bc9f1ae7f Add ask.openstack.org to ssl certs we monitor
Added ask.openstack.org to the list of ssl certs we monitor,
also took the opportunity to alphabetize the list.

Change-Id: I251d6ee0df8b73f159a9d7844b5c89412a548919
Reviewed-on: https://review.openstack.org/31866
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Dan Prince <dprince@redhat.com>
Approved: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Tested-by: Jenkins
2013-06-06 18:57:50 +00:00
Dan Stangel
bd10055923 Add the gerrit-git-prep macro so gitdm code actually gets cloned first
Change-Id: I5d441475d13471a38540d2051a81f404e4f27c0d
Reviewed-on: https://review.openstack.org/31722
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2013-06-06 17:46:11 +00:00
Joshua Harlow
e3c37b1bb9 Configure gerritbot to be on openstack-state-management.
Put gerritbot on openstack-state-management channel and have
it report about taskflow patches and changes being submitted.

Change-Id: I2028e0cf61d1a1e805b0997d662941687d0b4277
Reviewed-on: https://review.openstack.org/31837
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-06-06 17:41:39 +00:00
Clark Boylan
dc9ffb587f Fix review.o.o projects.yaml.
* modules/openstack_project/templates/review.projects.yaml.erb: Remove
invalid map object, upstream: upstream: git://foo had one too many
upstreams.

Change-Id: I108dcf5336e6531d02d728b364584172f53215c1
Reviewed-on: https://review.openstack.org/31895
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2013-06-06 00:57:08 +00:00
James E. Blair
4e5201f48b Fix run-docs as a gate job.
If run-docs is running as a gate script, ZUUL_REFNAME is not set.
We also don't care where the docs end up so do nothing (treat as
master).

Change-Id: I8f5a7ba4c6ab714765871c60b5e587fcb4dece41
Reviewed-on: https://review.openstack.org/31889
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Tested-by: Jenkins
2013-06-06 00:14:47 +00:00
James E. Blair
c108532b32 Don't publish non-master docs to master location.
The current run-docs script only moves the publishing location on
tags or stable branches.  This makes it so that master docs stay
where they are, stable branches and tags have the current behavior,
and anything else is placed in the branch name.  This should affect
milestone-proposed (which will be published to .../milestone-proposed/)
and feature branches (.../feature/foo).  Currently, these two cases
are in a race with master -- last change wins.

Change-Id: If1e09d31a7001255746ba1a91b641b95f42fcfbb
Reviewed-on: https://review.openstack.org/31300
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2013-06-05 22:28:44 +00:00
Clark Boylan
bd394410f3 Fix openstack-api-programming Jenkins job.
Fixes bug 1185966

The FTP source path was wrong in the openstack-api-programming job. It
was trying to copy from a source path that does not exist. Use the
correct path.

Change-Id: I89d664e44cd4df64998731565ba96882c11feece
Reviewed-on: https://review.openstack.org/31680
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2013-06-05 16:36:53 +00:00
James E. Blair
dab09b9646 Fix ssh public key on jenkins-dev.
The "openstack_project" module must be included in order to reference
the ssh public key variable.

Change-Id: I7126bff62134d220d8e90e457788100eee04e04b
Reviewed-on: https://review.openstack.org/31550
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Elizabeth Krumbach Joseph <lyz@princessleia.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2013-06-04 21:48:10 +00:00
James E. Blair
b064f95e52 Use Zuul's internal gearman server.
(This is only used by zuul-dev currently.)

Remove co-hosted gearmand server (will require manual cleanup).

Also, listen for feature/gearman events in openstack-infra.

Change-Id: I2dd58e62ff79277f1ef5c79da54bcc7511f2ccee
Reviewed-on: https://review.openstack.org/30175
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2013-06-04 21:47:33 +00:00
Jessica Lucci
ee9d8f0760 Taskflow Addition
Change-Id: I9d757954482386ad9f0a72488c54b56f4bb94365
Reviewed-on: https://review.openstack.org/30789
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-06-04 01:57:12 +00:00
Jay Pipes
4c59c7224d Enable gate jobs for Swift Cookbook
Enable lint and unit test jobs for object storage
cookbook. Initial patches for the cookbook expected
later today.

Change-Id: Ia4ecf5ad7097058844d2b2d4fc7d960a21fc4422
Reviewed-on: https://review.openstack.org/31504
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: matthew wagoner <zxkuqyb@gmail.com>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-06-04 01:54:49 +00:00
James E. Blair
94ca1d0fc0 Remove dev heat coverage jobs.
Conform!

Change-Id: Ie70479eac228ef80bb17f106cf9f84a9b4d1dec4
Reviewed-on: https://review.openstack.org/31303
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Clint Byrum <clint@ubuntu.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-06-04 01:52:25 +00:00
Monty Taylor
7c1dd467b9 Add a job that runs gitdm on commits.
Change-Id: Iac6a4073cc4a2569fdbc190a614d6eeebb7a2284
Reviewed-on: https://review.openstack.org/31296
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-06-04 01:49:31 +00:00
Slamet Hendry
259343d0e4 bug 1183607 New project request: golang-client
Change-Id: I8fa59dc042110cd678bb5b89671f995e012cf7c5
Reviewed-on: https://review.openstack.org/30623
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-06-04 01:46:49 +00:00
Jeremy Stanley
383f547e50 Restore Gerrit's local git replication.
* modules/openstack_project/manifests/gerrit.pp: Pass the local git
replication variable through to the gerrit module.

Change-Id: I58680c00687450876c54e17378b2daaf4e438b50
Reviewed-on: https://review.openstack.org/31090
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Elizabeth Krumbach Joseph <lyz@princessleia.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-06-03 23:39:10 +00:00
Clark Boylan
d313ce581a Include openstack_project for Jenkins' SSH key.
The openstack_project class needs to be included to make the
jenkins_ssh_key variable available to nodes.

Change-Id: I57fb6f24755bf123cf9f6f9b724035d0ababf8f3
Reviewed-on: https://review.openstack.org/31581
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-06-03 23:31:36 +00:00
Clark Boylan
b51d23a3cd Pass Jenkins' SSH pub key to special slaves.
The openstack_project::slave refactor defaulted the Jenkins' SSH pub key
to an empty string. This erased the authorized keys file for the Jenkins
user on our specialized slaves. Restore that file's contents.

Change-Id: I28067017ec2dc36feef9df076099813abf820ee9
Reviewed-on: https://review.openstack.org/31419
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Clark Boylan <clark.boylan@gmail.com>
Tested-by: Jenkins
2013-06-03 22:42:40 +00:00
Clark Boylan
6881008de0 Add logstash documentation.
* doc/source/logstash.rst: Add documentation on our Logstash system
architecture and how to query logstash.

Change-Id: I9da3e6d6391081131d1fd852230ddac6326c01a2
Reviewed-on: https://review.openstack.org/31257
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Elizabeth Krumbach Joseph <lyz@princessleia.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-31 22:21:03 +00:00
Sergey Lukjanov
c42c7acdc4 Add gerrit notifications for new Savanna projects.
Change-Id: I66a84199ddd2209b31853ed3d068e738c6afbbb9
Reviewed-on: https://review.openstack.org/31199
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2013-05-31 19:11:45 +00:00
Jeremy Stanley
2ec478c605 Increase python unittest timeout to 40 minutes.
Similar to cd02e47, the python stable bitrot unittests (particularly
python26) have been getting close to the test timeout and
occasionally go over. Increase the test timeout by 10 minutes for a
timeout of 40 minutes. These jobs run daily from a timed trigger so
should not increase the runtime for changes in the qate.

Change-Id: Ide580777c0fb062ebce3aa066d5647062009a5bd
Reviewed-on: https://review.openstack.org/31060
Reviewed-by: Alan Pevec <apevec@gmail.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2013-05-31 12:48:23 +00:00
Clark Boylan
ff91e70e42 set -e when checking testr test counts.
* modules/jenkins/files/slave_scripts/run-tox.sh: set -e when checking
test counts so that the case when no tests are found and test complains
about a missing integer expression we fail the Jenkins job.

Change-Id: I2b416637d02d0b87fd3f9ece323e168c039da38b
Reviewed-on: https://review.openstack.org/30818
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2013-05-31 11:57:13 +00:00
Jeremy Stanley
38961a4236 Force releasestatus to use IPv4 for SSH to Gerrit.
At random, some hosts within Rackspace refuse to send IPv6 packets
with DSCP marker 0x10 (lowdelay). This is the default behavior of
recent OpenSSH servers and clients, and results in SSH sessions
hanging on these hosts. When static.openstack.org was rebuilt a few
months ago, we did not immediately realize it suffered from this
problem as Rackspace thought they'd fixed the issue previously. We
have an open trouble ticket with them for the past several months to
get it addressed properly, but have no resolution yet. In the
meantime, we have this lovely workaround...

* modules/releasestatus/files/ssh_config: New SSH config file forces
IPv4 when connecting to review.openstack.org from the releasestatus
account.

* modules/releasestatus/manifests/init.pp: Installs the new SSH
config file.

Change-Id: I2968fc00750e3a5a23c08a3007318fd2e336b251
Reviewed-on: https://review.openstack.org/30944
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Elizabeth Krumbach Joseph <lyz@princessleia.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2013-05-30 21:02:54 +00:00
Clark Boylan
6405ae32f9 Add swift logs to Logstash.
* modules/openstack_project/files/logstash/logstash-worker1/jenkins-log-pusher.yaml:
Add the swift log files to the list of files to be processed by
logstash-worker1. This does not include the swift proxy log file as it
will require extra parsing.

* modules/openstack_project/templates/logstash/indexer.conf.erb: Add
Logstash filters for apache combined log format files.

Change-Id: I7545ace8f7601bdca453e0d2ac1b2233823878ce
Reviewed-on: https://review.openstack.org/31103
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Tested-by: Jenkins
2013-05-30 20:44:48 +00:00
Clark Boylan
bd685327e5 Add syslog logs to Logstash.
* modules/openstack_project/files/logstash/logstash-worker1/jenkins-log-pusher.yaml:
Add the syslog log file to the list of files to be processed by
logstash-worker1.

* modules/openstack_project/templates/logstash/indexer.conf.erb: Add
Logstash filters for syslog format files.

Change-Id: I0f8f58ab484949eb0506842bdb98385767a50333
Reviewed-on: https://review.openstack.org/31097
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2013-05-30 20:44:42 +00:00
Clark Boylan
f8e624d1c2 Add keystone logs to Logstash.
* modules/openstack_project/files/logstash/logstash-worker1/jenkins-log-pusher.yaml:
Add the keystone log file to the list of files to be processed by
logstash-worker1.

* modules/openstack_project/templates/logstash/indexer.conf.erb: Add
Logstash filters for keystone format files.

Change-Id: I5a72fc17ed1f37b816581faabe44f26f8cc36db2
Reviewed-on: https://review.openstack.org/31096
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2013-05-30 20:44:10 +00:00
Clark Boylan
c9d484e797 Handle multiline Logstash events per file.
* modules/openstack_project/files/logstash/log-pusher.py: Add a filename
field to logstash events that can be used to associate multiline events
in files to their appropriate parents in the same file.

* modules/openstack_project/templates/logstash/indexer.conf.erb: Add
stream_identities to the mutliline filters that use the source host and
file name to determine relationships between mutliline events.

Change-Id: Ia325c0e1257131ab1b721c4df8f70f6bea1d0b99
Reviewed-on: https://review.openstack.org/30953
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2013-05-30 20:44:08 +00:00
James E. Blair
9ed2be3098 Refactor project infrastructure docs.
The goal is to re-orient the documentation as an introduction for new
contributors and a reference for all contributors.

Change-Id: I8702a5ace908c7618a6451bbfef7fc79b07429ff
Reviewed-on: https://review.openstack.org/30515
Reviewed-by: Elizabeth Krumbach Joseph <lyz@princessleia.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Monty Taylor <mordred@inaugust.com>
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Tested-by: Jenkins
2013-05-30 17:27:07 +00:00
Clark Boylan
971b210cf7 Add logstash nodes and elasticsearch to cacti.
* modules/openstack_project/manifests/cacti.pp: Add
logstash-worker[123].o.o and elasticsearch.o.o to the list of hosts
monitored by cacti.

Change-Id: Icfe658e6b6b097b61ae6753acee9a690c4076275
Reviewed-on: https://review.openstack.org/30926
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Elizabeth Krumbach Joseph <lyz@princessleia.com>
Approved: James E. Blair <corvus@inaugust.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2013-05-30 17:23:27 +00:00
Clark Boylan
963328f7ce Set ElasticSearch output node name to hostname.
* modules/openstack_project/templates/logstash/indexer.conf.erb: Set the
node name parameter in the ElasticSearch output template to be the
hostname of the host running logstash.

Change-Id: I8ade373403ca59d6d5768df175405167c9c8b4be
Reviewed-on: https://review.openstack.org/30925
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Elizabeth Krumbach Joseph <lyz@princessleia.com>
Approved: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Tested-by: Jenkins
2013-05-30 17:17:24 +00:00
James E. Blair
2b4ff1b4c1 Add docs publisher site for ironic.
And for ironicclient for good measure.

Change-Id: Id5697ee6e7312c79a6e5b7810a771e5348027a00
Reviewed-on: https://review.openstack.org/31082
Reviewed-by: Monty Taylor <mordred@inaugust.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-30 17:00:42 +00:00
Mathieu Gagné
54a8eaa228 Remove puppet-unit 2.6 gate for puppet-tempest
Puppet 2.6 unit tests were removed as they aren't supported anymore.

Change-Id: I417875be33887d9578be33cadc67fb8de0420de0
Reviewed-on: https://review.openstack.org/30909
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-30 03:26:19 +00:00
Jay Pipes
ba307ea0f5 Adds Chef style checking job
Adds a macro that fires off tailor to check cookbooks
Chef and Ruby style.

See https://review.openstack.org/#/c/30827 for some
more information about the use of tailor against the
Chef cookbook repositories.

Marks the OpenStack Compute cookbook for gating with
this new job.

Change-Id: Ib5b3d6548749ddc1107a70b462f7432dde672410
Reviewed-on: https://review.openstack.org/30921
Reviewed-by: John Dewey <john@dewey.ws>
Reviewed-by: craigtracey <craigtracey@gmail.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-30 03:26:15 +00:00
James E. Blair
12106d198e Add OpenStack docs jobs to ironic.
Also add the requirements job.

Change-Id: I52c30b8024a1087778d2295c20c1d9706b9ea92c
Reviewed-on: https://review.openstack.org/30907
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Elizabeth Krumbach Joseph <lyz@princessleia.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-30 03:26:03 +00:00
James E. Blair
0f219a1d0b Switch hacking and pbr to merge-if-necessary.
They (probably accidentally) were set up with the cherry-pick merge
strategy, but we should confine that to openstack-infra for the time
being until we are sure we want to support it more widely.

Change-Id: Ic813fd8d5b320ada1d83b468d41a43d430d49a04
Reviewed-on: https://review.openstack.org/30955
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: David Ripton <dripton@redhat.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-29 22:14:18 +00:00
Thierry Carrez
f51ac05e3e Add releasestatus SSH key
Add an SSH keypair for releasestatus so that it can connect to
review.openstack.org to grab review data. Also add review.o.o
public key to known_hosts.

The data in hiera was already added.

Change-Id: I193dfad5b229a0c193ce35d5a8917b0b3b86c117
Reviewed-on: https://review.openstack.org/30881
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-29 18:56:03 +00:00
Clark Boylan
c140bec6d2 Install java7 runtime with logstash root manifest.
Logstash depends on java but the runtime wasn't being installed by
the Logstash manifest. Fix this.

Change-Id: I63f2c9831a9c9eae63f4eebd2493800dd606f8fb
Reviewed-on: https://review.openstack.org/30919
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Tested-by: Jenkins
2013-05-29 18:20:14 +00:00
Sergey Lukjanov
4e43cb089c Repo for Savanna utils added and acls combined
Change-Id: I140d7a38906b35868cb989e0bb6be640c653789c
Reviewed-on: https://review.openstack.org/30641
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-29 03:43:11 +00:00
Elizabeth Krumbach
62ac5ffa22 Add OpenStack favicon to status page
Initial addition of OpenStack favicon to status index, if
we like it the html can be updated on related sites to
include it elsewhere in what we host.

Change-Id: I63df3f47f8c9e2f4a8fddf9abfe002f6d9721586
Reviewed-on: https://review.openstack.org/30568
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Khai Do <zaro0508@gmail.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-29 02:14:02 +00:00
Clark Boylan
5bbe7824e0 Scale out logstash indexing to multiple hosts.
Logstash performs filtering in a single thread so it does not scale up
very well. Work around this by scaling Logstash out to multiple indexer
hosts.

Current plan is to have a small (2GB) kibana web front end host that
does nothing but talk to elasticsearch, three 4GB logstash indexers that
will run a single log-pusher.py + logstash indexer with some partition
of the logfiles assigned to each indexer, and finally the existing large
elasticsearch node.

Eventually properly load balancing log processing across the worker
nodes would be great, but the current partition method should work well
enough with little additional effort.

Change-Id: Ifc6396560934314ffd6a7c47eb2acff9e9c2a7af
Reviewed-on: https://review.openstack.org/30573
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-29 00:33:36 +00:00
Clark Boylan
03bf2a553f Allocate more memory to ElasticSearch indexing.
* modules/logstash/files/elasticsearch.yml: By default ElasticSearch
allocates 10% of its memory space to indexing. Bump this up to 40% to
help ensure indexing does not block on needing more memory.

Change-Id: Ic2b862235c12467213ab9916e7f85d92559efc37
Reviewed-on: https://review.openstack.org/30796
Reviewed-by: Khai Do <zaro0508@gmail.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-29 00:33:33 +00:00
Clark Boylan
d637726079 Increase Logstash ES output max_inflight_requests.
The default value for the Logstash ElasticSearch max_inflight_requests
parameters is 50. Bump that up to 512, to have a bigger firehose to
ElasticSearch. ElasticSearch is the piece of the Logstash puzzle that
doesn't seem to have trouble with bigger firehoses.

Change-Id: I3eeaa036c68b00a8daa0896a4256b30043f04aaa
Reviewed-on: https://review.openstack.org/30769
Reviewed-by: Khai Do <zaro0508@gmail.com>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-29 00:33:30 +00:00
Clark Boylan
3b8e20e598 Set an upper bound to log pusher output queue.
Logstash's queues are small. During periods of high load this can cause
the log pusher to cache all of the logs it is pulling in. Set an upper
bound to its output queue size to force it to block when Logstash cannot
keep up. This should prevent OOMing and won't impact log throughput as
Logstash is blocking anyways.

Change-Id: I9ca31e6dbe454e9c4878fd7ba35bc33bc9df7d83
Reviewed-on: https://review.openstack.org/30572
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Khai Do <zaro0508@gmail.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-28 23:54:36 +00:00
Jeremy Stanley
52abfa977f Clarify StackForge document audience and workflow.
* doc/source/stackforge.rst: Adjust the project onboarding sequence
to suggest requesting an initial group member last, since this seems
to be the simpler and less error-prone order. Also add a brief
subsection to the introduction describing the intended audience and
linking to prerequisite documentation for those who need some
additional education on OpenStack code review process and
convention.

Change-Id: I4a7cc6e56505a462c5596abe587c560bfa722f00
Reviewed-on: https://review.openstack.org/30564
Reviewed-by: slamet hendry <slamet.hendry@gmail.com>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Tested-by: Jenkins
2013-05-28 18:24:42 +00:00
Flaper Fesp
3d136e613f Adding the list for OpenStack discussions in Spanish
Change-Id: I8208bba0dfaad67ae9050b1939064a4fd5686967
Reviewed-on: https://review.openstack.org/30495
Reviewed-by: David Ripton <dripton@redhat.com>
Reviewed-by: Stefano Maffulli <stefano@openstack.org>
Reviewed-by: Tom Fifield <fifieldt@unimelb.edu.au>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: James E. Blair <corvus@inaugust.com>
Tested-by: Jenkins
2013-05-28 15:40:18 +00:00
Matt Riedemann
1817c2ed96 Exclude *tempest-docs jobs from stable/(folsom|grizzly)
Fixes bug 1183841

Change-Id: I89230403ff24e8d0a26860c29e11d87bcf58bbca
Reviewed-on: https://review.openstack.org/30446
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Sean Dague <sean@dague.net>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-26 03:43:31 +00:00
Andy Edmonds
91528d6b18 Adding occi-os to stackforge
This adds the occi-os project to stackforge. This commit is a follow-
up to bug/1172884.

Change-Id: Ica192bdb4adaff99731c39eefc566c27ae1de575
Fixes: bug #1172884
Reviewed-on: https://review.openstack.org/30343
Reviewed-by: James E. Blair <corvus@inaugust.com>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-26 03:43:25 +00:00
James E. Blair
445cea1883 Add operations-guide.
It is a git filter-branch extration from openstack-manuals.

Addresses bug 1180552.

Change-Id: I0506b76de8cc1df3139781f02d1eef4669f50a7a
Reviewed-on: https://review.openstack.org/29614
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Anne Gentle <anne@openstack.org>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-26 03:42:39 +00:00
Monty Taylor
40c9a7a405 Don't suppress errors in run-cover.
Seriously. Why did I think that was a good idea?

Change-Id: I161a97d36592f271c7f2b1291acfd87b12199118
Reviewed-on: https://review.openstack.org/30524
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-26 03:03:18 +00:00
Elizabeth Krumbach
6ee09c0918 Add ssl-cert-check to cacti server
Add monitoring of SSL certificates for openstack websites

Change-Id: I50b6a8aced7ae563381eb948ce4e8f854a6d85a9
Reviewed-on: https://review.openstack.org/30490
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Approved: Jeremy Stanley <fungi@yuggoth.org>
Reviewed-by: Jeremy Stanley <fungi@yuggoth.org>
Tested-by: Jenkins
2013-05-26 02:57:11 +00:00
Jeremy Stanley
fa1bb4f3f7 Perform kernel upgrades on new Ubuntu servers.
* install_jenkins_slave.sh: Perform a dist-upgrade on Ubuntu
servers, similar to install_puppet.sh.

* install_puppet.sh: Change from upgrade to dist-upgrade so kernels
will also be included in the initial package upgrade step.

Change-Id: Ia39c37f75cc411ce92b1deb5125fa0c5c6e6db35
Reviewed-on: https://review.openstack.org/30388
Reviewed-by: James E. Blair <corvus@inaugust.com>
Approved: Clark Boylan <clark.boylan@gmail.com>
Reviewed-by: Clark Boylan <clark.boylan@gmail.com>
Tested-by: Jenkins
2013-05-24 17:50:50 +00:00