470 Commits

Author SHA1 Message Date
Monty Taylor
fa3b8f4869 Make storyboard run over ssl
We're doing auth now, so we should really do it over SSL.

The cert contents are already in hiera.

Change-Id: Ia939e228785168705840acd6d377e6c25ba3370d
2014-03-09 16:01:09 -07:00
James E. Blair
ec6b513d24 Add statusbot to all known channels
Also add SergeyLukjanov to statusbot controlling nicks.

Change-Id: I6e52358c2dcb59f00a2a139410379fe581a78290
2014-03-06 15:23:37 -08:00
Jenkins
70a089ecdb Merge "Move git01.openstack.org to a new server" 2014-03-04 22:26:43 +00:00
Jenkins
980587e20d Merge "Add storyboard SSL cert/key/chain" 2014-03-04 21:57:13 +00:00
Jenkins
35903cc196 Merge "Add OpenstackID SSL Certs" 2014-03-04 21:04:04 +00:00
James E. Blair
cec801f872 Add storyboard SSL cert/key/chain
Commented out because they aren't used, but the keys are in
hiera with these values.

Change-Id: Ie1d0bc5a9a996d55995c0d1c6d1ae961353f0c65
2014-03-04 20:39:55 +00:00
Jeremy Stanley
e5660ed3e9 Move git01.openstack.org to a new server
This moves git01.openstack.org to a new server, but should not be
merged until the old one is gracefully offlined in haproxy and the
new one is in sync with Gerrit replication and has been thoroughly
tested.

Change-Id: I84a3b2710edd96087a29735ca26863c75eb5023d
2014-03-04 20:32:12 +00:00
Jenkins
ef21ba4669 Merge "Move git02.openstack.org to a new server" 2014-03-04 18:50:50 +00:00
Jenkins
a7f233bc53 Merge "Remove old elasticsearch cluster members" 2014-03-04 18:45:24 +00:00
Jeremy Stanley
21de5ebefe Move git02.openstack.org to a new server
This moves git02.openstack.org to a new server, but should not be
merged until the old one is gracefully offlined in haproxy and the
new one is in sync with Gerrit replication and has been thoroughly
tested.

Change-Id: I8d0cc04ac6429a7780020242c9cc1ff2f0126b6e
2014-03-04 15:41:20 +00:00
Jeremy Stanley
1f377429f1 Move git03.openstack.org to a new server
This moves git03.openstack.org to a new server, but should not be
merged until the old one is gracefully offlined in haproxy and the
new one is in sync with Gerrit replication and has been thoroughly
tested.

Change-Id: Id4ab17d959fb6b7ab959fffca061b2c246a73b79
2014-03-04 01:14:44 +00:00
Jenkins
0c8bd2ee7b Merge "Move git04.openstack.org to a new server" 2014-03-03 21:33:55 +00:00
Marton Kiss
7df5b877bf Add OpenstackID SSL Certs
Add openstackid ssl cert in site.pp and pass ssl cert contents
to underlying openstackid classes.

Change-Id: I5d26f42ceacc38389703ea9921b265e4ddeed00f
2014-03-03 16:43:22 +01:00
Jenkins
8e82596ab1 Merge "Move primary elasticsearch discover node" 2014-02-27 18:06:16 +00:00
Jeremy Stanley
55860b0e51 Move git04.openstack.org to a new server
This moves git04.openstack.org to a new server, but should not be
merged until the old one is gracefully offlined in haproxy and the
new one is in sync with Gerrit replication and has been thoroughly
tested.

Change-Id: Ib15fe65bfd7e8099ae7ec1f4c9b08a15c4a7956e
2014-02-27 16:18:38 +00:00
Jenkins
72be2f94c1 Merge "Remove deprecated elasticsearch nodes from kibana" 2014-02-27 00:40:03 +00:00
Jeremy Stanley
a52c161658 Remove old elasticsearch cluster members
Once the elasticsearch cluster members have all been replaced,
remove them.

Change-Id: Id00faeb0ef2ae631ae7dab1e889aa1ba5b853f8f
2014-02-26 22:00:09 +00:00
Jeremy Stanley
d90a9bc3fb Move primary elasticsearch discover node
Now that the new elasticsearch cluster members are joined, we need
to move the primary discover node from elasticsearch.openstack.org
to one of the new servers before we can remove it from service.

Change-Id: I79fe4e2154def6b0404b6620601f4a02b63fee8a
2014-02-26 22:00:08 +00:00
Jeremy Stanley
ccc39c3bb8 Remove deprecated elasticsearch nodes from kibana
Kibana seems to be the only module using this list, and by default
it will try to query any nodes in this list even if they've been
pulled from service. Preemptively remove them from its configuration
so that it will continue to perform queries correctly.

Change-Id: Iecdc3414dec7ed2816b5a68a3398b0643fccaf31
2014-02-26 22:00:06 +00:00
Jeremy Stanley
cc4bbfcdbc Add git05 to the git.openstack.org haproxy farm
Once the git repositories on git05 are replicated from
review.openstack.org and confirmed in sync, merge this to add it to
the farm.

Change-Id: I6bc87957ff9ba7983c48ce156ab7658a9ab8a5ad
2014-02-26 20:40:29 +00:00
Jenkins
a31b9f1c53 Merge "Install and run elasticsearch on new workers" 2014-02-25 19:34:37 +00:00
Jenkins
f9ef1f9193 Merge "Clean up puppet (deploy LAMP / setup app config)" 2014-02-25 15:16:18 +00:00
Jeremy Stanley
a42846d2e7 Install and run elasticsearch on new workers
Add the actual elasticsearch module and associated parameters to the
new worker nodes, and put them in the node and discovery lists.

Change-Id: I0b55e4c5c8a3f0864dab2b2bf7f498b65bc20fd2
2014-02-25 00:28:46 +00:00
Jeremy Stanley
cde1a4abee Create new 30g heap elasticsearch workers
Temporarily leave the old node names in place with an override to
16g heap size, but pass the openstack_project default of 30g into
the elasticsearch module as a new variable. Also don't actually
configure the new servers to install and run elasticsearch yet,
since there are manual steps needed to prep the additional block
devices on them.

Change-Id: I9fca2115c8996ae2f1a6c605bcdf16a8b6342a24
2014-02-25 00:04:37 +00:00
James E. Blair
032ab0d470 Enable statsd for jenkins-log-client
Change-Id: I4395ce2151fc666cae1d9ea76b43bc3663e98ac8
2014-02-21 10:54:24 -08:00
smarcet
b7ce8e9533 Clean up puppet (deploy LAMP / setup app config)
Implements: blueprint openid-oauth2-infra-implementation-puppet-script

Prepares a raw server with all software stack needed to run
openstackid project:

* installs PHP
* installs Apache
* installs Redis Server
* creates a initial environment configuration for laravel application
  (using *.erb templates)

Change-Id: If6216da0d70a45609076e8111a67055dbc87c9e4
2014-02-21 11:33:40 -03:00
Jenkins
ffa5cae8d4 Merge "Add puppetdb to a new puppetdb host" 2014-02-18 17:58:58 +00:00
James E. Blair
17e09934db Fix zuul installation
The following items were missing from an automated zuul install:

 * A pre-populated known hosts file
 * The git user/email for creating commits (.gitconfig existed
   on zuul.o.o, but switch to using zuul's config file instead).

Also, make sure that the mergers specify the zuul server as the
gearman server address rather than localhost.

Change-Id: I47a473f60c4b5b2daaa910aa61cdf6e0c6fe1528
2014-02-18 02:33:24 +00:00
James E. Blair
083281f7ee Add Zuul merge servers
Remove obsolete config options from zuul module.

The server and merger classes are constructed so that they
may coexist on a single server.  Also, the init section is
constructed so that it will install everything needed for
both services but without activating them (leaving maximum
flexibility for the operator).

Change-Id: I7b86fbbe4611c5edfb463a0a6944e0717f664188
2014-02-17 11:11:21 -08:00
Spencer Krum
04b114ba82 Add puppetdb to a new puppetdb host
This brings in the puppetdb module via install_modules.sh and
creates a new class, openstack_project::puppetdb. It was modeled
on openstack_project::puppetmaster. Note that this will not enable
puppetdb to participate in the Puppet ecosystem yet. An additional
class will have to be added to the master:

  class { 'puppetdb::master::config':
    puppetdb_server => 'puppetdb',
  }

I will leave this out of this change so we can bring up puppetdb in
stages.

This paves the way for puppetboard to be brought online.

Change-Id: I8194372bd31e08f12a815fd04dcdf338565ed911
2014-02-15 16:14:33 -08:00
Monty Taylor
51949062fb Add replication key for gerrit from hiera
The ssh key in ~gerrit2/.ssh/id_rsa which is what is used for outbound
ssh-based replication is currently just kinda there by hand. Add management
of the files there.

Change-Id: I5bfea4543d6eb46ba2e9f3c791f4e6b6c5534522
Closes-Bug: 1209464
2014-02-09 21:13:31 +00:00
Jenkins
dc13aa372f Merge "Redo slave manifests for clarity and correctness." 2014-02-05 22:27:38 +00:00
Jenkins
eccb3478f9 Merge "point zuul-dev to review-dev" 2014-01-31 22:44:06 +00:00
Jeremy Stanley
f20639a2be Install and use the Gerrit welcome-message keypair
Change-Id: I7c23112664e43713f8dfc4bd0e4b9aec46b71500
2014-01-31 22:04:15 +00:00
Clark Boylan
0f4b0fae64 Redo slave manifests for clarity and correctness.
The differences between openstack_project::slave,
openstack_project::slave_template, and openstack_project::bare_slave
were not always clear. Keep openstack_project::slave as the default long
running slave manifest, but replace slave_template with a
single_use_slave.pp to make it clear where single use slave config
begins. Add the ability to toggle automatic upgrades and jenkins sudo
rights to this new manifest. Finally, add a more verbose comment to
bare_slave explaining what it is useful for (having a jenkins like slave
host that doesn't need a firewall or ntp or automatic upgrades).

Change-Id: I3989c9e6ad9469f441ca5d3627f7b3b704d8a8da
2014-01-30 10:37:36 -08:00
Khai Do
3e4ef9e003 point zuul-dev to review-dev
Partial-Bug: #1082781
Change-Id: I9fab6a763c45cfa0b7c2970f98876d178df16690
2014-01-29 15:47:56 -08:00
Ruslan Kamaldinov
265bd8fe1d Add Storyboard puppet module
There are two major parts being installed with this module:
1. storyboard-api - REST API service served  with
   apache mod_wsgi module
2. storyboard-webclient - static html/css/js files.
   This project is built and published to tarballs.o.o,
   from where it'll be installed with this puppet module

This module requires three configs from Hiera:
* storyboard_db_host
* storyboard_db_password
* storyboard_db_user

Installed projects:
* http://git.openstack.org/cgit/openstack-infra/storyboard/
* http://git.openstack.org/cgit/openstack-infra/storyboard-webclient/

Things to be added in later commits:
* Documentation for ci.openstack.org
* Configure logging (once supported by storyboard)
* SSL

Change-Id: If3da06f8d20a6282036f1f9f063c25a6d0db60c6
2014-01-29 06:47:37 +04:00
Monty Taylor
2dfcf4fb71 Add three new jenkins servers
Change-Id: I1143c1c7446890c47be12d8b115560bddadc1919
2014-01-22 12:50:40 -05:00
Jenkins
18f4498ec1 Merge "Set up openstackid module" 2014-01-14 22:46:47 +00:00
James E. Blair
0c8845494d Don't have zuul replicate to git.o.o
Change-Id: I8a80b26d843501d0e426bcff84ad8f71c5a68fc5
2014-01-08 20:24:51 +08:00
James E. Blair
62e37a37d8 Fix passing zuul public key to git backends
Change-Id: I774d36ce82266e1431ff89acdc6450dbb1626004
2014-01-08 16:50:59 +08:00
Jeremy Stanley
73c0175819 Allow zuul to push to git servers
* manifests/site.pp
* modules/openstack_project/manifests/git_backend.pp: Add the zuul
server's public SSH key to a dedicated zuul account on the git
server farm. This will allow zuul to push arbitrary references into
its scratch repositories. Also set ownership on its scratch
repository hierarchy and pack them, properly skipping it in the
existing cgit repo repack since ownership differs.

Change-Id: I4b5b583847c828aadc903270433882531e5b1ea7
2014-01-08 16:43:36 +08:00
James E. Blair
14694564df Fix typo in puppet
Change-Id: I39c29152e985aceefd1cc9032ca51081668d787d
2014-01-08 16:12:39 +08:00
James E. Blair
2866945db2 Have Zuul replicate to git.o.o
Change-Id: I750e8ea75181dacb10275a38fa702ed1edb56d4c
2014-01-08 15:52:00 +08:00
James E. Blair
f6500357f0 Add jenkins03 and 04 to most places
Add them to all the places it's safe to do so for now.  Don't actually
spin up any nodes for them yet.

Change-Id: I59e97be7e5b094af3153bc7d5dce0cff57996f55
2014-01-07 09:58:17 +08:00
James E. Blair
2bb28339cb Move elastic-recheck bot to status.o.o
Also, normalize some parameters to the status manifest to make it
more readable (since they follow the same pattern).  And make the
ssh config for elastic-recheck bot match reviewday.

Change-Id: I2417f121e7b3685aab9540504cdd4c6db1754e67
2013-12-31 19:35:47 +00:00
Jeremy Stanley
318c79b9fc Set up openstackid module
Refactor the openstack_project::openstackid_dev module out into a
top-level openstackid module in preparation for multiple servers,
set up Apache to serve content out of /srv/openstackid, add an
/etc/openstackid/database.php file with connection details injected
from hiera and keep an updated clone of openstack-infra/openstackid
in /opt/openstackid.

Change-Id: Icdde594384e3af27c8dd185a51b9e5a71619fb7b
2013-12-27 22:56:55 +00:00
James E. Blair
90aa64a644 Remove status.o.o vhost from static.o.o
Change-Id: I8e7ee035b10895043622041bf8bdfef84162ffd5
2013-12-19 14:57:02 -08:00
James E. Blair
757d7fa5bf Remove old logstash worker nodes
Change-Id: If67bf7ce363a8db500fc893dc38f7f4f46bda3f5
2013-12-18 13:34:26 -08:00
Jenkins
dd37040caa Merge "Increase to 16 logstash worker nodes" 2013-12-18 18:28:59 +00:00