489 Commits

Author SHA1 Message Date
James E. Blair
22486c7353 Plumb mysql host through gerrit.pp
Change-Id: I9fceda90f9e9a06bc738e70f35595b7f05426ab0
2014-04-28 15:32:15 -07:00
Monty Taylor
47a361d596 Manage gerritbot ssh key with puppet
I'm not sure this really needs a longer commit message.

Change-Id: If0a7db1b4a988fd181753748d5fc9d26cf1bb906
2014-04-28 12:18:42 -07:00
James E. Blair
0c5b2fad15 Support configurable mysql host in gerrit
In further support of using a trove db, remove the gerrit::mysql
module from review-dev.  Plumb mysql_host throughout and remove
the no longer necessary mysql_root_password.  Configure review-dev
to use mysql_host from hiera, but configure review to use
'localhost'.

Change-Id: Id13cea66601f80c5b17d2a4069a14f7b458ea09d
2014-04-23 10:31:37 -07:00
Clark Boylan
30c2f7d462 Remove puppet dashboard.
Puppet board has replaced puppet dashboard. Remove reference to puppet
dashboard as it shouldn't be used.

Change-Id: I5eeee2984729ef5d1b883b4762347d19786e28ed
2014-04-17 14:48:19 -07:00
Jenkins
94405f8f2b Merge "Remove activity-dev server" 2014-04-17 19:30:25 +00:00
James E. Blair
2f3956198a Remove activity-dev server
It is not in use currently.

Change-Id: Iac53d2af79249448f14211a0f4a4972e46e10703
2014-04-17 10:40:52 -07:00
Monty Taylor
edaa31ebbd Add keys and script for puppet over ssh
In anticipation of driving puppet over ssh, we need keys on the hosts
and the scripts on the master. Don't turn them on yet, because we want
to be able to do some by-hand testing of the mechanism.

Change-Id: I2c353777e2f8fb5a2e733ce405ba40427ce901e5
2014-04-15 20:24:16 -07:00
Clark Boylan
943ed2315f Zuul use dedicated ssh key.
Zuul should use a dedicated ssh key rather than piggy backing off of the
jenkins ssh key. This change makes this distinction clear and removes
one zuul use of the jenkins ssh key that is not necessary.

Change-Id: I74c811a8bf94838b285791e158f4e468513eaa3e
2014-04-15 10:54:52 -07:00
Clark Boylan
7d1a297e4b Make jenkins proposal jobs use dedicated user.
Switch all jenkins proposal jobs to a dedicated user with dedicated
credentials. This is being done to be more flexible and secure when it
comes to managing the scripts that make proposals to gerrit.

Change-Id: I2dbdd530bf5b64c14207f645512a1eb319681166
2014-04-14 15:38:31 -07:00
Clark Boylan
929ebfd170 Use snakeoil certs on numbered jenkins masters.
Make it easier to deploy jenkins masters by using snakeoil certs on
numbered jenkins masters. This also simplifies the process of replacing
certs as make-ssl-cert can easily regenerate snakeoil certs for us.

Change-Id: I4966b1e502e0edf4f6fad25f06b9bacca25c5951
2014-04-09 14:50:19 -07:00
Marton Kiss
4ec69a09d8 Openstackid Mysql connection Hiera variables
Add two puppet hiera variables to override defaults for
openstackid-dev in site.pp to access remote user profile database
(mysql_user, db_name). Now we can use the following
mysql parameters for connection:
- openstackid_dev_ss_mysql_host: mysql host
- openstackid_dev_ss_mysql_password: password for mysql account
- openstackid_dev_ss_mysql_user: user name of mysql account
- openstackid_dev_ss_db_name: database name

Change-Id: Ied0e3918d117c13ef53763461242e5380f0bab00
2014-04-07 17:44:39 +02:00
Jenkins
32d3abef76 Merge "Revert "Enable Gearman as default on Jenkins slaves"" 2014-03-31 22:54:06 +00:00
James E. Blair
8af61da62f Revert "Enable Gearman as default on Jenkins slaves"
SERVER: Invalid relationship: File[/var/lib/jenkins/hudson.plugins.gearman.GearmanPluginConfig.xml] { require => Class[Zuul] }, because Class[Zuul]doesn't seem to be in the catalog

This reverts commit 2a9cd677e4eb6a60787ebc73bd8fd9e1b6f26b34
2014-03-31 22:49:41 +00:00
Jenkins
d302b1b698 Merge "Enable Gearman as default on Jenkins slaves" 2014-03-31 16:29:50 +00:00
Jenkins
b219665c28 Merge "Remove obsolete static job workers" 2014-03-30 22:27:43 +00:00
Jenkins
2add3c1fa1 Merge "Add a script to manage IRC perms" 2014-03-21 19:15:43 +00:00
iberezovskiy
2a9cd677e4 Enable Gearman as default on Jenkins slaves
We don't need to enable Gearman through Jenkins UI.
It'll we done as default.

Change-Id: I50a1506f7efa3d71034cca2caebb6e5ddb76285a
2014-03-21 12:08:31 +04:00
James E. Blair
9dad326acc Add a script to manage IRC perms
Run it whenever there is a change to the YAML channel config.

The script will ensure everyone listed in global has those perms
and anyone else found with access on a channel will be left as-is
except that their access will be limited to the relevant mask.

Move it and the previous change to add a permission checking
script into a new module, 'accessbot'.

Support SSL in both scripts.

Add a 1 second sleep in the check script to avoid flood protection.

Add all known channels to the channel config.

Closes-Bug: 1190296
Change-Id: I5072cb56ae83a70f4fa955362b8db909b2956d70
2014-03-10 17:26:34 -07:00
Monty Taylor
fa3b8f4869 Make storyboard run over ssl
We're doing auth now, so we should really do it over SSL.

The cert contents are already in hiera.

Change-Id: Ia939e228785168705840acd6d377e6c25ba3370d
2014-03-09 16:01:09 -07:00
James E. Blair
ec6b513d24 Add statusbot to all known channels
Also add SergeyLukjanov to statusbot controlling nicks.

Change-Id: I6e52358c2dcb59f00a2a139410379fe581a78290
2014-03-06 15:23:37 -08:00
Jenkins
70a089ecdb Merge "Move git01.openstack.org to a new server" 2014-03-04 22:26:43 +00:00
Jenkins
980587e20d Merge "Add storyboard SSL cert/key/chain" 2014-03-04 21:57:13 +00:00
Jenkins
35903cc196 Merge "Add OpenstackID SSL Certs" 2014-03-04 21:04:04 +00:00
James E. Blair
cec801f872 Add storyboard SSL cert/key/chain
Commented out because they aren't used, but the keys are in
hiera with these values.

Change-Id: Ie1d0bc5a9a996d55995c0d1c6d1ae961353f0c65
2014-03-04 20:39:55 +00:00
Jeremy Stanley
e5660ed3e9 Move git01.openstack.org to a new server
This moves git01.openstack.org to a new server, but should not be
merged until the old one is gracefully offlined in haproxy and the
new one is in sync with Gerrit replication and has been thoroughly
tested.

Change-Id: I84a3b2710edd96087a29735ca26863c75eb5023d
2014-03-04 20:32:12 +00:00
Jenkins
ef21ba4669 Merge "Move git02.openstack.org to a new server" 2014-03-04 18:50:50 +00:00
Jenkins
a7f233bc53 Merge "Remove old elasticsearch cluster members" 2014-03-04 18:45:24 +00:00
Jeremy Stanley
21de5ebefe Move git02.openstack.org to a new server
This moves git02.openstack.org to a new server, but should not be
merged until the old one is gracefully offlined in haproxy and the
new one is in sync with Gerrit replication and has been thoroughly
tested.

Change-Id: I8d0cc04ac6429a7780020242c9cc1ff2f0126b6e
2014-03-04 15:41:20 +00:00
Jeremy Stanley
1f377429f1 Move git03.openstack.org to a new server
This moves git03.openstack.org to a new server, but should not be
merged until the old one is gracefully offlined in haproxy and the
new one is in sync with Gerrit replication and has been thoroughly
tested.

Change-Id: Id4ab17d959fb6b7ab959fffca061b2c246a73b79
2014-03-04 01:14:44 +00:00
Jenkins
0c8bd2ee7b Merge "Move git04.openstack.org to a new server" 2014-03-03 21:33:55 +00:00
Marton Kiss
7df5b877bf Add OpenstackID SSL Certs
Add openstackid ssl cert in site.pp and pass ssl cert contents
to underlying openstackid classes.

Change-Id: I5d26f42ceacc38389703ea9921b265e4ddeed00f
2014-03-03 16:43:22 +01:00
Jenkins
8e82596ab1 Merge "Move primary elasticsearch discover node" 2014-02-27 18:06:16 +00:00
Jeremy Stanley
55860b0e51 Move git04.openstack.org to a new server
This moves git04.openstack.org to a new server, but should not be
merged until the old one is gracefully offlined in haproxy and the
new one is in sync with Gerrit replication and has been thoroughly
tested.

Change-Id: Ib15fe65bfd7e8099ae7ec1f4c9b08a15c4a7956e
2014-02-27 16:18:38 +00:00
Jenkins
72be2f94c1 Merge "Remove deprecated elasticsearch nodes from kibana" 2014-02-27 00:40:03 +00:00
Jeremy Stanley
a52c161658 Remove old elasticsearch cluster members
Once the elasticsearch cluster members have all been replaced,
remove them.

Change-Id: Id00faeb0ef2ae631ae7dab1e889aa1ba5b853f8f
2014-02-26 22:00:09 +00:00
Jeremy Stanley
d90a9bc3fb Move primary elasticsearch discover node
Now that the new elasticsearch cluster members are joined, we need
to move the primary discover node from elasticsearch.openstack.org
to one of the new servers before we can remove it from service.

Change-Id: I79fe4e2154def6b0404b6620601f4a02b63fee8a
2014-02-26 22:00:08 +00:00
Jeremy Stanley
ccc39c3bb8 Remove deprecated elasticsearch nodes from kibana
Kibana seems to be the only module using this list, and by default
it will try to query any nodes in this list even if they've been
pulled from service. Preemptively remove them from its configuration
so that it will continue to perform queries correctly.

Change-Id: Iecdc3414dec7ed2816b5a68a3398b0643fccaf31
2014-02-26 22:00:06 +00:00
Jeremy Stanley
cc4bbfcdbc Add git05 to the git.openstack.org haproxy farm
Once the git repositories on git05 are replicated from
review.openstack.org and confirmed in sync, merge this to add it to
the farm.

Change-Id: I6bc87957ff9ba7983c48ce156ab7658a9ab8a5ad
2014-02-26 20:40:29 +00:00
Jenkins
a31b9f1c53 Merge "Install and run elasticsearch on new workers" 2014-02-25 19:34:37 +00:00
Jenkins
f9ef1f9193 Merge "Clean up puppet (deploy LAMP / setup app config)" 2014-02-25 15:16:18 +00:00
Jeremy Stanley
a42846d2e7 Install and run elasticsearch on new workers
Add the actual elasticsearch module and associated parameters to the
new worker nodes, and put them in the node and discovery lists.

Change-Id: I0b55e4c5c8a3f0864dab2b2bf7f498b65bc20fd2
2014-02-25 00:28:46 +00:00
Jeremy Stanley
cde1a4abee Create new 30g heap elasticsearch workers
Temporarily leave the old node names in place with an override to
16g heap size, but pass the openstack_project default of 30g into
the elasticsearch module as a new variable. Also don't actually
configure the new servers to install and run elasticsearch yet,
since there are manual steps needed to prep the additional block
devices on them.

Change-Id: I9fca2115c8996ae2f1a6c605bcdf16a8b6342a24
2014-02-25 00:04:37 +00:00
James E. Blair
032ab0d470 Enable statsd for jenkins-log-client
Change-Id: I4395ce2151fc666cae1d9ea76b43bc3663e98ac8
2014-02-21 10:54:24 -08:00
smarcet
b7ce8e9533 Clean up puppet (deploy LAMP / setup app config)
Implements: blueprint openid-oauth2-infra-implementation-puppet-script

Prepares a raw server with all software stack needed to run
openstackid project:

* installs PHP
* installs Apache
* installs Redis Server
* creates a initial environment configuration for laravel application
  (using *.erb templates)

Change-Id: If6216da0d70a45609076e8111a67055dbc87c9e4
2014-02-21 11:33:40 -03:00
Jenkins
ffa5cae8d4 Merge "Add puppetdb to a new puppetdb host" 2014-02-18 17:58:58 +00:00
Jeremy Stanley
7bb18b2397 Remove obsolete static job workers
Change-Id: Iefc9447e647ceabd4ebd9b0044bf007c9723738b
2014-02-18 17:52:37 +00:00
James E. Blair
17e09934db Fix zuul installation
The following items were missing from an automated zuul install:

 * A pre-populated known hosts file
 * The git user/email for creating commits (.gitconfig existed
   on zuul.o.o, but switch to using zuul's config file instead).

Also, make sure that the mergers specify the zuul server as the
gearman server address rather than localhost.

Change-Id: I47a473f60c4b5b2daaa910aa61cdf6e0c6fe1528
2014-02-18 02:33:24 +00:00
James E. Blair
083281f7ee Add Zuul merge servers
Remove obsolete config options from zuul module.

The server and merger classes are constructed so that they
may coexist on a single server.  Also, the init section is
constructed so that it will install everything needed for
both services but without activating them (leaving maximum
flexibility for the operator).

Change-Id: I7b86fbbe4611c5edfb463a0a6944e0717f664188
2014-02-17 11:11:21 -08:00
Spencer Krum
04b114ba82 Add puppetdb to a new puppetdb host
This brings in the puppetdb module via install_modules.sh and
creates a new class, openstack_project::puppetdb. It was modeled
on openstack_project::puppetmaster. Note that this will not enable
puppetdb to participate in the Puppet ecosystem yet. An additional
class will have to be added to the master:

  class { 'puppetdb::master::config':
    puppetdb_server => 'puppetdb',
  }

I will leave this out of this change so we can bring up puppetdb in
stages.

This paves the way for puppetboard to be brought online.

Change-Id: I8194372bd31e08f12a815fd04dcdf338565ed911
2014-02-15 16:14:33 -08:00
Monty Taylor
51949062fb Add replication key for gerrit from hiera
The ssh key in ~gerrit2/.ssh/id_rsa which is what is used for outbound
ssh-based replication is currently just kinda there by hand. Add management
of the files there.

Change-Id: I5bfea4543d6eb46ba2e9f3c791f4e6b6c5534522
Closes-Bug: 1209464
2014-02-09 21:13:31 +00:00