620 Commits

Author SHA1 Message Date
Spencer Krum
7b1f4ad0fe Set $group at node scope for hiera lookups
In order to support ansible copying split-out hiera files from the
master to the nodes, we need to support group files in addition to just
fqdn and common files.

Change-Id: I0732cc8521bc5f6588f5de286f874a69ef45ab14
2015-03-17 13:47:35 -04:00
Jenkins
b3ba5531f1 Merge "Hostname and CORS domains are now configurable." 2015-03-16 16:09:52 +00:00
Jenkins
ae8d1ec90f Merge "Added Valid OAuth client configuration to storyboard manifest." 2015-03-16 16:09:13 +00:00
Jenkins
23466bd8c0 Merge "Also serve zuul status.json via HTTPS" 2015-03-16 12:20:00 +00:00
Jenkins
58f1c1e8ae Merge "Move openstack_project::server to node def" 2015-03-13 16:08:47 +00:00
Jenkins
91480b309c Merge "Start testing review.o.o on trusty" 2015-03-10 22:45:08 +00:00
Spencer Krum
118b2762de Move openstack_project::server to node def
Partial implementation of:
http://specs.openstack.org/openstack-infra/infra-specs/specs/server_base_template_refactor.html

This pulls the openstack_project::server class out of the paste class
meaning only parameters actually needed by the paste class are passed
in to the paste class.

Change-Id: Iba93853c12f84271d4991679dfe80c2ca9e07d8f
Story: 2000172
2015-03-09 17:50:01 -07:00
Jenkins
fa9e74d3b5 Merge "Initial commit of Ask website" 2015-03-10 00:34:47 +00:00
Marton Kiss
71da74ece2 Initial commit of Ask website
Add ask.openstack.org to openstack-infra. Setup an all-in-one
askbot site based on existing deployment, including apache,
redis,apache solr,postgresql. See askbot.rst for further
details. Refactored to depend on vamsee's puppet solr module.

Depends-On: Iffe07d3a34087cb15151787bc683208425a27594
Change-Id: I36504eac7b953c3cce3e21a3559ac95b1bc12da7
2015-03-09 23:58:30 +00:00
Jeremy Stanley
cd324bdfac Also serve zuul status.json via HTTPS
So that we can include slices of zuul status data via Javascript at
https://review.openstack.org/ we also need it to be served via HTTPS
to match or else browsers will balk at it. Note that this does not
stop serving via HTTP or redirect it in any way, it is merely a
secondary means of obtaining the same data.

Change-Id: I1a11c990ea83e00550a0564ac1cf9d5d883db97d
Depends-On: I9799f39bf170f660bcbc17719937e1e87b68ac4a
2015-02-26 14:45:31 -08:00
Michael Krotscheck
5dd484f1b2 Hostname and CORS domains are now configurable.
Moved $hostname and $cors_allowed_origins into the top
level module, so that they may be set on a per-host basis.

Change-Id: I9859c903d0075493d230e433d68e0471f019140a
2015-02-23 13:08:51 -08:00
Michael Krotscheck
1bd2b2bca9 Added Valid OAuth client configuration to storyboard manifest.
StoryBoard now only permits a finite list of authorized oauth clients,
which are based on the domain host. This adds the necessary configuration
elements to the OpenStack StoryBoard manifest.

Change-Id: Ia7d34e9b80399ffa9e4229d6cc7035061c41dffc
Depends-on: I29495a0b640c3ca097cca8c17349df5cc42388de
2015-02-23 12:27:02 -08:00
Jenkins
776e790919 Merge "Set the expiry for zuul swift instructions" 2015-02-18 22:42:21 +00:00
Joshua Hesketh
fc44a50f64 Set the expiry for zuul swift instructions
Update the time from the default 2hrs to 4hrs. Some jobs now take
longer than 2 hours to run and this also allows time for testing
when a node is in hold.

Depends-On: I73758f04ed8dfb0e5227eac55505c9bc01c540df
Change-Id: I9e76ccdd9735e6042744f237ceb9af9b9d570f76
2015-02-18 14:46:55 +11:00
James E. Blair
72eb1acc13 Also test puppet zuul on trusty
People are starting to move from precise to trusty, and the module
is supposed to support both now.

Change-Id: I9bf92d799a1460b61e8abb853a79707dd502ee52
Depends-On: I70d814a5eaefea5a3fb6a47bc215f4ab64be884f
2015-02-13 15:38:06 -08:00
Jenkins
3dae6982de Merge "Change the gerrit_user on zuul-dev.o.o to match zuul.o.o" 2015-02-11 04:45:02 +00:00
Jenkins
0e4605bd5f Merge "Run review-dev on Ubuntu Trusty" 2015-02-11 00:37:33 +00:00
Khai Do
170f6b5e9e Change the gerrit_user on zuul-dev.o.o to match zuul.o.o
The zuul.o.o layout.yaml is set to trigger on comments from the
'jenkins' user.  Changing the gerrit user to match the one used
by zuul.o.o to llow us to maintain a similar layout.yaml for
zuul-dev.o.o

Change-Id: Idc5b668a9e8187f7127bcf1bebdacf99d38a57e7
2015-02-06 11:34:04 -08:00
Jenkins
c940f0d109 Merge "Create the known_hosts file for zuul user on review-dev.o.o" 2015-02-04 22:05:53 +00:00
Jeremy Stanley
12e00773c6 Start testing review.o.o on trusty
Gerrit 2.9 has some newer dependencies we need from Ubuntu Trusty,
so in preparation for the upgrade go ahead and begin testing our
puppet manifest with that transition in mind.

Change-Id: I1a31e2e5d432df4ca08673238f7b8fceefb19201
2015-02-04 22:04:31 +00:00
Jenkins
5d855aabcb Merge "Run nodepool on Ubuntu Trusty" 2015-02-04 21:46:50 +00:00
Khai Do
6ddb5922a4 Create the known_hosts file for zuul user on review-dev.o.o
The zuul user on zuul-dev.o.o could not connect to review-dev.o.o because the
/home/zuul/.ssh/known_hosts file did not get created.  This causes zuul-merger
to fail because it needs that to clone repos from review-dev.o.o.  This change
passes the gerrit public key from review-dev.o.o so that puppet can create the
known_hosts file.

Change-Id: Iae5d63cc7fd01dc68e4eef96a29bccda6f047eb3
2015-02-04 10:41:08 -08:00
Jenkins
a5d5380cf6 Merge "MySQL database cleanup for paste.o.o" 2015-02-04 14:21:37 +00:00
Jeremy Stanley
03c827b289 Run review-dev on Ubuntu Trusty
The review-dev.openstack.org server is now running on Ubuntu Trusty,
so test its manifest accordingly.

Change-Id: I1267a99ca997fd393f5950709cce9c0207281516
Depends-On: Iac6ab2c731175d62c2bfc58a52adafc61e25963a
2015-01-30 21:52:45 +00:00
Jenkins
dc287c08c1 Merge "Create puppet-forge credentials on the pypi slave" 2015-01-26 21:53:36 +00:00
Jenkins
95875d785f Merge "Remove nodepool-dev as it is becoming nodepool.o.o" 2015-01-19 21:10:20 +00:00
Jeremy Stanley
d6d4efc907 Run nodepool on Ubuntu Trusty
The nodepool.openstack.org server is now running on Ubuntu Trusty,
so test its manifest accordingly.

Change-Id: I08784812c28838233bcbc0ed6a80e8aa81b1568b
2015-01-15 22:06:20 +00:00
Jenkins
583791c6bf Merge "Remove community.openstack.org from the list of server" 2015-01-14 23:51:55 +00:00
Jeremy Stanley
8cad8d737f MySQL database cleanup for paste.o.o
Now that paste.openstack.org is using a local MySQL database,
unnecessary parameters are removed from the manifests. This should
only be approved after the maintenance to start using the local
database has concluded.

Change-Id: Icc63a6a08e3ee36fbc6fde207542b9e3647fb4cf
2015-01-09 15:15:45 +00:00
Jeremy Stanley
b7e352cc86 Add a local MySQL database to paste.o.o
Due to performance problems with the current Trove backend, add a
MySQL database locally on paste.openstack.org for later use.

Change-Id: Idc04a95ba157e4d3722c3ea8a703e52c5793976c
2015-01-09 15:15:24 +00:00
Stefano Maffulli
deee2ecd21 Remove community.openstack.org from the list of server
This host seems not to be in use by anyone.

Change-Id: I420a964d34dc90bc64a5fdb817b3013535df5114
2014-12-17 17:38:08 -08:00
Clark Boylan
dde5354db2 Remove nodepool-dev as it is becoming nodepool.o.o
Our old nodepool host is going away and nodepool-dev is taking its spot.
Remove nodepool-dev from the firewall rules for the various nodes
nodepool talks too.

Note that this should only be merged after nodepool.openstack.org has
DNS records that point at the new trusty host and the old
nodepool-dev.o.o DNS records have been completely removed.

Change-Id: Ieb13b7dfed0ab44b72615f38eb28bb046222ff6a
2014-12-16 12:43:40 -08:00
Matthew Treinish
d69df1515f Switch mysql-proxy to simpleproxy
Mysql-proxy turns out too unreliable and unstable for use in
production. The packaged version on Ubuntu suffers from a critical DOS
by using telnet. This patch switches from mysql-proxy to simpleproxy,
which is just a tcp proxy to forward incoming port 3306 connections to
the subunit2sql db.

Change-Id: Iffea64aea46cc34969bbaa970e5d91bd0cc05232
2014-12-12 15:40:54 -05:00
Jenkins
afd18da9a4 Merge "Enable SSL for groups.openstack.org" 2014-12-12 17:11:11 +00:00
Jenkins
f04a53c78e Merge "Add mysql-proxy to enable read-only access to a db" 2014-12-12 16:52:56 +00:00
Marton Kiss
ebcb1ae1ce Enable SSL for groups.openstack.org
Enable the SSL connection for groups.openstack.org, required
by oauth2 authentication of openstackid.org.

New hiera variables:
- groups_site_ssl_cert_file_contents: x509 certificate of the vhost
in pem format.
- groups_site_ssl_key_file_contents: key of x509 cert in pem format.
- groups_site_ssl_chain_file_contents: parent certs of site certificate

Change-Id: Ia266e1ee057467e5149b84f8b5f8be98bf63180f
Implements: blueprint groups-oauth2-authentication
2014-12-10 12:09:03 +01:00
Clark Boylan
4ce8c4ca4a Use 'fe' instead of 'frontend'
There is some preference for using shorter host names so make
git-frontendXX git-feXX instead.

Change-Id: I8a5d80b3f0df537890abd18a22e62a22bc19c51f
2014-12-09 13:40:24 -08:00
Clark Boylan
7cee3e14e7 Update git frontend regex to support more nodes
We are going to round robin multiple git.openstack.org frontends. Before
we build new nodes to do that we need to update the site.pp to properlly
configure new nodes with these names.

New name format will be git-frontendXX.openstack.org.

Change-Id: Id7f9405909c91e457270687592948456db3aa420
2014-12-09 13:17:57 -08:00
Matthew Treinish
364e5ca681 Add mysql-proxy to enable read-only access to a db
This commit adds a mysql_proxy module which will setup a read-only
proxy to a mysql db. This also configures a proxy to the subunit2sql
db to run on logstash.o.o to provide read only access to the data in
the database.

Change-Id: I478baca354354347fe50074a8e3b9f66ca890d55
2014-12-05 19:27:23 +00:00
Matthew Treinish
5941f835ac Switch subunit2sql to use decomposed uri
This commit switches the subunit2sql_uri which get's passed into the
config file template to use decomposed values. The advantage of this
is that it enables using subsets of the information elsewhere.

Change-Id: I30b5117c12897fa3a1cb1e2579b4eec59ba57b2b
2014-12-05 14:27:00 -05:00
Jenkins
fe231ef1f3 Merge "Adds logging to the #openstack-sprint channel" 2014-11-28 23:43:03 +00:00
Jenkins
e28b838c29 Merge "Allow traffic from nodepool-dev" 2014-11-26 21:17:11 +00:00
Jenkins
c07852f395 Merge "Enable SSL in groups-dev.openstack.org" 2014-11-26 16:25:22 +00:00
Spencer Krum
17b1469c2e Create puppet-forge credentials on the pypi slave
This will enable puppet forge release of puppet modules
using the release pipeline. See
 https://review.openstack.org/134834
 for the details.

Change-Id: I7c3004828df34672442d190bb60a8a342cacffd0
2014-11-25 15:17:10 -08:00
Clark Boylan
b612904a35 Allow traffic from nodepool-dev
We have a new trusty nodepool server spun up that we are not quite ready
to make use of. To ease the transition and to allow testing of this new
server it has DNS records pointing to it with names of
nodepool-dev.openstack.org. Add this name to the firewall rules that
allow nodepool to talk with jenkins, zuul, and graphite.

With this in place we can test it without actually putting the new
server into service.

Change-Id: Ice9fd9ed7a85dad89c5d9dfcb2e2ed5fac2e3512
2014-11-25 10:32:18 -08:00
Marton Kiss
f64a50b1e8 Enable SSL in groups-dev.openstack.org
Extend the Drupal vhost template with ssl capability, and
groups-dev.openstack.org now accepts the following hiera variables for
ssl setup:
- groups_dev_site_ssl_cert_file_contents: x509 certificate of vhost in pem format
- groups_dev_site_ssl_key_file_contents: rsa key of x509 certificate in pem format
- groups_dev_site_ssl_chain_file_contents: trusted chain of parent certificates (optional)

This patch is required for proper openstackid/oauth2 backref communication.

Change-Id: Ia148d1db743fc80bcb675c9ca2906333ef62eff8
Implements: blueprint groups-oauth2-authentication
2014-11-25 18:32:26 +01:00
Matthew Treinish
d2e09c5876 Remove unnecessary use of logstash::indexer from subunit_worker
Previously the subunit2sql worker.pp was including the
logstash::indexer class, but this was really only done for the
/etc/logstash dir which is where the worker puts all it's files. This
commit corrects this by just ensuring the directory exists instead of
importing the other class which includes a lot of other unnecessary
things.

Change-Id: I3f00d1bb443ee0f1b2a8e9d393f46a7e9ebf148a
2014-11-18 20:07:02 -05:00
Matthew Treinish
fc266f8e18 Add subunit2sql workers
This commit adds the subunit2sql workers to site.pp

Change-Id: I0bf526611602c15b062ffca920a740dda7515200
2014-11-17 09:52:44 -05:00
Jenkins
01f61ae359 Merge "Add subunit2sql_db_uri taken from hiera for logstash" 2014-11-07 16:23:00 +00:00
Anita Kuno
4902ed5d92 Adds logging to the #openstack-sprint channel
We have created a new channel for virtual sprints called
openstack-sprint. This patch adds logging.

Please merge after https://review.openstack.org/#/c/133256/
has merged (gives channel permissions to infra).

Change-Id: I284aff251b41e6d03494176c13001ef17812267e
2014-11-07 16:51:58 +01:00