opendev/system-config
Code Issues Proposed changes
3de606ff8a
system-config/manifests/site.pp

717 lines
27 KiB
ObjectPascal
Raw Normal View History

Add default puppet node. Change-Id: I1e1e723a9847b55dbb825a078a4dd5d9c08ce37b
2011-09-08 13:20:21 -07:00
#
# Default: should at least behave like an openstack server
#
node default {
Move OpenStack classes to openstack_project module Change-Id: Iafcd2e06c5b62e4cde5eccaab3173a20bb08a78d
2012-07-20 18:56:35 -07:00
include openstack_project::puppet_cron
Pass sysadmins list into node defs. Pass the sysadmins list into each node definition. This allows us to retrieve the data from hiera rather than hard coding it in the puppet manifests. Also, update test script to use bogus sysadmin data when testing. Change-Id: Ide3560f16bce4d66fb95cc5021fc879476e6a712 Reviewed-on: https://review.openstack.org/12512 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-06 10:32:48 -07:00
class { 'openstack_project::server':
sysadmins => hiera('sysadmins'),
}
Add default puppet node. Change-Id: I1e1e723a9847b55dbb825a078a4dd5d9c08ce37b
2011-09-08 13:20:21 -07:00
}
Move all node configuration into site.pp, with node identifiers based on hostnames so that puppet self-identifies which node config to use. Refactor class hierarchy for OpenStack slaves and servers. Add NTP to all systems. Change-Id: Ie7695768fcdebb744a86b3dc88bc0ea71297f978
2011-08-02 12:58:08 -07:00
#
# Long lived servers:
#
Style guide updates for manifest directory Change-Id: I40d54189eb6d5cd4512080ec5010fe339bac96e0 Signed-off-by: Paul Belanger <paul.belanger@polybeacon.com> Reviewed-on: https://review.openstack.org/13830 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-28 10:05:02 -04:00
node 'review.openstack.org' {
Move hiera calls into site.pp. Secret info should be parameters to modules. It makes for easier testing. Change-Id: I66034387094b2a24c6fae57fec3af1dae3dd1d3a
2012-07-26 18:58:35 -05:00
class { 'openstack_project::review':
Add replication key for gerrit from hiera The ssh key in ~gerrit2/.ssh/id_rsa which is what is used for outbound ssh-based replication is currently just kinda there by hand. Add management of the files there. Change-Id: I5bfea4543d6eb46ba2e9f3c791f4e6b6c5534522 Closes-Bug: 1209464
2014-02-04 10:03:33 +01:00
github_oauth_token => hiera('gerrit_github_token'),
github_project_username => hiera('github_project_username'),
github_project_password => hiera('github_project_password'),
mysql_password => hiera('gerrit_mysql_password'),
mysql_root_password => hiera('gerrit_mysql_root_password'),
email_private_key => hiera('gerrit_email_private_key'),
gerritbot_password => hiera('gerrit_gerritbot_password'),
ssl_cert_file_contents => hiera('gerrit_ssl_cert_file_contents'),
ssl_key_file_contents => hiera('gerrit_ssl_key_file_contents'),
ssl_chain_file_contents => hiera('gerrit_ssl_chain_file_contents'),
ssh_dsa_key_contents => hiera('gerrit_ssh_dsa_key_contents'),
ssh_dsa_pubkey_contents => hiera('gerrit_ssh_dsa_pubkey_contents'),
ssh_rsa_key_contents => hiera('gerrit_ssh_rsa_key_contents'),
ssh_rsa_pubkey_contents => hiera('gerrit_ssh_rsa_pubkey_contents'),
ssh_project_rsa_key_contents => hiera('gerrit_project_ssh_rsa_key_contents'),
ssh_project_rsa_pubkey_contents => hiera('gerrit_project_ssh_rsa_pubkey_contents'),
ssh_welcome_rsa_key_contents => hiera('welcome_message_gerrit_ssh_private_key'),
ssh_welcome_rsa_pubkey_contents => hiera('welcome_message_gerrit_ssh_public_key'),
ssh_replication_rsa_key_contents => hiera('gerrit_replication_ssh_rsa_key_contents'),
ssh_replication_rsa_pubkey_contents => hiera('gerrit_replication_ssh_rsa_pubkey_contents'),
lp_sync_consumer_key => hiera('gerrit_lp_consumer_key'),
lp_sync_token => hiera('gerrit_lp_access_token'),
lp_sync_secret => hiera('gerrit_lp_access_secret'),
contactstore_appsec => hiera('gerrit_contactstore_appsec'),
contactstore_pubkey => hiera('gerrit_contactstore_pubkey'),
sysadmins => hiera('sysadmins'),
swift_username => hiera('swift_store_user'),
swift_password => hiera('swift_store_key'),
Move hiera calls into site.pp. Secret info should be parameters to modules. It makes for easier testing. Change-Id: I66034387094b2a24c6fae57fec3af1dae3dd1d3a
2012-07-26 18:58:35 -05:00
}
Add Gerrit configuration to puppet. Change-Id: I26ebd80adb00ac5bf676533d5dd9359cbbe08075
2011-08-05 23:00:46 +00:00
}
Add review2 node. To bootstrap a new gerrit server. Also, make the consumer_key field in the lp creds file templated and use a value from hiera so that dev/prod can share the template. Change-Id: Ie14e560beae4f4c270e558c24a67096a1c4a7d32 Reviewed-on: https://review.openstack.org/14369 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2012-10-11 16:55:07 -07:00
node 'review-dev.openstack.org' {
Move hiera calls into site.pp. Secret info should be parameters to modules. It makes for easier testing. Change-Id: I66034387094b2a24c6fae57fec3af1dae3dd1d3a
2012-07-26 18:58:35 -05:00
class { 'openstack_project::review_dev':
Attempt to more fully manage project creation. Manage project creation via yaml files. Also, Modify the manage_projects scripts to configure Gerrit project ACLs. This change expects the project yaml to exist. The change will clone the project for the localhost Gerrit install. It will then checkout the meta/config ref, copy the ACL config file into the repo, commit, and push to the origin. The ACL config location should be specified in the projects.yaml file with the acl_config key. For this to work the ACLs will need to be copied by Puppet from Puppet to the Gerrit host. Add the file resource to do this as well. Change-Id: I15a1ec13b381dce3c115c01c21f404ab79e72cc4 Reviewed-on: https://review.openstack.org/15352 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-11-04 22:20:36 +01:00
github_oauth_token => hiera('gerrit_dev_github_token'),
github_project_username => hiera('github_dev_project_username'),
github_project_password => hiera('github_dev_project_password'),
mysql_password => hiera('gerrit_dev_mysql_password'),
mysql_root_password => hiera('gerrit_dev_mysql_root_password'),
email_private_key => hiera('gerrit_dev_email_private_key'),
contactstore_appsec => hiera('gerrit_dev_contactstore_appsec'),
contactstore_pubkey => hiera('gerrit_dev_contactstore_pubkey'),
ssh_dsa_key_contents => hiera('gerrit_dev_ssh_dsa_key_contents'),
ssh_dsa_pubkey_contents => hiera('gerrit_dev_ssh_dsa_pubkey_contents'),
ssh_rsa_key_contents => hiera('gerrit_dev_ssh_rsa_key_contents'),
ssh_rsa_pubkey_contents => hiera('gerrit_dev_ssh_rsa_pubkey_contents'),
ssh_project_rsa_key_contents => hiera('gerrit_dev_project_ssh_rsa_key_contents'),
ssh_project_rsa_pubkey_contents => hiera('gerrit_dev_project_ssh_rsa_pubkey_contents'),
lp_sync_consumer_key => hiera('gerrit_dev_lp_consumer_key'),
lp_sync_token => hiera('gerrit_dev_lp_access_token'),
lp_sync_secret => hiera('gerrit_dev_lp_access_secret'),
sysadmins => hiera('sysadmins'),
Move hiera calls into site.pp. Secret info should be parameters to modules. It makes for easier testing. Change-Id: I66034387094b2a24c6fae57fec3af1dae3dd1d3a
2012-07-26 18:58:35 -05:00
}
Move all node configuration into site.pp, with node identifiers based on hostnames so that puppet self-identifies which node config to use. Refactor class hierarchy for OpenStack slaves and servers. Add NTP to all systems. Change-Id: Ie7695768fcdebb744a86b3dc88bc0ea71297f978
2011-08-02 12:58:08 -07:00
}
Style guide updates for manifest directory Change-Id: I40d54189eb6d5cd4512080ec5010fe339bac96e0 Signed-off-by: Paul Belanger <paul.belanger@polybeacon.com> Reviewed-on: https://review.openstack.org/13830 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-28 10:05:02 -04:00
node 'jenkins.openstack.org' {
Move hiera calls into site.pp. Secret info should be parameters to modules. It makes for easier testing. Change-Id: I66034387094b2a24c6fae57fec3af1dae3dd1d3a
2012-07-26 18:58:35 -05:00
class { 'openstack_project::jenkins':
Pass jenkins.o.o cert contents in from hiera. Use hiera to store the jenkins.o.o cert contents and populate the cert files from the values in hiera. Change-Id: Iffd724b7fabf9403506f08f76fa927c3b461ba19 Reviewed-on: https://review.openstack.org/13933 Approved: James E. Blair <corvus@inaugust.com> Reviewed-by: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2012-10-01 18:53:58 -07:00
jenkins_jobs_password => hiera('jenkins_jobs_password'),
Add jenkins dev slaves. Allow them to use an ssh key distinct from production. Clean up unused slave classes. Use dedicated keys on dev slaves (do this in prod in the future, but it's a breaking change). Add a dev_slave_template class for devstack-gate to use. Remove devstack-gate deps from jenkins master (they're on devstack-launch now). Clean up unneeded remove statements for glance creds. Tidy up some permissions on files where they weren't specified before. Change-Id: I02cef1ee3951c5780084118073770521bebb9eda Reviewed-on: https://review.openstack.org/29319 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-05-15 16:03:05 -07:00
jenkins_ssh_private_key => hiera('jenkins_ssh_private_key_contents'),
Pass jenkins.o.o cert contents in from hiera. Use hiera to store the jenkins.o.o cert contents and populate the cert files from the values in hiera. Change-Id: Iffd724b7fabf9403506f08f76fa927c3b461ba19 Reviewed-on: https://review.openstack.org/13933 Approved: James E. Blair <corvus@inaugust.com> Reviewed-by: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2012-10-01 18:53:58 -07:00
ssl_cert_file_contents => hiera('jenkins_ssl_cert_file_contents'),
ssl_key_file_contents => hiera('jenkins_ssl_key_file_contents'),
ssl_chain_file_contents => hiera('jenkins_ssl_chain_file_contents'),
sysadmins => hiera('sysadmins'),
Add nodepool host Change-Id: Ib216bd400aa269ccdb17848b3870ab65400cf3d2
2013-08-15 17:52:52 +00:00
zmq_event_receivers => ['logstash.openstack.org',
'nodepool.openstack.org',
],
Move hiera calls into site.pp. Secret info should be parameters to modules. It makes for easier testing. Change-Id: I66034387094b2a24c6fae57fec3af1dae3dd1d3a
2012-07-26 18:58:35 -05:00
}
Add jenkins master support. Change-Id: Idd43b8e4b3dbe2a3781669f51943efa041b7b863
2012-01-05 10:55:29 -08:00
}
Add new jenkins masters. Add jenkins01 and jenkins02, both of which will have unit test and devstack slaves. Leave jenkins.o.o alone; over time it will be reduced so that it alone has special jobs and privileged slaves attached to it. Note that currently all of the jobs will be defined on all nodes, including jobs on timers. I think the long-term fix for that is to have zuul schedule timed jobs. Change-Id: I10bbd5555e5194b1031700975d5b3ae6b458b8b3
2013-07-26 15:33:06 -07:00
node 'jenkins01.openstack.org' {
class { 'openstack_project::jenkins':
jenkins_jobs_password => hiera('jenkins_jobs_password'),
jenkins_ssh_private_key => hiera('jenkins_ssh_private_key_contents'),
ssl_cert_file_contents => hiera('jenkins01_ssl_cert_file_contents'),
ssl_key_file_contents => hiera('jenkins01_ssl_key_file_contents'),
ssl_chain_file_contents => hiera('jenkins01_ssl_chain_file_contents'),
sysadmins => hiera('sysadmins'),
Add nodepool host Change-Id: Ib216bd400aa269ccdb17848b3870ab65400cf3d2
2013-08-15 17:52:52 +00:00
zmq_event_receivers => ['logstash.openstack.org',
'nodepool.openstack.org',
],
Add new jenkins masters. Add jenkins01 and jenkins02, both of which will have unit test and devstack slaves. Leave jenkins.o.o alone; over time it will be reduced so that it alone has special jobs and privileged slaves attached to it. Note that currently all of the jobs will be defined on all nodes, including jobs on timers. I think the long-term fix for that is to have zuul schedule timed jobs. Change-Id: I10bbd5555e5194b1031700975d5b3ae6b458b8b3
2013-07-26 15:33:06 -07:00
}
}
node 'jenkins02.openstack.org' {
class { 'openstack_project::jenkins':
jenkins_jobs_password => hiera('jenkins_jobs_password'),
jenkins_ssh_private_key => hiera('jenkins_ssh_private_key_contents'),
ssl_cert_file_contents => hiera('jenkins02_ssl_cert_file_contents'),
ssl_key_file_contents => hiera('jenkins02_ssl_key_file_contents'),
ssl_chain_file_contents => hiera('jenkins02_ssl_chain_file_contents'),
sysadmins => hiera('sysadmins'),
Add nodepool host Change-Id: Ib216bd400aa269ccdb17848b3870ab65400cf3d2
2013-08-15 17:52:52 +00:00
zmq_event_receivers => ['logstash.openstack.org',
'nodepool.openstack.org',
Create jenkins03 and jenkins04 Change-Id: I8db56b9a7a2ad8f423d052c07d4908480d9f8762
2013-11-20 10:56:02 -08:00
],
}
}
node 'jenkins03.openstack.org' {
class { 'openstack_project::jenkins':
jenkins_jobs_password => hiera('jenkins_jobs_password'),
jenkins_ssh_private_key => hiera('jenkins_ssh_private_key_contents'),
ssl_cert_file_contents => hiera('jenkins03_ssl_cert_file_contents'),
ssl_key_file_contents => hiera('jenkins03_ssl_key_file_contents'),
ssl_chain_file_contents => hiera('jenkins03_ssl_chain_file_contents'),
sysadmins => hiera('sysadmins'),
zmq_event_receivers => ['logstash.openstack.org',
'nodepool.openstack.org',
],
}
}
node 'jenkins04.openstack.org' {
class { 'openstack_project::jenkins':
jenkins_jobs_password => hiera('jenkins_jobs_password'),
jenkins_ssh_private_key => hiera('jenkins_ssh_private_key_contents'),
ssl_cert_file_contents => hiera('jenkins04_ssl_cert_file_contents'),
ssl_key_file_contents => hiera('jenkins04_ssl_key_file_contents'),
ssl_chain_file_contents => hiera('jenkins04_ssl_chain_file_contents'),
sysadmins => hiera('sysadmins'),
zmq_event_receivers => ['logstash.openstack.org',
'nodepool.openstack.org',
Add nodepool host Change-Id: Ib216bd400aa269ccdb17848b3870ab65400cf3d2
2013-08-15 17:52:52 +00:00
],
Add new jenkins masters. Add jenkins01 and jenkins02, both of which will have unit test and devstack slaves. Leave jenkins.o.o alone; over time it will be reduced so that it alone has special jobs and privileged slaves attached to it. Note that currently all of the jobs will be defined on all nodes, including jobs on timers. I think the long-term fix for that is to have zuul schedule timed jobs. Change-Id: I10bbd5555e5194b1031700975d5b3ae6b458b8b3
2013-07-26 15:33:06 -07:00
}
}
Add three new jenkins servers Change-Id: I1143c1c7446890c47be12d8b115560bddadc1919
2014-01-22 09:12:39 -08:00
node 'jenkins05.openstack.org' {
class { 'openstack_project::jenkins':
jenkins_jobs_password => hiera('jenkins_jobs_password'),
jenkins_ssh_private_key => hiera('jenkins_ssh_private_key_contents'),
ssl_cert_file_contents => hiera('jenkins05_ssl_cert_file_contents'),
ssl_key_file_contents => hiera('jenkins05_ssl_key_file_contents'),
ssl_chain_file_contents => hiera('jenkins05_ssl_chain_file_contents'),
sysadmins => hiera('sysadmins'),
zmq_event_receivers => ['logstash.openstack.org',
'nodepool.openstack.org',
],
}
}
node 'jenkins06.openstack.org' {
class { 'openstack_project::jenkins':
jenkins_jobs_password => hiera('jenkins_jobs_password'),
jenkins_ssh_private_key => hiera('jenkins_ssh_private_key_contents'),
ssl_cert_file_contents => hiera('jenkins06_ssl_cert_file_contents'),
ssl_key_file_contents => hiera('jenkins06_ssl_key_file_contents'),
ssl_chain_file_contents => hiera('jenkins06_ssl_chain_file_contents'),
sysadmins => hiera('sysadmins'),
zmq_event_receivers => ['logstash.openstack.org',
'nodepool.openstack.org',
],
}
}
node 'jenkins07.openstack.org' {
class { 'openstack_project::jenkins':
jenkins_jobs_password => hiera('jenkins_jobs_password'),
jenkins_ssh_private_key => hiera('jenkins_ssh_private_key_contents'),
ssl_cert_file_contents => hiera('jenkins07_ssl_cert_file_contents'),
ssl_key_file_contents => hiera('jenkins07_ssl_key_file_contents'),
ssl_chain_file_contents => hiera('jenkins07_ssl_chain_file_contents'),
sysadmins => hiera('sysadmins'),
zmq_event_receivers => ['logstash.openstack.org',
'nodepool.openstack.org',
],
}
}
Style guide updates for manifest directory Change-Id: I40d54189eb6d5cd4512080ec5010fe339bac96e0 Signed-off-by: Paul Belanger <paul.belanger@polybeacon.com> Reviewed-on: https://review.openstack.org/13830 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-28 10:05:02 -04:00
node 'jenkins-dev.openstack.org' {
Pass sysadmins list into node defs. Pass the sysadmins list into each node definition. This allows us to retrieve the data from hiera rather than hard coding it in the puppet manifests. Also, update test script to use bogus sysadmin data when testing. Change-Id: Ide3560f16bce4d66fb95cc5021fc879476e6a712 Reviewed-on: https://review.openstack.org/12512 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-06 10:32:48 -07:00
class { 'openstack_project::jenkins_dev':
add nodepool to jenkins-dev server We are co-locating nodepool on jenkins-dev to allow us to test jenkins upgrades. This dev nodepool is configured to only spin up machines in one AZ on hpcloud. Change-Id: I73f6d4373fa79fec8845d7d81fa1235f7fe15482
2013-11-19 21:46:13 +00:00
jenkins_ssh_private_key => hiera('jenkins_dev_ssh_private_key_contents'),
sysadmins => hiera('sysadmins'),
mysql_password => hiera('nodepool_dev_mysql_password'),
mysql_root_password => hiera('nodepool_dev_mysql_root_password'),
nodepool_ssh_private_key => hiera('jenkins_dev_ssh_private_key_contents'),
jenkins_api_user => hiera('jenkins_dev_api_user'),
jenkins_api_key => hiera('jenkins_dev_api_key'),
jenkins_credentials_id => hiera('jenkins_dev_credentials_id'),
hpcloud_username => hiera('nodepool_hpcloud_username'),
hpcloud_password => hiera('nodepool_hpcloud_password'),
hpcloud_project => hiera('nodepool_hpcloud_project'),
Pass sysadmins list into node defs. Pass the sysadmins list into each node definition. This allows us to retrieve the data from hiera rather than hard coding it in the puppet manifests. Also, update test script to use bogus sysadmin data when testing. Change-Id: Ide3560f16bce4d66fb95cc5021fc879476e6a712 Reviewed-on: https://review.openstack.org/12512 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-06 10:32:48 -07:00
}
Update jenkins master config. Add the required apache modules. Add the jenkins archive key. Make sure the jenkins repo is set up and apt-get update is run before installing jenkins. Change-Id: I503705d893246300e50f3b54da6114863dc8de93
2012-02-28 11:37:20 -08:00
}
Add cacti host. Change-Id: I67cc116ad8a2b2586856965ae1e341d735d69fd3 Reviewed-on: https://review.openstack.org/14582 Reviewed-by: Monty Taylor <mordred@inaugust.com> Approved: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2012-10-20 23:53:20 +00:00
node 'cacti.openstack.org' {
Add ssl-cert-check to cacti server Add monitoring of SSL certificates for openstack websites Change-Id: I50b6a8aced7ae563381eb948ce4e8f854a6d85a9 Reviewed-on: https://review.openstack.org/30490 Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Tested-by: Jenkins
2013-05-24 12:43:54 -07:00
include openstack_project::ssl_cert_check
Add cacti host. Change-Id: I67cc116ad8a2b2586856965ae1e341d735d69fd3 Reviewed-on: https://review.openstack.org/14582 Reviewed-by: Monty Taylor <mordred@inaugust.com> Approved: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2012-10-20 23:53:20 +00:00
class { 'openstack_project::cacti':
sysadmins => hiera('sysadmins'),
}
}
Style guide updates for manifest directory Change-Id: I40d54189eb6d5cd4512080ec5010fe339bac96e0 Signed-off-by: Paul Belanger <paul.belanger@polybeacon.com> Reviewed-on: https://review.openstack.org/13830 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-28 10:05:02 -04:00
node 'community.openstack.org' {
Pass sysadmins list into node defs. Pass the sysadmins list into each node definition. This allows us to retrieve the data from hiera rather than hard coding it in the puppet manifests. Also, update test script to use bogus sysadmin data when testing. Change-Id: Ide3560f16bce4d66fb95cc5021fc879476e6a712 Reviewed-on: https://review.openstack.org/12512 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-06 10:32:48 -07:00
class { 'openstack_project::community':
sysadmins => hiera('sysadmins'),
}
Add community.openstack.org. Change-Id: I0fac07af1f64c82df68338c009c1fb9e8565d339
2011-09-08 13:17:57 -07:00
}
Style guide updates for manifest directory Change-Id: I40d54189eb6d5cd4512080ec5010fe339bac96e0 Signed-off-by: Paul Belanger <paul.belanger@polybeacon.com> Reviewed-on: https://review.openstack.org/13830 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-28 10:05:02 -04:00
node 'ci-puppetmaster.openstack.org' {
Pass sysadmins list into node defs. Pass the sysadmins list into each node definition. This allows us to retrieve the data from hiera rather than hard coding it in the puppet manifests. Also, update test script to use bogus sysadmin data when testing. Change-Id: Ide3560f16bce4d66fb95cc5021fc879476e6a712 Reviewed-on: https://review.openstack.org/12512 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-06 10:32:48 -07:00
class { 'openstack_project::puppetmaster':
sysadmins => hiera('sysadmins'),
}
Add puppet master Opens up the required port for a puppet master server Adds a git pull to update the master Update the docs for the improved way of configuring puppet master Change-Id: I12a4c2820f78df723ede922ca8e0b9d33ed42a33
2012-06-06 20:54:34 +01:00
}
Add graphite. Change-Id: I276641d55e966cd76013cae847061c3ac7996864 Reviewed-on: https://review.openstack.org/17094 Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-11-28 23:12:07 +00:00
node 'graphite.openstack.org' {
class { 'openstack_project::graphite':
sysadmins => hiera('sysadmins'),
graphite_admin_user => hiera('graphite_admin_user'),
graphite_admin_email => hiera('graphite_admin_email'),
graphite_admin_password => hiera('graphite_admin_password'),
Remove devstack launch nodes and jobs Change-Id: Icc6ba916df45b2a763f85a73412f9c8e1df88701
2013-08-15 18:24:07 -07:00
statsd_hosts => ['nodepool.openstack.org',
Add statsd configuration to zuul. And allow zuul to send to statsd. Change-Id: Ie9f78268a673523c4ea4025bdbbe40d8d3819398 Reviewed-on: https://review.openstack.org/18658 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2012-12-26 10:48:15 -08:00
'zuul.openstack.org'],
Add graphite. Change-Id: I276641d55e966cd76013cae847061c3ac7996864 Reviewed-on: https://review.openstack.org/17094 Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-11-28 23:12:07 +00:00
}
}
Add groups.openstack.org. Change-Id: Ie143fe2477372c0c1a7fe6675b538b2b40146626 Reviewed-on: https://review.openstack.org/15624 Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: Paul Belanger <paul.belanger@polybeacon.com> Approved: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2012-11-08 10:52:37 +01:00
node 'groups.openstack.org' {
class { 'openstack_project::groups':
sysadmins => hiera('sysadmins'),
}
}
Add groups-dev.openstack.org node Add a groups-dev node to openstack infra, based on drupal environment. This node checks out the repository: https://git.openstack.org/openstack-infra/groups Build a new deployment from scratch, including drush make distbuild and drush si auto-installation features. Change-Id: I71eef1c14724ceb13a896ff768923148dedcc2ef
2013-09-17 11:43:00 +02:00
node 'groups-dev.openstack.org' {
class { 'openstack_project::groups_dev':
sysadmins => hiera('sysadmins'),
site_admin_password => hiera('groups_dev_site_admin_password'),
site_mysql_host => hiera('groups_dev_site_mysql_host'),
site_mysql_password => hiera('groups_dev_site_mysql_password'),
}
}
Style guide updates for manifest directory Change-Id: I40d54189eb6d5cd4512080ec5010fe339bac96e0 Signed-off-by: Paul Belanger <paul.belanger@polybeacon.com> Reviewed-on: https://review.openstack.org/13830 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-28 10:05:02 -04:00
node 'lists.openstack.org' {
Move hiera calls into site.pp. Secret info should be parameters to modules. It makes for easier testing. Change-Id: I66034387094b2a24c6fae57fec3af1dae3dd1d3a
2012-07-26 18:58:35 -05:00
class { 'openstack_project::lists':
Puppetizing mailing lists Allow for mailing lists to be created with a request for review. Change-Id: I8b3b0965119418cfc9286cd20221fe38ffd06b24 Reviewed-on: https://review.openstack.org/29833 Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Elizabeth Krumbach Joseph <lyz@princessleia.com> Approved: James E. Blair <corvus@inaugust.com> Reviewed-by: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2013-05-20 13:47:24 -07:00
listadmins => hiera('listadmins'),
listpassword => hiera('listpassword'),
Move hiera calls into site.pp. Secret info should be parameters to modules. It makes for easier testing. Change-Id: I66034387094b2a24c6fae57fec3af1dae3dd1d3a
2012-07-26 18:58:35 -05:00
}
Move all node configuration into site.pp, with node identifiers based on hostnames so that puppet self-identifies which node config to use. Refactor class hierarchy for OpenStack slaves and servers. Add NTP to all systems. Change-Id: Ie7695768fcdebb744a86b3dc88bc0ea71297f978
2011-08-02 12:58:08 -07:00
}
Style guide updates for manifest directory Change-Id: I40d54189eb6d5cd4512080ec5010fe339bac96e0 Signed-off-by: Paul Belanger <paul.belanger@polybeacon.com> Reviewed-on: https://review.openstack.org/13830 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-28 10:05:02 -04:00
node 'paste.openstack.org' {
Pass sysadmins list into node defs. Pass the sysadmins list into each node definition. This allows us to retrieve the data from hiera rather than hard coding it in the puppet manifests. Also, update test script to use bogus sysadmin data when testing. Change-Id: Ide3560f16bce4d66fb95cc5021fc879476e6a712 Reviewed-on: https://review.openstack.org/12512 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-06 10:32:48 -07:00
class { 'openstack_project::paste':
sysadmins => hiera('sysadmins'),
}
Add lodgeit to puppet Will automatically install paste.drizzle.org and paste.openstack.org onto a server Change-Id: Ia2c1e37892f3ae8e3d4034e38ddfaa01c6a92a54
2012-01-30 13:57:37 +00:00
}
Style guide updates for manifest directory Change-Id: I40d54189eb6d5cd4512080ec5010fe339bac96e0 Signed-off-by: Paul Belanger <paul.belanger@polybeacon.com> Reviewed-on: https://review.openstack.org/13830 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-28 10:05:02 -04:00
node 'planet.openstack.org' {
Pass sysadmins list into node defs. Pass the sysadmins list into each node definition. This allows us to retrieve the data from hiera rather than hard coding it in the puppet manifests. Also, update test script to use bogus sysadmin data when testing. Change-Id: Ide3560f16bce4d66fb95cc5021fc879476e6a712 Reviewed-on: https://review.openstack.org/12512 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-06 10:32:48 -07:00
class { 'openstack_project::planet':
sysadmins => hiera('sysadmins'),
}
Add planet support Adds planet module and planet.openstack.org site. Change-Id: Id4d495889346e0a0d85d0fd05e40d451b04d21b1 Note: will not work with current openstack-planet git branch. Update for that comming
2012-02-03 14:37:54 +00:00
}
Style guide updates for manifest directory Change-Id: I40d54189eb6d5cd4512080ec5010fe339bac96e0 Signed-off-by: Paul Belanger <paul.belanger@polybeacon.com> Reviewed-on: https://review.openstack.org/13830 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-28 10:05:02 -04:00
node 'eavesdrop.openstack.org' {
Move hiera calls into site.pp. Secret info should be parameters to modules. It makes for easier testing. Change-Id: I66034387094b2a24c6fae57fec3af1dae3dd1d3a
2012-07-26 18:58:35 -05:00
class { 'openstack_project::eavesdrop':
Add statusbot to eavesdrop.o.o. Change-Id: I3ae19a6321827b82ebf864182a1e5a90253b9c39 Reviewed-on: https://review.openstack.org/25755 Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2013-03-29 13:47:38 -07:00
nickpass => hiera('openstack_meetbot_password'),
sysadmins => hiera('sysadmins'),
statusbot_nick => hiera('statusbot_nick'),
statusbot_password => hiera('statusbot_nick_password'),
statusbot_server => 'chat.freenode.net',
Add openstack, openstack-dev to statusbot. Change-Id: Ie011dfb049989aff3dfaffb10f8e2782af1073b1 Reviewed-on: https://review.openstack.org/25769 Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2013-03-29 16:06:03 -07:00
statusbot_channels => 'openstack-infra, openstack-dev, openstack',
Add nicks parameter to statusbot. Change-Id: I293f4b5dd76de562cec39b4c995a2c255d383263 Reviewed-on: https://review.openstack.org/25765 Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2013-03-29 15:43:31 -07:00
statusbot_auth_nicks => 'jeblair, ttx, fungi, mordred, clarkb, sdague',
Add statusbot to eavesdrop.o.o. Change-Id: I3ae19a6321827b82ebf864182a1e5a90253b9c39 Reviewed-on: https://review.openstack.org/25755 Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2013-03-29 13:47:38 -07:00
statusbot_wiki_user => hiera('statusbot_wiki_username'),
statusbot_wiki_password => hiera('statusbot_wiki_password'),
statusbot_wiki_url => 'https://wiki.openstack.org/w/api.php',
statusbot_wiki_pageid => '1781',
Move hiera calls into site.pp. Secret info should be parameters to modules. It makes for easier testing. Change-Id: I66034387094b2a24c6fae57fec3af1dae3dd1d3a
2012-07-26 18:58:35 -05:00
}
Puts meetbot under control of puppet Adds meetbot and an nginx setup to puppet. See manifests/site.pp for usage Change-Id: I47dcf2884a06441b482585bf5dae9f7d0bd7e543
2012-04-15 16:06:41 +01:00
}
Add clarkb to etherpad.openstack.org. Add clarkb user and key and apply it to the new etherpad.openstack.org host. Also, send email to clarkb. Change-Id: I37c852ff39872e0fd5fd588145129028a8e80e3b
2012-06-06 20:27:31 +00:00
node 'etherpad.openstack.org' {
Move hiera calls into site.pp. Secret info should be parameters to modules. It makes for easier testing. Change-Id: I66034387094b2a24c6fae57fec3af1dae3dd1d3a
2012-07-26 18:58:35 -05:00
class { 'openstack_project::etherpad':
Align etherpad vhost ssl section with standard. As copied from jenkins. Both old and new names for the cert contents are in hiera. Change-Id: Ic6d8258479c260ac37346c49c1ecde8339c96a37 Reviewed-on: https://review.openstack.org/14432 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: James E. Blair <corvus@inaugust.com> Reviewed-by: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2012-10-13 08:55:30 -07:00
ssl_cert_file_contents => hiera('etherpad_ssl_cert_file_contents'),
ssl_key_file_contents => hiera('etherpad_ssl_key_file_contents'),
ssl_chain_file_contents => hiera('etherpad_ssl_chain_file_contents'),
Update etherpad and etherpad puppet manifests. * manifests/site.pp: Pass new mysql DB variables to openstack::etherpad*. * modules/etherpad_lite/manifests/apache.pp: Fix broken /etc/ssl/certs permissions (0700 -> 0755). * modules/etherpad_lite/manifests/init.pp: Update default nodejs and etherpad versions. Remove ep_headings plugin install. New plugin define should be used for this instead. Stop making the etherpad-lite ref to checkout optional (defaults to develop). Note these changes are probably not going to be backward compat. * modules/etherpad_lite/manifests/plugin.pp: Define to install etherpad lite plugins. * modules/etherpad_lite/manifests/site.pp: Simplify DB support and remove support for the dirty DB type. * modules/etherpad_lite/templates/etherpad-lite_settings.json.erb: Bring settings erb up to par with latest template. * modules/etherpad_lite/templates/etherpadlite.vhost.erb: Update rewrite rules for new etherpad. Instead of allowing nice pad urls rooted at / redirect these url to /p/padname. Etherpad does not deal well with a change in root path as /p/ is hardcoded in many places. * modules/openstack_project/manifests/etherpad.pp * modules/openstack_project/manifests/etherpad_dev.pp: Update to use new etherpad module setup. MySQL DBs are now externally managed, pass in needed connection info. * modules/mysql_backup/manifests/backup_remote.pp: New define to backup remote DB servers. * modules/mysql_backup/templates/my.cnf.erb: Template for a my.cnf to be used by the cron in backup_remote.pp. Allows for easy connectivity from server using MySQL DB as root. Change-Id: I1250297674b91e81d59cd28c07c52e09967ca548
2013-09-05 18:22:21 -07:00
mysql_host => hiera('etherpad_db_host'),
mysql_user => hiera('etherpad_db_user'),
mysql_password => hiera('etherpad_db_password'),
Align etherpad vhost ssl section with standard. As copied from jenkins. Both old and new names for the cert contents are in hiera. Change-Id: Ic6d8258479c260ac37346c49c1ecde8339c96a37 Reviewed-on: https://review.openstack.org/14432 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: James E. Blair <corvus@inaugust.com> Reviewed-by: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2012-10-13 08:55:30 -07:00
sysadmins => hiera('sysadmins'),
Move hiera calls into site.pp. Secret info should be parameters to modules. It makes for easier testing. Change-Id: I66034387094b2a24c6fae57fec3af1dae3dd1d3a
2012-07-26 18:58:35 -05:00
}
Update eplite module for new version of eplite. Etherpad lite has changed their source tree slightly. This has required a few updates to the etherpad lite puppet module. The custom pad.js needs to go in a different directory and the upstart conf file needs a couple updated paths. In addition to the fixes a couple things have been cleaned up. Now define an etherpadlite.openstack.org node in site.pp and copy SSL certs from /root/secret-files. Change-Id: I312b419aa98212b6db68232c672bc4d75f23777f
2012-05-31 23:16:57 +00:00
}
Add etherpad-dev node and host class. We now host etherpad.openstack.org. To properly test upgrades and things add a proper etherpad-dev host to puppet. Currently the configuration is set to mimic that which is on etherpad.o.o. Once the -dev host is up and running it will be used to test upgrades to more modern etherpad lite and node.js version. Also at some point we will probably want to use the puppetlabs-mysql module to manage the mysql instances for etherpad. This dev host makes that easier. Change-Id: I63500026a1a38d7c4dd5b00cc869586eb2483497 Reviewed-on: https://review.openstack.org/14861 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-10-25 16:09:13 -07:00
node 'etherpad-dev.openstack.org' {
class { 'openstack_project::etherpad_dev':
Update etherpad and etherpad puppet manifests. * manifests/site.pp: Pass new mysql DB variables to openstack::etherpad*. * modules/etherpad_lite/manifests/apache.pp: Fix broken /etc/ssl/certs permissions (0700 -> 0755). * modules/etherpad_lite/manifests/init.pp: Update default nodejs and etherpad versions. Remove ep_headings plugin install. New plugin define should be used for this instead. Stop making the etherpad-lite ref to checkout optional (defaults to develop). Note these changes are probably not going to be backward compat. * modules/etherpad_lite/manifests/plugin.pp: Define to install etherpad lite plugins. * modules/etherpad_lite/manifests/site.pp: Simplify DB support and remove support for the dirty DB type. * modules/etherpad_lite/templates/etherpad-lite_settings.json.erb: Bring settings erb up to par with latest template. * modules/etherpad_lite/templates/etherpadlite.vhost.erb: Update rewrite rules for new etherpad. Instead of allowing nice pad urls rooted at / redirect these url to /p/padname. Etherpad does not deal well with a change in root path as /p/ is hardcoded in many places. * modules/openstack_project/manifests/etherpad.pp * modules/openstack_project/manifests/etherpad_dev.pp: Update to use new etherpad module setup. MySQL DBs are now externally managed, pass in needed connection info. * modules/mysql_backup/manifests/backup_remote.pp: New define to backup remote DB servers. * modules/mysql_backup/templates/my.cnf.erb: Template for a my.cnf to be used by the cron in backup_remote.pp. Allows for easy connectivity from server using MySQL DB as root. Change-Id: I1250297674b91e81d59cd28c07c52e09967ca548
2013-09-05 18:22:21 -07:00
mysql_host => hiera('etherpad-dev_db_host'),
mysql_user => hiera('etherpad-dev_db_user'),
mysql_password => hiera('etherpad-dev_db_password'),
sysadmins => hiera('sysadmins'),
Add etherpad-dev node and host class. We now host etherpad.openstack.org. To properly test upgrades and things add a proper etherpad-dev host to puppet. Currently the configuration is set to mimic that which is on etherpad.o.o. Once the -dev host is up and running it will be used to test upgrades to more modern etherpad lite and node.js version. Also at some point we will probably want to use the puppetlabs-mysql module to manage the mysql instances for etherpad. This dev host makes that easier. Change-Id: I63500026a1a38d7c4dd5b00cc869586eb2483497 Reviewed-on: https://review.openstack.org/14861 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-10-25 16:09:13 -07:00
}
}
adding staging server for activity board Change-Id: Ib2b0de6e2cdc59f5c9dca90117d333f70dbab040
2013-08-20 14:07:38 -07:00
node 'activity-dev.openstack.org' {
class { 'openstack_project::activity_dev':
sysadmins => hiera('sysadmins'),
site_admin_password => hiera('activity_dev_site_admin_password'),
site_mysql_host => hiera('activity_dev_site_mysql_host'),
site_mysql_password => hiera('activity_dev_site_mysql_password'),
}
}
Add wiki.openstack.org. Add Ryan Lane's ssh key, and add him to wiki.o.o. Change-Id: I6b81107b3b1c84c6e730caf77842e80e81d80a76
2012-07-16 15:29:28 -07:00
node 'wiki.openstack.org' {
Initial commit of MediaWiki module Change-Id: I6181e0d4a717d0a11ea2d741034db99435d5e180 Reviewed-on: https://review.openstack.org/10521 Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-07-30 00:23:41 -07:00
class { 'openstack_project::wiki':
Add ssl cert to wiki.o.o. Change-Id: I6c6ad0ddd000e3f140cb08faef7dce2cb9ae7079 Reviewed-on: https://review.openstack.org/18349 Reviewed-by: Ryan Lane Reviewed-by: Monty Taylor <mordred@inaugust.com> Approved: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2012-12-18 14:11:43 -08:00
mysql_root_password => hiera('wiki_db_password'),
sysadmins => hiera('sysadmins'),
ssl_cert_file_contents => hiera('wiki_ssl_cert_file_contents'),
ssl_key_file_contents => hiera('wiki_ssl_key_file_contents'),
ssl_chain_file_contents => hiera('wiki_ssl_chain_file_contents'),
Initial commit of MediaWiki module Change-Id: I6181e0d4a717d0a11ea2d741034db99435d5e180 Reviewed-on: https://review.openstack.org/10521 Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-07-30 00:23:41 -07:00
}
Add wiki.openstack.org. Add Ryan Lane's ssh key, and add him to wiki.o.o. Change-Id: I6b81107b3b1c84c6e730caf77842e80e81d80a76
2012-07-16 15:29:28 -07:00
}
Add support for puppet dashboard. Change-Id: Ia63c0af6724f95417910215a82abaadd53ba0b49
2012-07-27 09:47:03 -05:00
node 'puppet-dashboard.openstack.org' {
class { 'openstack_project::dashboard':
Style guide updates for manifest directory Change-Id: I40d54189eb6d5cd4512080ec5010fe339bac96e0 Signed-off-by: Paul Belanger <paul.belanger@polybeacon.com> Reviewed-on: https://review.openstack.org/13830 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-28 10:05:02 -04:00
password => hiera('dashboard_password'),
mysql_password => hiera('dashboard_mysql_password'),
sysadmins => hiera('sysadmins'),
Add support for puppet dashboard. Change-Id: Ia63c0af6724f95417910215a82abaadd53ba0b49
2012-07-27 09:47:03 -05:00
}
}
Add sixth elasticsearch node. * manifests/site.pp: Put elasticsearch nodes in a list variable that is reused. * modules/logstash/templates/elasticsearch.yml.erb: Update cluster settings to be more appropriate for the larger cluster size, including changing the minimum number of master eligible nodes that must be seen before becoming operational in a cluster. Should help prevent split brained clusters. * modules/openstack_project/manifests/cacti.pp: Add new node to cacti node list. Change-Id: I9a18422aa56a56b9ad030892a312772d9b6b2a79
2013-08-02 13:22:47 -07:00
$elasticsearch_nodes = [
'elasticsearch.openstack.org',
'elasticsearch2.openstack.org',
'elasticsearch3.openstack.org',
'elasticsearch4.openstack.org',
'elasticsearch5.openstack.org',
'elasticsearch6.openstack.org',
]
Add skeleton logstash module. This new logstash module adds classes to install logstash agents and indexers as well as redis and elasticsearch. The configuration for each of these services is rudimentary but it shouldn't be difficult to expand the configs and make them useful. Also, add a logstash.openstack.org node that will have an agent, indexer, web frontend, redis, and elasticsearch installed on it. Change-Id: I25b635f088f99d45cfaa70ed122c6433d3784937 Reviewed-on: https://review.openstack.org/19871 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-01-16 15:01:25 -08:00
node 'logstash.openstack.org' {
class { 'openstack_project::logstash':
Deploy elastic-recheck on logstash.openstack.org. This elastic recheck thing that classifies failures based on logstash queries is awesome. We should run it on the OpenStack developer infrastructure. Deploy it on logstash.o.o to keep related services together. Change-Id: I16ae7a32c2c48474454df17931779d0f60c3ed85
2013-09-19 16:11:28 -07:00
sysadmins => hiera('sysadmins'),
elasticsearch_nodes => $elasticsearch_nodes,
gearman_workers => [
Increase to 16 logstash worker nodes Add '%02d' versions of the system names so that when we replace the current workers with performance nodes, they will have more scalable names. Change-Id: I6c9d8aa6338bdd94649096a13f2d3dbeb1daec08
2013-12-17 16:43:36 -08:00
'logstash-worker01.openstack.org',
'logstash-worker02.openstack.org',
'logstash-worker03.openstack.org',
'logstash-worker04.openstack.org',
'logstash-worker05.openstack.org',
'logstash-worker06.openstack.org',
'logstash-worker07.openstack.org',
'logstash-worker08.openstack.org',
'logstash-worker09.openstack.org',
'logstash-worker10.openstack.org',
'logstash-worker11.openstack.org',
'logstash-worker12.openstack.org',
'logstash-worker13.openstack.org',
'logstash-worker14.openstack.org',
'logstash-worker15.openstack.org',
'logstash-worker16.openstack.org',
Use gearman to distribute logstash log pushing. This change reorgs the logstash log pushing so that there is a central gearman server that listens to Jenkins ZMQ events which are then converted to per log file gearman jobs which are processed by gearman workers. The central gearman server will live on logstash.o.o and the existing logstash-worker hosts will be converted to gearman log pusher workers. This commit includes relavent documentation changes. Change-Id: I45f7185c2479c54b090d223408dff268e1e8d7db Reviewed-on: https://review.openstack.org/32455 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-06-10 12:06:58 -07:00
],
Deploy elastic-recheck on logstash.openstack.org. This elastic recheck thing that classifies failures based on logstash queries is awesome. We should run it on the OpenStack developer infrastructure. Deploy it on logstash.o.o to keep related services together. Change-Id: I16ae7a32c2c48474454df17931779d0f60c3ed85
2013-09-19 16:11:28 -07:00
discover_nodes => [
Fix logstash.o.o elasticsearch discover node list. Logstash.o.o needs to be given the host and port for its elasticsearch discover node list. Fix the change that used just a list of hosts. Change-Id: If421007f633eb54a5dc65d5ede57d1e0a6f1c5d9
2013-08-06 10:46:00 -07:00
'elasticsearch.openstack.org:9200',
'elasticsearch2.openstack.org:9200',
'elasticsearch3.openstack.org:9200',
'elasticsearch4.openstack.org:9200',
'elasticsearch5.openstack.org:9200',
'elasticsearch6.openstack.org:9200',
],
Scale out logstash indexing to multiple hosts. Logstash performs filtering in a single thread so it does not scale up very well. Work around this by scaling Logstash out to multiple indexer hosts. Current plan is to have a small (2GB) kibana web front end host that does nothing but talk to elasticsearch, three 4GB logstash indexers that will run a single log-pusher.py + logstash indexer with some partition of the logfiles assigned to each indexer, and finally the existing large elasticsearch node. Eventually properly load balancing log processing across the worker nodes would be great, but the current partition method should work well enough with little additional effort. Change-Id: Ifc6396560934314ffd6a7c47eb2acff9e9c2a7af Reviewed-on: https://review.openstack.org/30573 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Tested-by: Jenkins
2013-05-26 16:08:46 -07:00
}
}
node /^logstash-worker\d+\.openstack\.org$/ {
class { 'openstack_project::logstash_worker':
Add support for elasticsearch cluster. We need to expand our elasticsearch install base. Update puppet to make this possible. Change-Id: Id0dae839b12ebf47715cf40a363832e0f661a94f Reviewed-on: https://review.openstack.org/33910 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-06-20 18:37:41 -07:00
sysadmins => hiera('sysadmins'),
Add sixth elasticsearch node. * manifests/site.pp: Put elasticsearch nodes in a list variable that is reused. * modules/logstash/templates/elasticsearch.yml.erb: Update cluster settings to be more appropriate for the larger cluster size, including changing the minimum number of master eligible nodes that must be seen before becoming operational in a cluster. Should help prevent split brained clusters. * modules/openstack_project/manifests/cacti.pp: Add new node to cacti node list. Change-Id: I9a18422aa56a56b9ad030892a312772d9b6b2a79
2013-08-02 13:22:47 -07:00
elasticsearch_nodes => $elasticsearch_nodes,
Add support for elasticsearch cluster. We need to expand our elasticsearch install base. Update puppet to make this possible. Change-Id: Id0dae839b12ebf47715cf40a363832e0f661a94f Reviewed-on: https://review.openstack.org/33910 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-06-20 18:37:41 -07:00
discover_node => 'elasticsearch.openstack.org',
Add skeleton logstash module. This new logstash module adds classes to install logstash agents and indexers as well as redis and elasticsearch. The configuration for each of these services is rudimentary but it shouldn't be difficult to expand the configs and make them useful. Also, add a logstash.openstack.org node that will have an agent, indexer, web frontend, redis, and elasticsearch installed on it. Change-Id: I25b635f088f99d45cfaa70ed122c6433d3784937 Reviewed-on: https://review.openstack.org/19871 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-01-16 15:01:25 -08:00
}
}
Add support for elasticsearch cluster. We need to expand our elasticsearch install base. Update puppet to make this possible. Change-Id: Id0dae839b12ebf47715cf40a363832e0f661a94f Reviewed-on: https://review.openstack.org/33910 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-06-20 18:37:41 -07:00
node /^elasticsearch\d*\.openstack\.org$/ {
Rename openstack_project::elasticsearch To avoid namespace issues, rename openstack_project::elasticsearch to openstack_project::elasticsearch_node. Change-Id: Icd215cd0c13f06d279a477d0885d33665ce125ae
2013-10-18 14:48:22 -07:00
class { 'openstack_project::elasticsearch_node':
Add support for elasticsearch cluster. We need to expand our elasticsearch install base. Update puppet to make this possible. Change-Id: Id0dae839b12ebf47715cf40a363832e0f661a94f Reviewed-on: https://review.openstack.org/33910 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-06-20 18:37:41 -07:00
sysadmins => hiera('sysadmins'),
Add sixth elasticsearch node. * manifests/site.pp: Put elasticsearch nodes in a list variable that is reused. * modules/logstash/templates/elasticsearch.yml.erb: Update cluster settings to be more appropriate for the larger cluster size, including changing the minimum number of master eligible nodes that must be seen before becoming operational in a cluster. Should help prevent split brained clusters. * modules/openstack_project/manifests/cacti.pp: Add new node to cacti node list. Change-Id: I9a18422aa56a56b9ad030892a312772d9b6b2a79
2013-08-02 13:22:47 -07:00
elasticsearch_nodes => $elasticsearch_nodes,
Add support for elasticsearch cluster. We need to expand our elasticsearch install base. Update puppet to make this possible. Change-Id: Id0dae839b12ebf47715cf40a363832e0f661a94f Reviewed-on: https://review.openstack.org/33910 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-06-20 18:37:41 -07:00
elasticsearch_clients => [
Scale out logstash indexing to multiple hosts. Logstash performs filtering in a single thread so it does not scale up very well. Work around this by scaling Logstash out to multiple indexer hosts. Current plan is to have a small (2GB) kibana web front end host that does nothing but talk to elasticsearch, three 4GB logstash indexers that will run a single log-pusher.py + logstash indexer with some partition of the logfiles assigned to each indexer, and finally the existing large elasticsearch node. Eventually properly load balancing log processing across the worker nodes would be great, but the current partition method should work well enough with little additional effort. Change-Id: Ifc6396560934314ffd6a7c47eb2acff9e9c2a7af Reviewed-on: https://review.openstack.org/30573 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Tested-by: Jenkins
2013-05-26 16:08:46 -07:00
'logstash.openstack.org',
Increase to 16 logstash worker nodes Add '%02d' versions of the system names so that when we replace the current workers with performance nodes, they will have more scalable names. Change-Id: I6c9d8aa6338bdd94649096a13f2d3dbeb1daec08
2013-12-17 16:43:36 -08:00
'logstash-worker01.openstack.org',
'logstash-worker02.openstack.org',
'logstash-worker03.openstack.org',
'logstash-worker04.openstack.org',
'logstash-worker05.openstack.org',
'logstash-worker06.openstack.org',
'logstash-worker07.openstack.org',
'logstash-worker08.openstack.org',
'logstash-worker09.openstack.org',
'logstash-worker10.openstack.org',
'logstash-worker11.openstack.org',
'logstash-worker12.openstack.org',
'logstash-worker13.openstack.org',
'logstash-worker14.openstack.org',
'logstash-worker15.openstack.org',
'logstash-worker16.openstack.org',
Scale out logstash indexing to multiple hosts. Logstash performs filtering in a single thread so it does not scale up very well. Work around this by scaling Logstash out to multiple indexer hosts. Current plan is to have a small (2GB) kibana web front end host that does nothing but talk to elasticsearch, three 4GB logstash indexers that will run a single log-pusher.py + logstash indexer with some partition of the logfiles assigned to each indexer, and finally the existing large elasticsearch node. Eventually properly load balancing log processing across the worker nodes would be great, but the current partition method should work well enough with little additional effort. Change-Id: Ifc6396560934314ffd6a7c47eb2acff9e9c2a7af Reviewed-on: https://review.openstack.org/30573 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Tested-by: Jenkins
2013-05-26 16:08:46 -07:00
],
Add sixth elasticsearch node. * manifests/site.pp: Put elasticsearch nodes in a list variable that is reused. * modules/logstash/templates/elasticsearch.yml.erb: Update cluster settings to be more appropriate for the larger cluster size, including changing the minimum number of master eligible nodes that must be seen before becoming operational in a cluster. Should help prevent split brained clusters. * modules/openstack_project/manifests/cacti.pp: Add new node to cacti node list. Change-Id: I9a18422aa56a56b9ad030892a312772d9b6b2a79
2013-08-02 13:22:47 -07:00
discover_nodes => $elasticsearch_nodes,
Switch to dedicated elasticsearch node. Switch to a large dedicated elasticsearch node as sharing resources between logstash, kibana, jenkins-log-pusher, and elasticsearch results in a constrained environment. Change-Id: I39e6210f2c577429be2cb38aca09111a0f56f9be Reviewed-on: https://review.openstack.org/30344 Approved: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Tested-by: Jenkins
2013-05-23 14:08:58 -07:00
}
}
Split git.o.o haproxy out of cgit module. * manifests/site.pp: Use distinct manifests for git.o.o and git.o.o backends. This allows for the haproxy server to not serve git content and purely be a load balancer. * modules/cgit/manifests/init.pp: Remove haproxy from cgit module. Remove stale xinetd cleanup. Select git daemon port when selecting HTTP(S) ports. * modules/openstack_project/manifests/git.pp: Make git.pp a manifest to load balance git servers with haproxy. * modules/openstack_project/manifests/git_backend.pp: New manifest to manage servers that actually serve git content. They sit behind a load balancer. * modules/openstack_project/manifests/review.pp: Stop replicating repos to git load balancer. Change-Id: I343a0d1e0a7b93874c2e2299ed974a3304957efb
2013-08-26 10:38:35 -07:00
# A CentOS machine to load balance git access.
Add cgit web service and git server Define git.openstack.org server and deploy cgit web service with Apache on CentOS. Change-Id: Id3c7c870e25e4202915bc081454896895084f9af
2013-07-11 11:21:02 -07:00
node 'git.openstack.org' {
class { 'openstack_project::git':
Add httpd ssl support to git.openstack.org Certificates have been added to hiera, now adding the support for https in a new apache file. Change-Id: I8447d60a15779b103556e53f04accf671dbf4843
2013-08-05 10:24:16 -07:00
sysadmins => hiera('sysadmins'),
Load balance git requests. * install_modules.sh: Add puppetlabs-haproxy forge module. * modules/cgit/manifests/init.pp: Add haproxy config to load balance https, https and git protocol git access. Each git server will host git http on port 8080, https on port 4443 and git protocol on 29418. These endpoints will then be load balanced by a single haproxy instance listening on ports 80, 443 and 9418. The use of haproxy and having services listen on offset ports to accomodate haproxy is toggleable using the $balance_git and $behind_proxy boolean flags. Additionally, configure rsyslog for haproxy. * modules/cgit/files/rsyslog.haproxy.conf: Enable syslog over UDP on port 514. This is needed by haproxy to perform logging. Send local0 messages to /var/log/haproxy.log. * modules/cgit/templates/ssl.conf.erb: Make Apache https listen port configurable. Remove default virtualhost. * modules/cgit/templates/httpd.conf.erb: Make Apache http listen port configurable. * modules/cgit/templates/git.vhost..erb: Make Apache http(s) listen ports configuruable. Allow http without redirecting to https as a fallback option to accomodate CentOS clients. * modules/openstack_project/manifests/git.pp: Pass load balancer variables through to the cgit manifest. * manifests/site.pp: Configure git.o.o to run the load balancer haproxy and balance across the new gitXX.o.o nodes. Change-Id: Icefc5923cff9a7c6ce62c1923ec2ea87ebc6474a
2013-08-19 17:10:13 -07:00
balancer_member_names => [
'git01.openstack.org',
'git02.openstack.org',
'git03.openstack.org',
'git04.openstack.org',
],
balancer_member_ips => [
'192.237.218.169',
'192.237.217.253',
'192.237.218.239',
'192.237.218.34',
],
}
}
# CentOS machines to run cgit and git daemon. Will be
# load balanced by git.openstack.org.
node /^git\d+\.openstack\.org$/ {
Fix passing zuul public key to git backends Change-Id: I774d36ce82266e1431ff89acdc6450dbb1626004
2014-01-08 16:50:59 +08:00
include openstack_project
Split git.o.o haproxy out of cgit module. * manifests/site.pp: Use distinct manifests for git.o.o and git.o.o backends. This allows for the haproxy server to not serve git content and purely be a load balancer. * modules/cgit/manifests/init.pp: Remove haproxy from cgit module. Remove stale xinetd cleanup. Select git daemon port when selecting HTTP(S) ports. * modules/openstack_project/manifests/git.pp: Make git.pp a manifest to load balance git servers with haproxy. * modules/openstack_project/manifests/git_backend.pp: New manifest to manage servers that actually serve git content. They sit behind a load balancer. * modules/openstack_project/manifests/review.pp: Stop replicating repos to git load balancer. Change-Id: I343a0d1e0a7b93874c2e2299ed974a3304957efb
2013-08-26 10:38:35 -07:00
class { 'openstack_project::git_backend':
Load balance git requests. * install_modules.sh: Add puppetlabs-haproxy forge module. * modules/cgit/manifests/init.pp: Add haproxy config to load balance https, https and git protocol git access. Each git server will host git http on port 8080, https on port 4443 and git protocol on 29418. These endpoints will then be load balanced by a single haproxy instance listening on ports 80, 443 and 9418. The use of haproxy and having services listen on offset ports to accomodate haproxy is toggleable using the $balance_git and $behind_proxy boolean flags. Additionally, configure rsyslog for haproxy. * modules/cgit/files/rsyslog.haproxy.conf: Enable syslog over UDP on port 514. This is needed by haproxy to perform logging. Send local0 messages to /var/log/haproxy.log. * modules/cgit/templates/ssl.conf.erb: Make Apache https listen port configurable. Remove default virtualhost. * modules/cgit/templates/httpd.conf.erb: Make Apache http listen port configurable. * modules/cgit/templates/git.vhost..erb: Make Apache http(s) listen ports configuruable. Allow http without redirecting to https as a fallback option to accomodate CentOS clients. * modules/openstack_project/manifests/git.pp: Pass load balancer variables through to the cgit manifest. * manifests/site.pp: Configure git.o.o to run the load balancer haproxy and balance across the new gitXX.o.o nodes. Change-Id: Icefc5923cff9a7c6ce62c1923ec2ea87ebc6474a
2013-08-19 17:10:13 -07:00
vhost_name => 'git.openstack.org',
sysadmins => hiera('sysadmins'),
git_gerrit_ssh_key => hiera('gerrit_replication_ssh_rsa_pubkey_contents'),
Allow zuul to push to git servers * manifests/site.pp * modules/openstack_project/manifests/git_backend.pp: Add the zuul server's public SSH key to a dedicated zuul account on the git server farm. This will allow zuul to push arbitrary references into its scratch repositories. Also set ownership on its scratch repository hierarchy and pack them, properly skipping it in the existing cgit repo repack since ownership differs. Change-Id: I4b5b583847c828aadc903270433882531e5b1ea7
2014-01-08 01:41:38 +00:00
git_zuul_ssh_key => $openstack_project::jenkins_ssh_key,
Load balance git requests. * install_modules.sh: Add puppetlabs-haproxy forge module. * modules/cgit/manifests/init.pp: Add haproxy config to load balance https, https and git protocol git access. Each git server will host git http on port 8080, https on port 4443 and git protocol on 29418. These endpoints will then be load balanced by a single haproxy instance listening on ports 80, 443 and 9418. The use of haproxy and having services listen on offset ports to accomodate haproxy is toggleable using the $balance_git and $behind_proxy boolean flags. Additionally, configure rsyslog for haproxy. * modules/cgit/files/rsyslog.haproxy.conf: Enable syslog over UDP on port 514. This is needed by haproxy to perform logging. Send local0 messages to /var/log/haproxy.log. * modules/cgit/templates/ssl.conf.erb: Make Apache https listen port configurable. Remove default virtualhost. * modules/cgit/templates/httpd.conf.erb: Make Apache http listen port configurable. * modules/cgit/templates/git.vhost..erb: Make Apache http(s) listen ports configuruable. Allow http without redirecting to https as a fallback option to accomodate CentOS clients. * modules/openstack_project/manifests/git.pp: Pass load balancer variables through to the cgit manifest. * manifests/site.pp: Configure git.o.o to run the load balancer haproxy and balance across the new gitXX.o.o nodes. Change-Id: Icefc5923cff9a7c6ce62c1923ec2ea87ebc6474a
2013-08-19 17:10:13 -07:00
ssl_cert_file_contents => hiera('git_ssl_cert_file_contents'),
ssl_key_file_contents => hiera('git_ssl_key_file_contents'),
ssl_chain_file_contents => hiera('git_ssl_chain_file_contents'),
behind_proxy => true,
Add cgit web service and git server Define git.openstack.org server and deploy cgit web service with Apache on CentOS. Change-Id: Id3c7c870e25e4202915bc081454896895084f9af
2013-07-11 11:21:02 -07:00
}
}
Add summit.openstack.org to OpenStack infra Add summit.openstack.org to OpenStack infrastructure. The current host used is an old forgotten 11.04 cloudserver from pre-Foundation days. We'll need to move summit.openstack.org A/CNAME to this new instance. This host will be fully automated with its own Puppet module sometimes during Havana, but for the urgent Portland summit setup it will be set up manually. Change-Id: I80a46e5969c27e540278a51d176a536e7777f005 Reviewed-on: https://review.openstack.org/21302 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2013-02-06 15:10:13 +01:00
# A machine to run ODSREG in preparation for summits.
node 'summit.openstack.org' {
Open port 80 on summit.o.o and add ttx. * manifests/site.pp: Change the summit node to be an instance of the new summit class rather than the more generic server class. * modules/openstack_project/manifests/summit.pp: Add a new summit class based on server, but open 80/tcp and realize an account for ttx. Also explicitly list 22/tcp even though it's already included by the server class. * modules/openstack_project/manifests/users.pp: Add an entry for ttx with his name and SSH public key. Change-Id: Idc4f0f30a89da12eeb8ee770e0ba0f0a2978bf5f Reviewed-on: https://review.openstack.org/21430 Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Tested-by: Jenkins
2013-02-07 13:56:07 +00:00
class { 'openstack_project::summit':
Add summit.openstack.org to OpenStack infra Add summit.openstack.org to OpenStack infrastructure. The current host used is an old forgotten 11.04 cloudserver from pre-Foundation days. We'll need to move summit.openstack.org A/CNAME to this new instance. This host will be fully automated with its own Puppet module sometimes during Havana, but for the urgent Portland summit setup it will be set up manually. Change-Id: I80a46e5969c27e540278a51d176a536e7777f005 Reviewed-on: https://review.openstack.org/21302 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2013-02-06 15:10:13 +01:00
sysadmins => hiera('sysadmins'),
}
}
Add Storyboard puppet module There are two major parts being installed with this module: 1. storyboard-api - REST API service served with apache mod_wsgi module 2. storyboard-webclient - static html/css/js files. This project is built and published to tarballs.o.o, from where it'll be installed with this puppet module This module requires three configs from Hiera: * storyboard_db_host * storyboard_db_password * storyboard_db_user Installed projects: * http://git.openstack.org/cgit/openstack-infra/storyboard/ * http://git.openstack.org/cgit/openstack-infra/storyboard-webclient/ Things to be added in later commits: * Documentation for ci.openstack.org * Configure logging (once supported by storyboard) * SSL Change-Id: If3da06f8d20a6282036f1f9f063c25a6d0db60c6
2014-01-06 06:33:45 +04:00
# A machine to run Storyboard
node 'storyboard.openstack.org' {
class { 'openstack_project::storyboard':
sysadmins => hiera('sysadmins'),
mysql_host => hiera('storyboard_db_host'),
mysql_user => hiera('storyboard_db_user'),
mysql_password => hiera('storyboard_db_password'),
}
}
Add node definition for static.openstack.org. Add node definition for static.openstack.org and create first simple implementation of what the static.openstack.org host would look like. Change-Id: I04952154246c4985e7ff44909e892918a1336fba Reviewed-on: https://review.openstack.org/11193 Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-08-10 15:38:08 -07:00
# A machine to serve static content.
node 'static.openstack.org' {
Pass sysadmins list into node defs. Pass the sysadmins list into each node definition. This allows us to retrieve the data from hiera rather than hard coding it in the puppet manifests. Also, update test script to use bogus sysadmin data when testing. Change-Id: Ide3560f16bce4d66fb95cc5021fc879476e6a712 Reviewed-on: https://review.openstack.org/12512 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-06 10:32:48 -07:00
class { 'openstack_project::static':
Remove status.o.o vhost from static.o.o Change-Id: I8e7ee035b10895043622041bf8bdfef84162ffd5
2013-12-19 14:57:02 -08:00
sysadmins => hiera('sysadmins'),
Add status.openstack.org vm Let's branch status.o.o off from static.o.o into its own machine. For now, keep the extra /static/ in paths to ease the transition (so we can use the same files and templates). We can remove them later if desired. Change-Id: If38197db79b9f6adfcdcf40f10d4797c7df1c620
2013-12-11 12:01:13 -08:00
}
}
Remove status.o.o vhost from static.o.o Change-Id: I8e7ee035b10895043622041bf8bdfef84162ffd5
2013-12-19 14:57:02 -08:00
# A machine to serve various project status updates.
Add status.openstack.org vm Let's branch status.o.o off from static.o.o into its own machine. For now, keep the extra /static/ in paths to ease the transition (so we can use the same files and templates). We can remove them later if desired. Change-Id: If38197db79b9f6adfcdcf40f10d4797c7df1c620
2013-12-11 12:01:13 -08:00
node 'status.openstack.org' {
class { 'openstack_project::status':
Move elastic-recheck bot to status.o.o Also, normalize some parameters to the status manifest to make it more readable (since they follow the same pattern). And make the ssh config for elastic-recheck bot match reviewday. Change-Id: I2417f121e7b3685aab9540504cdd4c6db1754e67
2013-12-31 11:11:55 -08:00
sysadmins => hiera('sysadmins'),
gerrit_host => 'review.openstack.org',
gerrit_ssh_host_key => hiera('gerrit_ssh_rsa_pubkey_contents'),
reviewday_ssh_public_key => hiera('reviewday_rsa_pubkey_contents'),
reviewday_ssh_private_key => hiera('reviewday_rsa_key_contents'),
releasestatus_ssh_public_key => hiera('releasestatus_rsa_pubkey_contents'),
releasestatus_ssh_private_key => hiera('releasestatus_rsa_key_contents'),
recheck_ssh_public_key => hiera('elastic-recheck_gerrit_ssh_public_key'),
recheck_ssh_private_key => hiera('elastic-recheck_gerrit_ssh_private_key'),
recheck_bot_nick => 'openstackrecheck',
recheck_bot_passwd => hiera('elastic-recheck_ircbot_password'),
Pass sysadmins list into node defs. Pass the sysadmins list into each node definition. This allows us to retrieve the data from hiera rather than hard coding it in the puppet manifests. Also, update test script to use bogus sysadmin data when testing. Change-Id: Ide3560f16bce4d66fb95cc5021fc879476e6a712 Reviewed-on: https://review.openstack.org/12512 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-06 10:32:48 -07:00
}
Add node definition for static.openstack.org. Add node definition for static.openstack.org and create first simple implementation of what the static.openstack.org host would look like. Change-Id: I04952154246c4985e7ff44909e892918a1336fba Reviewed-on: https://review.openstack.org/11193 Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-08-10 15:38:08 -07:00
}
Add nodepool host Change-Id: Ib216bd400aa269ccdb17848b3870ab65400cf3d2
2013-08-15 17:52:52 +00:00
node 'nodepool.openstack.org' {
class { 'openstack_project::nodepool':
mysql_password => hiera('nodepool_mysql_password'),
mysql_root_password => hiera('nodepool_mysql_root_password'),
nodepool_ssh_private_key => hiera('jenkins_ssh_private_key_contents'),
sysadmins => hiera('sysadmins'),
statsd_host => 'graphite.openstack.org',
jenkins_api_user => hiera('jenkins_api_user'),
jenkins_api_key => hiera('jenkins_api_key'),
Fix nodepool setup scripts The devstack cache steps were being run as the ubuntu user; make sure they are run as jenkins. Also update the nodepool configuration file to current values and include the jenkins credential id. Change-Id: Icbe8bee3b1800e28034cd36d4d328a6793d55b0e
2013-08-20 19:58:38 -07:00
jenkins_credentials_id => hiera('jenkins_credentials_id'),
Add nodepool host Change-Id: Ib216bd400aa269ccdb17848b3870ab65400cf3d2
2013-08-15 17:52:52 +00:00
rackspace_username => hiera('nodepool_rackspace_username'),
rackspace_password => hiera('nodepool_rackspace_password'),
rackspace_project => hiera('nodepool_rackspace_project'),
hpcloud_username => hiera('nodepool_hpcloud_username'),
hpcloud_password => hiera('nodepool_hpcloud_password'),
hpcloud_project => hiera('nodepool_hpcloud_project'),
Add initial files for tripleo in the gate. Add jenkins job builder tripleo script (based on pbr). Add prepare_node_tripleo.sh which will be called by nodepool. Add prepare_tripleo.sh script, based on the devstack script but pulling in just the tripleo repositories with pull-tools tripleo-incubator script. Add tripleo stanza to nodepool itself. Update site.pp with variables for tripleo authentication. Add experimental pipeline to zuul's layout.yaml for this job on tripleo-incubator. Change-Id: I03433d08585ba3a783fe939264d7521cafa83e41
2013-10-02 15:57:08 -07:00
tripleo_username => hiera('nodepool_tripleo_username'),
tripleo_password => hiera('nodepool_tripleo_password'),
tripleo_project => hiera('nodepool_tripleo_project'),
Add nodepool host Change-Id: Ib216bd400aa269ccdb17848b3870ab65400cf3d2
2013-08-15 17:52:52 +00:00
}
}
Add a dedicated zuul server. Just bootstrapping the server; a follow-on change will switch hostnames in configurations. Change-Id: Ie453a3d046014137c66f2bc25e0a5916d09b9267 Reviewed-on: https://review.openstack.org/17167 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2012-11-29 13:43:20 -08:00
node 'zuul.openstack.org' {
Rename zuul manifest to zuul_prod. Because puppet scoping is ridiculous. Change-Id: I5a62a272353a88fe996e946ef3611a8320ba9c30 Reviewed-on: https://review.openstack.org/29011 Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2013-05-13 14:59:15 -07:00
class { 'openstack_project::zuul_prod':
Move Zuul to its own server. Remove zuul from jenkins server. Remove transitional zuul config. Add an extra argument to gerrit-git-prep for the git site name, so that it doesn't have to be the same as the review site. Serve zuul git repos via apache. Change-Id: I342032bcedf317c0f48ff89b773546eb2ccd08f8 Reviewed-on: https://review.openstack.org/17949 Tested-by: Jenkins Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: James E. Blair <corvus@inaugust.com> Reviewed-by: James E. Blair <corvus@inaugust.com> Tested-by: James E. Blair <corvus@inaugust.com>
2012-12-02 16:32:10 +00:00
gerrit_server => 'review.openstack.org',
gerrit_user => 'jenkins',
zuul_ssh_private_key => hiera('jenkins_ssh_private_key_contents'),
Switch Zuul/JJB to use LOG_PATH This calculates the full LOG_PATH in the Zuul config and pases it to Jenkins. The new path is similar to the old but with the substitution of a short ZUUL_UUID at the end instead of the Jenkins build number in order to avoid collisions from multiple Jenkins masters. Periodic jobs add a node name to their log path to avoid collisions from multiple masters. Unfortunately, that value is not accessible to the logstash worker. This can be solved by having Zuul trigger periodic jobs. Add the ZUUL_REF to logstash as "build_ref". Requires https://review.openstack.org/#/c/39130/ Change-Id: I40bad59e3ad8ed6b4706762ed8b833fd15c13b0d
2013-07-29 10:46:53 -07:00
url_pattern => 'http://logs.openstack.org/{build.parameters[LOG_PATH]}',
Zuul puppet support to zuul_url option This adds the zuul_url support in puppet. Change-Id: Ie37744f11452efc4029c1fe93d880dd3a4ecb831
2013-11-27 09:58:47 -02:00
zuul_url => 'http://zuul.openstack.org/p',
Move Zuul to its own server. Remove zuul from jenkins server. Remove transitional zuul config. Add an extra argument to gerrit-git-prep for the git site name, so that it doesn't have to be the same as the review site. Serve zuul git repos via apache. Change-Id: I342032bcedf317c0f48ff89b773546eb2ccd08f8 Reviewed-on: https://review.openstack.org/17949 Tested-by: Jenkins Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: James E. Blair <corvus@inaugust.com> Reviewed-by: James E. Blair <corvus@inaugust.com> Tested-by: James E. Blair <corvus@inaugust.com>
2012-12-02 16:32:10 +00:00
sysadmins => hiera('sysadmins'),
Add statsd configuration to zuul. And allow zuul to send to statsd. Change-Id: Ie9f78268a673523c4ea4025bdbbe40d8d3819398 Reviewed-on: https://review.openstack.org/18658 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2012-12-26 10:48:15 -08:00
statsd_host => 'graphite.openstack.org',
Connectivity from workers to gearmand on zuul. * manifests/site.pp: Pass both jenkins.openstack.org and jenkins-dev.openstack.org to openstack_project::zuul as the list of gearman workers for use in iptables rules. * modules/openstack_project/manifests/jenkins.pp * modules/openstack_project/manifests/jenkins_dev.pp: Remove unused 4155/tcp from public allowed ports list, previously for a bzr service which is no longer running on these servers. * modules/openstack_project/manifests/zuul.pp: Add iptables rules allowing access from gearman workers to the gearmand, and also configure gearmand to listen on all addresses including IPv6, as opposed to its IPv4-only default. * install_modules.sh: Add puppetlabs-stdlib version 3.2.0 to the list of puppet dependencies. This is required to pull in the "flatten" function used in zuul.pp above. Change-Id: I05d4abc92b3050884a7e9f3c2b6cd9dcc81bfa36 Reviewed-on: https://review.openstack.org/26245 Reviewed-by: James E. Blair <corvus@inaugust.com> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: Jeremy Stanley <fungi@yuggoth.org> Tested-by: Jenkins
2013-03-28 02:42:05 +00:00
gearman_workers => [
Start using gearman-based bursting with nodepool Also, reduce number of ready nodes slightly to better observe how nodepool reacts. Allow nodepool to talk to zuul's gearman server. Change-Id: I764482062525b6ca5454b53cbd56861b24fd3764
2013-10-05 08:26:20 -07:00
'nodepool.openstack.org',
Connectivity from workers to gearmand on zuul. * manifests/site.pp: Pass both jenkins.openstack.org and jenkins-dev.openstack.org to openstack_project::zuul as the list of gearman workers for use in iptables rules. * modules/openstack_project/manifests/jenkins.pp * modules/openstack_project/manifests/jenkins_dev.pp: Remove unused 4155/tcp from public allowed ports list, previously for a bzr service which is no longer running on these servers. * modules/openstack_project/manifests/zuul.pp: Add iptables rules allowing access from gearman workers to the gearmand, and also configure gearmand to listen on all addresses including IPv6, as opposed to its IPv4-only default. * install_modules.sh: Add puppetlabs-stdlib version 3.2.0 to the list of puppet dependencies. This is required to pull in the "flatten" function used in zuul.pp above. Change-Id: I05d4abc92b3050884a7e9f3c2b6cd9dcc81bfa36 Reviewed-on: https://review.openstack.org/26245 Reviewed-by: James E. Blair <corvus@inaugust.com> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: Jeremy Stanley <fungi@yuggoth.org> Tested-by: Jenkins
2013-03-28 02:42:05 +00:00
'jenkins.openstack.org',
Add new jenkins masters to zuul firewall Change-Id: Id8dc54deea14150b972602249330e1081e594bc5
2013-08-05 13:39:53 -07:00
'jenkins01.openstack.org',
'jenkins02.openstack.org',
Add jenkins03 and 04 to most places Add them to all the places it's safe to do so for now. Don't actually spin up any nodes for them yet. Change-Id: I59e97be7e5b094af3153bc7d5dce0cff57996f55
2014-01-07 09:58:17 +08:00
'jenkins03.openstack.org',
'jenkins04.openstack.org',
Add three new jenkins servers Change-Id: I1143c1c7446890c47be12d8b115560bddadc1919
2014-01-22 09:12:39 -08:00
'jenkins05.openstack.org',
'jenkins06.openstack.org',
'jenkins07.openstack.org',
Connectivity from workers to gearmand on zuul. * manifests/site.pp: Pass both jenkins.openstack.org and jenkins-dev.openstack.org to openstack_project::zuul as the list of gearman workers for use in iptables rules. * modules/openstack_project/manifests/jenkins.pp * modules/openstack_project/manifests/jenkins_dev.pp: Remove unused 4155/tcp from public allowed ports list, previously for a bzr service which is no longer running on these servers. * modules/openstack_project/manifests/zuul.pp: Add iptables rules allowing access from gearman workers to the gearmand, and also configure gearmand to listen on all addresses including IPv6, as opposed to its IPv4-only default. * install_modules.sh: Add puppetlabs-stdlib version 3.2.0 to the list of puppet dependencies. This is required to pull in the "flatten" function used in zuul.pp above. Change-Id: I05d4abc92b3050884a7e9f3c2b6cd9dcc81bfa36 Reviewed-on: https://review.openstack.org/26245 Reviewed-by: James E. Blair <corvus@inaugust.com> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: Jeremy Stanley <fungi@yuggoth.org> Tested-by: Jenkins
2013-03-28 02:42:05 +00:00
'jenkins-dev.openstack.org',
Add zuul-dev.openstack.org. And connect it to the firehose. Change-Id: Id860ff329e33a588d669608e5402bdb3765001dd Reviewed-on: https://review.openstack.org/28742 Reviewed-by: Khai Do <zaro0508@gmail.com> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Approved: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2013-05-09 16:06:21 -07:00
],
Fix typo in puppet Change-Id: I39c29152e985aceefd1cc9032ca51081668d787d
2014-01-08 16:12:39 +08:00
}
Add zuul-dev.openstack.org. And connect it to the firehose. Change-Id: Id860ff329e33a588d669608e5402bdb3765001dd Reviewed-on: https://review.openstack.org/28742 Reviewed-by: Khai Do <zaro0508@gmail.com> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Approved: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2013-05-09 16:06:21 -07:00
}
node 'zuul-dev.openstack.org' {
class { 'openstack_project::zuul_dev':
point zuul-dev to review-dev Partial-Bug: #1082781 Change-Id: I9fab6a763c45cfa0b7c2970f98876d178df16690
2014-01-21 13:47:24 -08:00
gerrit_server => 'review-dev.openstack.org',
Add zuul-dev.openstack.org. And connect it to the firehose. Change-Id: Id860ff329e33a588d669608e5402bdb3765001dd Reviewed-on: https://review.openstack.org/28742 Reviewed-by: Khai Do <zaro0508@gmail.com> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Approved: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2013-05-09 16:06:21 -07:00
gerrit_user => 'zuul-dev',
zuul_ssh_private_key => hiera('zuul_dev_ssh_private_key_contents'),
Switch Zuul/JJB to use LOG_PATH This calculates the full LOG_PATH in the Zuul config and pases it to Jenkins. The new path is similar to the old but with the substitution of a short ZUUL_UUID at the end instead of the Jenkins build number in order to avoid collisions from multiple Jenkins masters. Periodic jobs add a node name to their log path to avoid collisions from multiple masters. Unfortunately, that value is not accessible to the logstash worker. This can be solved by having Zuul trigger periodic jobs. Add the ZUUL_REF to logstash as "build_ref". Requires https://review.openstack.org/#/c/39130/ Change-Id: I40bad59e3ad8ed6b4706762ed8b833fd15c13b0d
2013-07-29 10:46:53 -07:00
url_pattern => 'http://logs.openstack.org/{build.parameters[LOG_PATH]}',
Zuul puppet support to zuul_url option This adds the zuul_url support in puppet. Change-Id: Ie37744f11452efc4029c1fe93d880dd3a4ecb831
2013-11-27 09:58:47 -02:00
zuul_url => 'http://zuul-dev.openstack.org/p',
Add zuul-dev.openstack.org. And connect it to the firehose. Change-Id: Id860ff329e33a588d669608e5402bdb3765001dd Reviewed-on: https://review.openstack.org/28742 Reviewed-by: Khai Do <zaro0508@gmail.com> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Approved: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2013-05-09 16:06:21 -07:00
sysadmins => hiera('sysadmins'),
statsd_host => 'graphite.openstack.org',
gearman_workers => [
'jenkins.openstack.org',
Add new jenkins masters to zuul firewall Change-Id: Id8dc54deea14150b972602249330e1081e594bc5
2013-08-05 13:39:53 -07:00
'jenkins01.openstack.org',
'jenkins02.openstack.org',
Add jenkins03 and 04 to most places Add them to all the places it's safe to do so for now. Don't actually spin up any nodes for them yet. Change-Id: I59e97be7e5b094af3153bc7d5dce0cff57996f55
2014-01-07 09:58:17 +08:00
'jenkins03.openstack.org',
'jenkins04.openstack.org',
Add three new jenkins servers Change-Id: I1143c1c7446890c47be12d8b115560bddadc1919
2014-01-22 09:12:39 -08:00
'jenkins05.openstack.org',
'jenkins06.openstack.org',
'jenkins07.openstack.org',
Add zuul-dev.openstack.org. And connect it to the firehose. Change-Id: Id860ff329e33a588d669608e5402bdb3765001dd Reviewed-on: https://review.openstack.org/28742 Reviewed-by: Khai Do <zaro0508@gmail.com> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Approved: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2013-05-09 16:06:21 -07:00
'jenkins-dev.openstack.org',
Connectivity from workers to gearmand on zuul. * manifests/site.pp: Pass both jenkins.openstack.org and jenkins-dev.openstack.org to openstack_project::zuul as the list of gearman workers for use in iptables rules. * modules/openstack_project/manifests/jenkins.pp * modules/openstack_project/manifests/jenkins_dev.pp: Remove unused 4155/tcp from public allowed ports list, previously for a bzr service which is no longer running on these servers. * modules/openstack_project/manifests/zuul.pp: Add iptables rules allowing access from gearman workers to the gearmand, and also configure gearmand to listen on all addresses including IPv6, as opposed to its IPv4-only default. * install_modules.sh: Add puppetlabs-stdlib version 3.2.0 to the list of puppet dependencies. This is required to pull in the "flatten" function used in zuul.pp above. Change-Id: I05d4abc92b3050884a7e9f3c2b6cd9dcc81bfa36 Reviewed-on: https://review.openstack.org/26245 Reviewed-by: James E. Blair <corvus@inaugust.com> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: Jeremy Stanley <fungi@yuggoth.org> Tested-by: Jenkins
2013-03-28 02:42:05 +00:00
],
Add a dedicated zuul server. Just bootstrapping the server; a follow-on change will switch hostnames in configurations. Change-Id: Ie453a3d046014137c66f2bc25e0a5916d09b9267 Reviewed-on: https://review.openstack.org/17167 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2012-11-29 13:43:20 -08:00
}
}
Add a skeleton asterisk server. This commit adds a bare server that will be updated to become an Asterisk server. Change-Id: If54badab3269d8c8ce504f8bfcb0e5f79eeaeb69
2013-07-16 17:03:58 -04:00
node 'pbx.openstack.org' {
class { 'openstack_project::pbx':
Add voipms configuration Change-Id: Ib776c8944bb3b2564e52b94fdb2bd04ffc6835eb
2013-07-18 13:36:21 -07:00
sysadmins => hiera('sysadmins'),
sip_providers => [
{
provider => 'voipms',
hostname => 'dallas.voip.ms',
username => hiera('voipms_username'),
password => hiera('voipms_password'),
outgoing => false,
},
],
Add a skeleton asterisk server. This commit adds a bare server that will be updated to become an Asterisk server. Change-Id: If54badab3269d8c8ce504f8bfcb0e5f79eeaeb69
2013-07-16 17:03:58 -04:00
}
}
Add backups. Change-Id: If328f94174a6b9dff5006a63fdff3983e89aee24
2012-06-15 22:40:12 +00:00
# A backup machine. Don't run cron or puppet agent on it.
node /^ci-backup-.*\.openstack\.org$/ {
Make a class for each type of server. Change-Id: I520b77a4d83958a6a1c2472e87b28f6b8822d890
2012-07-20 19:38:57 -07:00
include openstack_project::backup_server
Add backups. Change-Id: If328f94174a6b9dff5006a63fdff3983e89aee24
2012-06-15 22:40:12 +00:00
}
Move all node configuration into site.pp, with node identifiers based on hostnames so that puppet self-identifies which node config to use. Refactor class hierarchy for OpenStack slaves and servers. Add NTP to all systems. Change-Id: Ie7695768fcdebb744a86b3dc88bc0ea71297f978
2011-08-02 12:58:08 -07:00
#
# Jenkins slaves:
#
Apply cgroups and ulimit to precise8. To test the cgroup and ulimit changes in a controlled manner apply the two limiting tools to precise8. One this host the jenkins user will only be able to start 256 processes and will be limited to using 90% of the hosts physical memory. Change-Id: Id57c2ca9bbb40366b2827c4b07236aa33cc10bd7
2012-07-03 14:28:41 -07:00
Add pypi mirror building slaves. Change-Id: I9c5ea870d365f65ff19d91ca579ee127f67d9ea8 Reviewed-on: https://review.openstack.org/25314 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2013-03-25 11:30:37 -07:00
node 'mirror26.slave.openstack.org' {
Include openstack_project for Jenkins' SSH key. The openstack_project class needs to be included to make the jenkins_ssh_key variable available to nodes. Change-Id: I57fb6f24755bf123cf9f6f9b724035d0ababf8f3 Reviewed-on: https://review.openstack.org/31581 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Tested-by: Jenkins
2013-06-03 16:05:57 -07:00
include openstack_project
Add pypi mirror building slaves. Change-Id: I9c5ea870d365f65ff19d91ca579ee127f67d9ea8 Reviewed-on: https://review.openstack.org/25314 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2013-03-25 11:30:37 -07:00
class { 'openstack_project::mirror26_slave':
Pass Jenkins' SSH pub key to special slaves. The openstack_project::slave refactor defaulted the Jenkins' SSH pub key to an empty string. This erased the authorized keys file for the Jenkins user on our specialized slaves. Restore that file's contents. Change-Id: I28067017ec2dc36feef9df076099813abf820ee9 Reviewed-on: https://review.openstack.org/31419 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-06-01 19:40:07 -07:00
jenkins_ssh_public_key => $openstack_project::jenkins_ssh_key,
Add pypi mirror building slaves. Change-Id: I9c5ea870d365f65ff19d91ca579ee127f67d9ea8 Reviewed-on: https://review.openstack.org/25314 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2013-03-25 11:30:37 -07:00
jenkins_ssh_private_key => hiera('jenkins_ssh_private_key_contents')
}
}
node 'mirror27.slave.openstack.org' {
Include openstack_project for Jenkins' SSH key. The openstack_project class needs to be included to make the jenkins_ssh_key variable available to nodes. Change-Id: I57fb6f24755bf123cf9f6f9b724035d0ababf8f3 Reviewed-on: https://review.openstack.org/31581 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Tested-by: Jenkins
2013-06-03 16:05:57 -07:00
include openstack_project
Add pypi mirror building slaves. Change-Id: I9c5ea870d365f65ff19d91ca579ee127f67d9ea8 Reviewed-on: https://review.openstack.org/25314 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2013-03-25 11:30:37 -07:00
class { 'openstack_project::mirror27_slave':
Pass Jenkins' SSH pub key to special slaves. The openstack_project::slave refactor defaulted the Jenkins' SSH pub key to an empty string. This erased the authorized keys file for the Jenkins user on our specialized slaves. Restore that file's contents. Change-Id: I28067017ec2dc36feef9df076099813abf820ee9 Reviewed-on: https://review.openstack.org/31419 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-06-01 19:40:07 -07:00
jenkins_ssh_public_key => $openstack_project::jenkins_ssh_key,
Add pypi mirror building slaves. Change-Id: I9c5ea870d365f65ff19d91ca579ee127f67d9ea8 Reviewed-on: https://review.openstack.org/25314 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2013-03-25 11:30:37 -07:00
jenkins_ssh_private_key => hiera('jenkins_ssh_private_key_contents')
}
}
Add a mirror33 slave node definition. This will eventually run a job to feed any Python 3.3 specific dependencies into the pypi mirror. Change-Id: Idcfca576ee3b531bad54be5d53e0219f8719c25c
2013-07-31 19:13:14 +00:00
node 'mirror33.slave.openstack.org' {
include openstack_project
class { 'openstack_project::mirror33_slave':
jenkins_ssh_public_key => $openstack_project::jenkins_ssh_key,
jenkins_ssh_private_key => hiera('jenkins_ssh_private_key_contents')
}
}
Rename tx slave to proposal slave. The tx slave is going to be used for other jobs that propose changes to Gerrit. Give it a more appropriate name. This lines up with the move from hosting this under rackspace legacy to rackspace nova. Change-Id: I7168d62a4a0aae27d2cd2a7dc6c37595604c8251
2013-08-02 11:06:29 -07:00
node 'proposal.slave.openstack.org' {
Include openstack_project for Jenkins' SSH key. The openstack_project class needs to be included to make the jenkins_ssh_key variable available to nodes. Change-Id: I57fb6f24755bf123cf9f6f9b724035d0ababf8f3 Reviewed-on: https://review.openstack.org/31581 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Tested-by: Jenkins
2013-06-03 16:05:57 -07:00
include openstack_project
Rename tx slave to proposal slave. The tx slave is going to be used for other jobs that propose changes to Gerrit. Give it a more appropriate name. This lines up with the move from hosting this under rackspace legacy to rackspace nova. Change-Id: I7168d62a4a0aae27d2cd2a7dc6c37595604c8251
2013-08-02 11:06:29 -07:00
class { 'openstack_project::proposal_slave':
Add Jenkins SSH key to proposal.slave. Proposal.slave.openstack.org is used to push change proposals into Gerrit. To do this the slave needs to have the Jenkins' private SSH key installed. Make it so. Change-Id: Id3106d3167da0569370000e3c1a724a88abbd245
2013-08-05 10:38:59 -07:00
transifex_username => 'openstackjenkins',
transifex_password => hiera('transifex_password'),
jenkins_ssh_public_key => $openstack_project::jenkins_ssh_key,
jenkins_ssh_private_key => hiera('jenkins_ssh_private_key_contents'),
New job template for translation management. Add a new job template for translation management. Add two jobs for translation management. The first will will update transifex with the new .pot and .po files after every merge to a project. The second will commit the new .pot and .po files and submit for review once a day. Add puppet manifest for the slave that these jobs will be running on. Apply the template to nova. Change-Id: I5242f81bd6ff13d1ed8610ef9e3b39fd3dbd7301 Reviewed-on: https://review.openstack.org/11369 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-08-14 12:47:01 -07:00
}
}
Run pypi uploads more securely. To run pypi uploads more securely perform the `python setup.py sdist` on a normal build slave, then copy the sdist to the pypi slave and perform only the upload from that host. Change-Id: Ie68d484ef6d129749186c792d0ced812ac25818b Reviewed-on: https://review.openstack.org/16335 Reviewed-by: Monty Taylor <mordred@inaugust.com> Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2012-11-16 13:16:26 -08:00
node 'pypi.slave.openstack.org' {
Include openstack_project for Jenkins' SSH key. The openstack_project class needs to be included to make the jenkins_ssh_key variable available to nodes. Change-Id: I57fb6f24755bf123cf9f6f9b724035d0ababf8f3 Reviewed-on: https://review.openstack.org/31581 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Tested-by: Jenkins
2013-06-03 16:05:57 -07:00
include openstack_project
Run pypi uploads more securely. To run pypi uploads more securely perform the `python setup.py sdist` on a normal build slave, then copy the sdist to the pypi slave and perform only the upload from that host. Change-Id: Ie68d484ef6d129749186c792d0ced812ac25818b Reviewed-on: https://review.openstack.org/16335 Reviewed-by: Monty Taylor <mordred@inaugust.com> Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2012-11-16 13:16:26 -08:00
class { 'openstack_project::pypi_slave':
Pass Jenkins' SSH pub key to special slaves. The openstack_project::slave refactor defaulted the Jenkins' SSH pub key to an empty string. This erased the authorized keys file for the Jenkins user on our specialized slaves. Restore that file's contents. Change-Id: I28067017ec2dc36feef9df076099813abf820ee9 Reviewed-on: https://review.openstack.org/31419 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-06-01 19:40:07 -07:00
pypi_username => 'openstackci',
pypi_password => hiera('pypi_password'),
jenkins_ssh_public_key => $openstack_project::jenkins_ssh_key,
make maven versioning and deployment workflow similiar to python This commit fixes bug 1182154 The maven workflow for versioning and deployment is at odds with how we like to do it. For versioning, our convention is to get info from SCM to set the project build versions. For deployments to remote repositories we prefer to use curl instead of mvn deploy due to maven security vulnerabilities. Our python builds have already been setup to set package versions from SCM and deploy to pypi using curl so this commit is to make maven versioning and deployments similiar our python versioning and deployment workflow. This commit does the following: Setup a project version string as an environement variable so we can pass it to maven builds. The version string is retrieved from information in git. This makes the build versioning workflow similar to how we build python packages. This setup expects a variable called '$project-version' in the root 'version' element (i.e. <version>${project-version}</version>) of the maven project's pom.xml file. For general (throw away CI) builds we do the following: 1. generate a package 'myplugin.hpi' with version '1.3.0.4.a0bc21f' in the MANIFEST.MF file. The '4' is the number of commits since last tag. 2. publish 'myplugin-1.3.0.4.a0bc21f.hpi' to tarballs.o.o For release builds we do the following: 1. generate a package 'myplugin.hpi' with version '1.3.1' in the MANIFEST.MF file. 2. publish 'myplugin-1.3.1.hpi' to tarballs.o.o 3. publish 'myplugin-1.3.1.hpi' to repo.jenkins-ci.org Passes the jenkins credentials from hiera to the pypi slave so we can use it to deploy released plugins to repo.jenkins-ci.org Creates a generic jenkinsci-upload job that will deploy released jenkins plugin artifacts to a remote repository with user credentials from hiera. It will use the same curl deployment method as the pypi-upload job. Change-Id: If1306523a28da94ee970d96b7a788ca116348de7 Reviewed-on: https://review.openstack.org/31875 Reviewed-by: Monty Taylor <mordred@inaugust.com> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-06-12 14:26:41 -07:00
jenkinsci_username => hiera('jenkins_ci_org_user'),
jenkinsci_password => hiera('jenkins_ci_org_password'),
new maven plugin jobs to build and deploy maven plugins to maven nexus This patch adds jobs to build maven plugins and deploy them to the maven nexus repo at https://oss.sonatype.org Closes-Bug: #1082812 Change-Id: I283d475ab18819391f282234b063522abbf09eda
2013-09-11 09:49:24 -07:00
mavencentral_username => hiera('mavencentral_org_user'),
mavencentral_password => hiera('mavencentral_org_password'),
Run pypi uploads more securely. To run pypi uploads more securely perform the `python setup.py sdist` on a normal build slave, then copy the sdist to the pypi slave and perform only the upload from that host. Change-Id: Ie68d484ef6d129749186c792d0ced812ac25818b Reviewed-on: https://review.openstack.org/16335 Reviewed-by: Monty Taylor <mordred@inaugust.com> Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2012-11-16 13:16:26 -08:00
}
}
Add a Jenkins slave for triggering salt commands This is the skeleton we'll fill out with any additional functionality needed by the salt-trigger slave. Change-Id: I928c2fa4c64e69140b673615a8c18e4eea79e952
2013-09-12 17:38:19 +00:00
node 'salt-trigger.slave.openstack.org' {
include openstack_project
class { 'openstack_project::salt_trigger_slave':
jenkins_ssh_public_key => $openstack_project::jenkins_ssh_key,
}
}
Add jenkins dev slaves. Allow them to use an ssh key distinct from production. Clean up unused slave classes. Use dedicated keys on dev slaves (do this in prod in the future, but it's a breaking change). Add a dev_slave_template class for devstack-gate to use. Remove devstack-gate deps from jenkins master (they're on devstack-launch now). Clean up unneeded remove statements for glance creds. Tidy up some permissions on files where they weren't specified before. Change-Id: I02cef1ee3951c5780084118073770521bebb9eda Reviewed-on: https://review.openstack.org/29319 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-05-15 16:03:05 -07:00
node /^precise-?\d+.*\.slave\.openstack\.org$/ {
include openstack_project
Move OpenStack classes to openstack_project module Change-Id: Iafcd2e06c5b62e4cde5eccaab3173a20bb08a78d
2012-07-20 18:56:35 -07:00
include openstack_project::puppet_cron
Use puppetmaster for slaves. Use puppet agent --test for puppet cron. We don't need the private ssh or gpg key on the slaves anymore. We do need the glance testing stuff, so stick that into hiera. Change-Id: If94fc3f150bf569efe9461f80d3565f9825eebce Reviewed-on: https://review.openstack.org/10851 Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-08-05 13:02:21 -05:00
class { 'openstack_project::slave':
Style guide updates for manifest directory Change-Id: I40d54189eb6d5cd4512080ec5010fe339bac96e0 Signed-off-by: Paul Belanger <paul.belanger@polybeacon.com> Reviewed-on: https://review.openstack.org/13830 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-28 10:05:02 -04:00
certname => 'precise.slave.openstack.org',
Add jenkins dev slaves. Allow them to use an ssh key distinct from production. Clean up unused slave classes. Use dedicated keys on dev slaves (do this in prod in the future, but it's a breaking change). Add a dev_slave_template class for devstack-gate to use. Remove devstack-gate deps from jenkins master (they're on devstack-launch now). Clean up unneeded remove statements for glance creds. Tidy up some permissions on files where they weren't specified before. Change-Id: I02cef1ee3951c5780084118073770521bebb9eda Reviewed-on: https://review.openstack.org/29319 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-05-15 16:03:05 -07:00
ssh_key => $openstack_project::jenkins_ssh_key,
Pass sysadmins list into node defs. Pass the sysadmins list into each node definition. This allows us to retrieve the data from hiera rather than hard coding it in the puppet manifests. Also, update test script to use bogus sysadmin data when testing. Change-Id: Ide3560f16bce4d66fb95cc5021fc879476e6a712 Reviewed-on: https://review.openstack.org/12512 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-06 10:32:48 -07:00
sysadmins => hiera('sysadmins'),
Use puppetmaster for slaves. Use puppet agent --test for puppet cron. We don't need the private ssh or gpg key on the slaves anymore. We do need the glance testing stuff, so stick that into hiera. Change-Id: If94fc3f150bf569efe9461f80d3565f9825eebce Reviewed-on: https://review.openstack.org/10851 Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-08-05 13:02:21 -05:00
}
Apply cgroups and ulimit to precise8. To test the cgroup and ulimit changes in a controlled manner apply the two limiting tools to precise8. One this host the jenkins user will only be able to start 256 processes and will be limited to using 90% of the hosts physical memory. Change-Id: Id57c2ca9bbb40366b2827c4b07236aa33cc10bd7
2012-07-03 14:28:41 -07:00
}
Add jenkins dev slaves. Allow them to use an ssh key distinct from production. Clean up unused slave classes. Use dedicated keys on dev slaves (do this in prod in the future, but it's a breaking change). Add a dev_slave_template class for devstack-gate to use. Remove devstack-gate deps from jenkins master (they're on devstack-launch now). Clean up unneeded remove statements for glance creds. Tidy up some permissions on files where they weren't specified before. Change-Id: I02cef1ee3951c5780084118073770521bebb9eda Reviewed-on: https://review.openstack.org/29319 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-05-15 16:03:05 -07:00
node /^precise-dev\d+.*\.slave\.openstack\.org$/ {
include openstack_project
Move OpenStack classes to openstack_project module Change-Id: Iafcd2e06c5b62e4cde5eccaab3173a20bb08a78d
2012-07-20 18:56:35 -07:00
include openstack_project::puppet_cron
Use puppetmaster for slaves. Use puppet agent --test for puppet cron. We don't need the private ssh or gpg key on the slaves anymore. We do need the glance testing stuff, so stick that into hiera. Change-Id: If94fc3f150bf569efe9461f80d3565f9825eebce Reviewed-on: https://review.openstack.org/10851 Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-08-05 13:02:21 -05:00
class { 'openstack_project::slave':
Add jenkins dev slaves. Allow them to use an ssh key distinct from production. Clean up unused slave classes. Use dedicated keys on dev slaves (do this in prod in the future, but it's a breaking change). Add a dev_slave_template class for devstack-gate to use. Remove devstack-gate deps from jenkins master (they're on devstack-launch now). Clean up unneeded remove statements for glance creds. Tidy up some permissions on files where they weren't specified before. Change-Id: I02cef1ee3951c5780084118073770521bebb9eda Reviewed-on: https://review.openstack.org/29319 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-05-15 16:03:05 -07:00
ssh_key => $openstack_project::jenkins_dev_ssh_key,
Pass sysadmins list into node defs. Pass the sysadmins list into each node definition. This allows us to retrieve the data from hiera rather than hard coding it in the puppet manifests. Also, update test script to use bogus sysadmin data when testing. Change-Id: Ide3560f16bce4d66fb95cc5021fc879476e6a712 Reviewed-on: https://review.openstack.org/12512 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-06 10:32:48 -07:00
sysadmins => hiera('sysadmins'),
Jenkins slave puppetry for CentOS. The install scripts now look for CentOS in release files. Also some instances of facter's operatingsystem are switched to osfamily and capitalization of RedHat is normalized to match what facter uses. Change-Id: I3bbca5481d0d5e6de9e62bfd6e2b0a85264ed6ed Reviewed-on: https://review.openstack.org/27398 Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Tested-by: Jenkins
2013-04-24 02:27:21 +00:00
}
}
Use precisepy3k instead of precise3k. * manifests/site.pp: Unfortunately node names like precise3k-1 match the existing node name pattern precise-?\d+.* and end up with the precise.slave.openstack.org shared puppet cert as a result. Switch to precisepy3k which won't have this unintended side effect. Change-Id: I2a530b0e19af769700e85f9060c2cbd8592eef1d
2013-07-20 01:30:25 +00:00
node /^precisepy3k-?\d+.*\.slave\.openstack\.org$/ {
Add a node pattern for precise3k slaves. * manifests/site.pp: Add a node pattern for slave servers which run Ubuntu Precise Pangolin and default to Python 3.3 for the Puppet PIP package provider. * launch/README: Starting with precise3k slaves, individual Puppet certificates will now be used per-server. Change-Id: I2cde440720afd8014fc98dfd133d29a428751a9d
2013-07-18 02:37:29 +00:00
include openstack_project
include openstack_project::puppet_cron
class { 'openstack_project::slave':
Add support for running tox with PyPy and use it for Marconi This works by installing PyPy from the Ubuntu PPA, and then invoking `tox -e pypy` (similar to all the other Python buidlers). PyPy shares nodes with the Python3 builders. Change-Id: Ibf683c1995b0f5c04c93c56010befb222b386d7a
2013-08-19 10:45:47 -07:00
ssh_key => $openstack_project::jenkins_ssh_key,
sysadmins => hiera('sysadmins'),
python3 => true,
include_pypy => true,
Add a node pattern for precise3k slaves. * manifests/site.pp: Add a node pattern for slave servers which run Ubuntu Precise Pangolin and default to Python 3.3 for the Puppet PIP package provider. * launch/README: Starting with precise3k slaves, individual Puppet certificates will now be used per-server. Change-Id: I2cde440720afd8014fc98dfd133d29a428751a9d
2013-07-18 02:37:29 +00:00
}
}
Use precisepy3k instead of precise3k. * manifests/site.pp: Unfortunately node names like precise3k-1 match the existing node name pattern precise-?\d+.* and end up with the precise.slave.openstack.org shared puppet cert as a result. Switch to precisepy3k which won't have this unintended side effect. Change-Id: I2a530b0e19af769700e85f9060c2cbd8592eef1d
2013-07-20 01:30:25 +00:00
node /^precisepy3k-dev\d+.*\.slave\.openstack\.org$/ {
Add a node pattern for precise3k slaves. * manifests/site.pp: Add a node pattern for slave servers which run Ubuntu Precise Pangolin and default to Python 3.3 for the Puppet PIP package provider. * launch/README: Starting with precise3k slaves, individual Puppet certificates will now be used per-server. Change-Id: I2cde440720afd8014fc98dfd133d29a428751a9d
2013-07-18 02:37:29 +00:00
include openstack_project
include openstack_project::puppet_cron
class { 'openstack_project::slave':
Add support for running tox with PyPy and use it for Marconi This works by installing PyPy from the Ubuntu PPA, and then invoking `tox -e pypy` (similar to all the other Python buidlers). PyPy shares nodes with the Python3 builders. Change-Id: Ibf683c1995b0f5c04c93c56010befb222b386d7a
2013-08-19 10:45:47 -07:00
ssh_key => $openstack_project::jenkins_dev_ssh_key,
sysadmins => hiera('sysadmins'),
python3 => true,
include_pypy => true,
Add a node pattern for precise3k slaves. * manifests/site.pp: Add a node pattern for slave servers which run Ubuntu Precise Pangolin and default to Python 3.3 for the Puppet PIP package provider. * launch/README: Starting with precise3k slaves, individual Puppet certificates will now be used per-server. Change-Id: I2cde440720afd8014fc98dfd133d29a428751a9d
2013-07-18 02:37:29 +00:00
}
}
Add jenkins dev slaves. Allow them to use an ssh key distinct from production. Clean up unused slave classes. Use dedicated keys on dev slaves (do this in prod in the future, but it's a breaking change). Add a dev_slave_template class for devstack-gate to use. Remove devstack-gate deps from jenkins master (they're on devstack-launch now). Clean up unneeded remove statements for glance creds. Tidy up some permissions on files where they weren't specified before. Change-Id: I02cef1ee3951c5780084118073770521bebb9eda Reviewed-on: https://review.openstack.org/29319 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-05-15 16:03:05 -07:00
node /^centos6-?\d+\.slave\.openstack\.org$/ {
include openstack_project
Jenkins slave puppetry for CentOS. The install scripts now look for CentOS in release files. Also some instances of facter's operatingsystem are switched to osfamily and capitalization of RedHat is normalized to match what facter uses. Change-Id: I3bbca5481d0d5e6de9e62bfd6e2b0a85264ed6ed Reviewed-on: https://review.openstack.org/27398 Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Tested-by: Jenkins
2013-04-24 02:27:21 +00:00
include openstack_project::puppet_cron
class { 'openstack_project::slave':
certname => 'centos6.slave.openstack.org',
Add jenkins dev slaves. Allow them to use an ssh key distinct from production. Clean up unused slave classes. Use dedicated keys on dev slaves (do this in prod in the future, but it's a breaking change). Add a dev_slave_template class for devstack-gate to use. Remove devstack-gate deps from jenkins master (they're on devstack-launch now). Clean up unneeded remove statements for glance creds. Tidy up some permissions on files where they weren't specified before. Change-Id: I02cef1ee3951c5780084118073770521bebb9eda Reviewed-on: https://review.openstack.org/29319 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-05-15 16:03:05 -07:00
ssh_key => $openstack_project::jenkins_ssh_key,
Jenkins slave puppetry for CentOS. The install scripts now look for CentOS in release files. Also some instances of facter's operatingsystem are switched to osfamily and capitalization of RedHat is normalized to match what facter uses. Change-Id: I3bbca5481d0d5e6de9e62bfd6e2b0a85264ed6ed Reviewed-on: https://review.openstack.org/27398 Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Tested-by: Jenkins
2013-04-24 02:27:21 +00:00
sysadmins => hiera('sysadmins'),
Use puppetmaster for slaves. Use puppet agent --test for puppet cron. We don't need the private ssh or gpg key on the slaves anymore. We do need the glance testing stuff, so stick that into hiera. Change-Id: If94fc3f150bf569efe9461f80d3565f9825eebce Reviewed-on: https://review.openstack.org/10851 Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-08-05 13:02:21 -05:00
}
Add tox to jenkins slave configs. Change-Id: I1528afc878c65abfd83a6a9418631a1c392e2a5a
2012-01-23 15:16:06 -08:00
}
Refactor Dynamic tcp ports. Change-Id: Id53f9960f0b7b5c27f3595fc6722a2a110aa88db
2012-03-25 12:44:52 -07:00
Add jenkins dev slaves. Allow them to use an ssh key distinct from production. Clean up unused slave classes. Use dedicated keys on dev slaves (do this in prod in the future, but it's a breaking change). Add a dev_slave_template class for devstack-gate to use. Remove devstack-gate deps from jenkins master (they're on devstack-launch now). Clean up unneeded remove statements for glance creds. Tidy up some permissions on files where they weren't specified before. Change-Id: I02cef1ee3951c5780084118073770521bebb9eda Reviewed-on: https://review.openstack.org/29319 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-05-15 16:03:05 -07:00
node /^centos6-dev\d+\.slave\.openstack\.org$/ {
include openstack_project
Add support for RHEL to site.pp. Updates site.pp with a block for RHEL slaves. Change-Id: Ib83e9d0cd1cc4208eac3a0a63580c76e60965c2a Reviewed-on: https://review.openstack.org/23106 Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Tested-by: Jenkins
2013-02-27 14:06:42 -05:00
include openstack_project::puppet_cron
class { 'openstack_project::slave':
Add jenkins dev slaves. Allow them to use an ssh key distinct from production. Clean up unused slave classes. Use dedicated keys on dev slaves (do this in prod in the future, but it's a breaking change). Add a dev_slave_template class for devstack-gate to use. Remove devstack-gate deps from jenkins master (they're on devstack-launch now). Clean up unneeded remove statements for glance creds. Tidy up some permissions on files where they weren't specified before. Change-Id: I02cef1ee3951c5780084118073770521bebb9eda Reviewed-on: https://review.openstack.org/29319 Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: Clark Boylan <clark.boylan@gmail.com> Tested-by: Jenkins
2013-05-15 16:03:05 -07:00
ssh_key => $openstack_project::jenkins_dev_ssh_key,
Add support for RHEL to site.pp. Updates site.pp with a block for RHEL slaves. Change-Id: Ib83e9d0cd1cc4208eac3a0a63580c76e60965c2a Reviewed-on: https://review.openstack.org/23106 Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: Jeremy Stanley <fungi@yuggoth.org> Reviewed-by: Jeremy Stanley <fungi@yuggoth.org> Tested-by: Jenkins
2013-02-27 14:06:42 -05:00
sysadmins => hiera('sysadmins'),
}
}
Add fedora18 and fedora18-dev slaves. * manifests/site.pp: Add node name patterns for fedora18 production and development slaves with Python 3 support switched on. Change-Id: I7eac41e6dccde50be962cbc3fda21ac90c3d246b Reviewed-on: https://review.openstack.org/34084 Reviewed-by: Dan Prince <dprince@redhat.com> Reviewed-by: Clark Boylan <clark.boylan@gmail.com> Approved: James E. Blair <corvus@inaugust.com> Reviewed-by: James E. Blair <corvus@inaugust.com> Tested-by: Jenkins
2013-06-22 02:07:45 +00:00
node /^fedora18-?\d+\.slave\.openstack\.org$/ {
include openstack_project
include openstack_project::puppet_cron
class { 'openstack_project::slave':
certname => 'fedora18.slave.openstack.org',
ssh_key => $openstack_project::jenkins_ssh_key,
sysadmins => hiera('sysadmins'),
python3 => true,
}
}
node /^fedora18-dev\d+\.slave\.openstack\.org$/ {
include openstack_project
include openstack_project::puppet_cron
class { 'openstack_project::slave':
ssh_key => $openstack_project::jenkins_dev_ssh_key,
sysadmins => hiera('sysadmins'),
python3 => true,
}
}
Review and create Puppet configuration for dev server blueprint sso-openid-provider Change-Id: I7966f59df6bd6ba851b507c7a408f076d7031abe
2013-10-24 11:18:24 -03:00
node 'openstackid-dev.openstack.org' {
Set up openstackid module Refactor the openstack_project::openstackid_dev module out into a top-level openstackid module in preparation for multiple servers, set up Apache to serve content out of /srv/openstackid, add an /etc/openstackid/database.php file with connection details injected from hiera and keep an updated clone of openstack-infra/openstackid in /opt/openstackid. Change-Id: Icdde594384e3af27c8dd185a51b9e5a71619fb7b
2013-12-20 04:59:12 +00:00
class { 'openstack_project::openstackid_dev':
sysadmins => hiera('sysadmins'),
site_admin_password => hiera('openstackid_dev_site_admin_password'),
mysql_host => hiera('openstackid_dev_mysql_host'),
mysql_password => hiera('openstackid_dev_mysql_password'),
Review and create Puppet configuration for dev server blueprint sso-openid-provider Change-Id: I7966f59df6bd6ba851b507c7a408f076d7031abe
2013-10-24 11:18:24 -03:00
}
}
Style guide updates for manifest directory Change-Id: I40d54189eb6d5cd4512080ec5010fe339bac96e0 Signed-off-by: Paul Belanger <paul.belanger@polybeacon.com> Reviewed-on: https://review.openstack.org/13830 Reviewed-by: James E. Blair <corvus@inaugust.com> Approved: Monty Taylor <mordred@inaugust.com> Reviewed-by: Monty Taylor <mordred@inaugust.com> Tested-by: Jenkins
2012-09-28 10:05:02 -04:00
# vim:sw=2:ts=2:expandtab:textwidth=79
Copy Permalink