148 Commits

Author SHA1 Message Date
Mathias Ewald
f16a45180c External Ceph support - Implementation Glance
Most simple implementation of external ceph support.

We use INI merge to configure RBD backend for Glance and copy
ceph.conf and keyring provided by the user into the container.

Set_configs.py had to be extended to support globbing (wildcards) in
order to copy ceph keyring file which is named depending on the cephx
user name.

Partially-Implements Blueprint: external-ceph
Partially-Implements Blueprint: selectable-ceph

Change-Id: Iacadbd8ec9956e9f075206ea03b28f044cb6ffb8
2016-07-14 14:05:34 +00:00
Jenkins
160d6b270d Merge "Use the disk size as the osd weight when osd_initial_weight is auto" 2016-07-05 06:14:47 +00:00
Jeffrey Zhang
d4269334dd Use the disk size as the osd weight when osd_initial_weight is auto
In most of case, the disks used by ceph have different size. Use the
default value 1 may block the ceph when one disk is full. Use the disk
size as osd weight will more reasonally.

TrivialFix

Change-Id: Ib875c7289188cbb9380355baf0c8048f1eb09332
2016-06-29 23:14:51 +08:00
Christian Berendt
727173f4be Cleanup RUN commands in base Dockerfile
This will merge several RUN statements into one RUN statement to reduce
the number of the layers of the base Docker image.

TrivialFix

Change-Id: I69b00b2e7fa7717923f0fe364c5be9b38a2dbb90
2016-06-29 13:31:07 +02:00
Michal (inc0) Jastrzebski
24b90f15ce Add customizations for apt keys and packages
To customize apt packages, you need to do something like that in
override file:

{% set base_apt_packages = base_apt_packages + ['vim', 'emacs'] %}

Change-Id: I7913ed405c2cb7e33f1cfe310d651030e0700e6b
Partially-implements: blueprint third-party-plugin-support
2016-06-21 03:14:45 +00:00
Christian Berendt
748eef065e Remove mesos artifacts
TrivialFix

Change-Id: Ide5944ea3b47db0de4bdce6410a217b5d8991c8f
2016-06-18 17:47:30 +02:00
Benedikt Trefzer
190ae5957c Make container dind unpin old docker relase
- remove pinning to old docker version in ubuntu
- move docker ubuntu repository to base image

Change-Id: If05ccc0c5b3e89725acea3b603b5ef7acbbee649
Partially-implements: blueprint build-debian
2016-06-04 10:09:59 +02:00
Jenkins
ad71352a93 Merge "Use debian repos for debian base docker image" 2016-06-03 17:59:36 +00:00
Benedikt Trefzer
30c805596f Use debian repos for debian base docker image
Change-Id: Ic5c1d20fa9f7f1cd9fd20e658b4bd1abb235f3b6
Partially-implements: blueprint build-debian
2016-06-03 00:32:05 +02:00
Benedikt Trefzer
80d2edbd8e add curlrc file to base image
The curlrc file for root allows better output control for
curl downloads during build process.

Closes-Bug: #1567926

Change-Id: I19b526e4eab223d2456f4bbc2f4ba50192ec0901
2016-06-02 18:20:48 +02:00
Jeffrey Zhang
4044a3475e Pin the base distro release version
Pin the base distro release version in the master branch(Newton).
Only one distro version is supported. The supported versions are:

* CentOS: 7
* RedHat: 7
* OracleLinux: 7
* Debian: 8
* Ubuntu: 14.04

NOTE: Kolla will move to Ubuntu 16.04 in the Newton cycle

DocImpact
TrivialFix

Change-Id: I32c0edbee4de14c8a0cc7c961d566e84d70f19a4
2016-05-31 01:41:48 +00:00
Jenkins
383730443c Merge "Update ubuntu dockerfiles for formatting" 2016-05-26 11:13:10 +00:00
Swapnil Kulkarni (coolsvap)
435b21b90d Update ubuntu dockerfiles for formatting
Change-Id: If4be00b937e14ec93443dcb7249cf17099d57cbe
Closes-Bug: #1569417
2016-05-26 04:09:22 +00:00
Paul Bourke
d958e24c3d Fix build for oraclelinux base
centos-release-openstack-mitaka 1.3 is now available via the
delorean-mitaka-testing repo. We need to install this directly instead
of the 1.2 version as otherwise the subsequent 'yum update' tries to
install it and fails on the centos-release dependency which is
incompatible with the oraclelinux base.

Closes-Bug: 1576238

Change-Id: I51cb372424b27b32e95f9e81c5dddbe8e49a6131
2016-05-16 09:18:32 +00:00
Jeffrey Zhang
070bf25835 Support a custom base image
Add a new option(base-image) to support custom base image
In default, the base-image is equal to base. When using custom
image, please use command line like:

    ./tool/build.py --base-image my-image --base centos --base-tag 0.1

DocImpact

Closes-Bug: #1573544
Change-Id: If4b9c57a2b68f6f06d3e981f30b2173064e02193
2016-05-09 07:29:19 +00:00
Jenkins
6fa8261a5c Merge "Remove unecessary blank lines" 2016-05-03 02:53:00 +00:00
Steven Dake
025d57f820 Remove dependencies on kazoo and friends
Since kolla-mesos has been retired, there is no need in the code
base to keep the zookeeper implementation.  As a result, just remove
it.  If we were to keep it we need virtualenvs for that part of the
code base which installs the python dependencies related to it
for from-binary installs.

This just simplifies the implementation tremendously and culls dead
code.

Change-Id: Ieda226e652d67f5b5667112f4f2556f3171366d3
Closes-Bug: #1577194
2016-05-02 06:12:50 -07:00
Mauricio Lima
2c34214388 Remove unecessary blank lines
TrivialFix

Change-Id: I1f03d428c380dfdbde5ef33e7ea43cbf5e9154ce
2016-05-02 07:44:29 -04:00
Swapnil Kulkarni (coolsvap)
53b609df45 Update base dockerfile for formatting
Change-Id: I3ff33a5f4e0359eefd997e8c0a2305d815c52486
Partial-Bug:#1569417
2016-04-15 08:53:58 +05:30
Steven Dake
e37fa65f4f Use proper CentOS repositories for ceph and qemu
CentOS has a virtualization sig and storage sig which produces
udpated ceph and qemu images.  These images are then reused within
the rest of Red Hat packaging.  Install these repositories for
CentOS and make use of them.

This should work for OracleLinux as well.
Still testing centos.

Co-Authored-By: Vikram Hosakote <vhosakot@cisco.com>
Co-Authored-By: Paul Bourke <paul.bourke@oracle.com>

Change-Id: Iea21fc4f33bbfdb973cf354d492c372bd3360acb
Closes-Bug: #1566588
2016-04-14 10:50:38 +01:00
Jenkins
544c00b497 Merge "Adds iscsid and tgtd docker containers" 2016-04-12 19:38:46 +00:00
Carlos Cesario
08b08c78b5 Identify container through PS1 shell variable
As suggested it was created the variable KOLLA_SERVICE_NAME to identify
the container service name through  PS1 shell variable.
This method it was previously discussed in IRC.
https://goo.gl/k7AdEg

The other option it was usage hostname param in kolla_docker, but
currently docker does not support it due this issue:
https://github.com/docker/compose/issues/2460

The final result is like this:

$ docker exec -it heka /bin/bash
(heka)[heka@kolla-control /]$

$ docker exec -it mariadb /bin/bash
(mariadb)[mysql@kolla-control /]$

More details can be accessed through this link
http://paste.openstack.org/show/493689/

Closes-Bug: #1557454
Change-Id: I6aab8d640a8ebb17baa9d6d4f1edd6e331674713
2016-04-11 17:50:04 -03:00
Serguei Bezverkhi
184f01a0d6 Adds iscsid and tgtd docker containers
This partially implements iscsi and lvm2 support for cinder
in Kolla. Adds iscsid and tgtd docker containers.

Change-Id: I7fb48c954e578772b90a2aa619c8bcfa990b3ae8
Partially-Implements: blueprint iscsi-lvm2-docker
2016-04-10 09:17:16 -04:00
SamYaple
f4175f04d7 Fix 'optional' config.json values
These values are optional only when the services are not enabled.

If the file does not exist we should not warn, but rather inform.

Ceph-mon is an exception here since its bootstrap process means
the files may or may not exist initially.

TrivialFix

Change-Id: Ic02bece76d480e99deecf612036f37abb5604135
2016-03-19 23:01:27 +00:00
Vikram Hosakote
ec3baf0428 Install Elasticsearch and Kibana packages using yum/apt-get
Test results of this patch set are at
http://paste.openstack.org/show/490450/.

Change-Id: I2957cc70fcca34706ec50a630d785f0630c3f5c0
Closes-Bug: #1553203
2016-03-18 04:05:30 +00:00
Paul Bourke
db27136ed5 Add missing tar command for oraclelinux binary
Kibana was failing with the binary build type due to tar missing.

TrivialFix

Change-Id: Ia7cb77c5359b2ed30cd1883c0848cd1506a63833
2016-03-15 16:16:53 +00:00
SamYaple
8b3f0d0857 Use ubuntu Mitaka repo
The rabbitmq-server package is upgraded to 3.5.7 in cloud-archive
so we update centos to match

The xen-utils package now needs an explict version, xen-utils-4.6 is
what is provided by cloud-archive mitaka

Libvirt 1.3 is in the ubuntu cloud-archive. This has a new daemon for
logging that needs further implementation in newton. For now, it has
been disabled within the qemu.conf

Co-Authored-By: Jeffrey Zhang <jeffrey.zhang@99cloud.net>
TrivialFix
Change-Id: I84217824817c484b6800a64cbd7767b127a3098e
2016-03-14 15:52:48 +00:00
SamYaple
0bb766c129 Properly pin ceph
Ubuntu is a bit different than centos. We aren't pinning a single ceph
verion because we cannot. We can however pin to a particular repo,
but we were not due to formating. This fixes that formating and pins
to a specific repo.

TrivialFix

Change-Id: I2f6c4cd2f7d51652dc2729c0ab384165151e94e2
2016-03-13 23:21:53 +00:00
Jenkins
4a5859bb46 Merge "Add missing 'yum clean all' in oraclelinux base" 2016-03-10 12:09:14 +00:00
Paul Bourke
4dd60575f2 Add missing 'yum clean all' in oraclelinux base
This one line halfs the size of oraclelinux images, from over 1GB to
just over 500MB, bringing them inline with centos.

TrivialFix

Change-Id: I9fd89aeeec56207791fc289db9880b43b17536f5
2016-03-10 10:24:19 +00:00
Paul Bourke
2967f250d7 Add centos-extras repo to oraclelinux-base
magnum requires python-docker-py which is missing in the oraclelinux
base repos.

TrivialFix

Change-Id: I466a170a8df8f207c47d06ba5a6cba9b7efa3e5f
2016-03-09 17:14:55 +00:00
Éric Lemoine
14dec25e54 Fix "wait for log socket" in start.sh
The code in docker/base/start.sh that waits for the log socket does
not work because it includes a bad "space" character after "-S".

This patch changes that character to a real "space" character. It
also sets the SKIP_LOG_SETUP envvar for the Heka container.

TrivialFix

Change-Id: I17a3005df5bbd57678350fc77030e44b5ad6acae
2016-03-07 13:21:38 +01:00
Jeffrey Zhang
e878da0412 Reconfigure cinder service
Change-Id: I8d207d1782acfebf5c07de39df3257fd9bdbbada
Partially-implements: bp kolla-reconfig
2016-03-02 23:52:49 +00:00
Jeffrey Zhang
72ac7a5541 Reconfigure keystone service
Partially-implements: bp kolla-reconfig

Change-Id: Ied293e59bf4531e88a0e5e5bf9a5f5f495d2a0e7
2016-02-27 02:15:48 +00:00
Jenkins
f1eb20d58a Merge "Import module rather than funciton in the set_configs.py file" 2016-02-25 21:53:13 +00:00
Jeffrey Zhang
2eaf65a1e1 Import module rather than funciton in the set_configs.py file
TrivialFix

Change-Id: I352ef1176407edf093667644ce6adbd48eb63865
2016-02-25 08:20:09 +08:00
Martin André
8d49c703d8 Pin ceph-radosgw
Change-Id: I9ff2e9d1e682f3d6b206568863d4bac3900fc03a
Closes-Bug: #1549538
2016-02-25 09:00:58 +09:00
Jenkins
22d32ff280 Merge "Pin Mesos to 0.27.1 version" 2016-02-23 17:34:37 +00:00
Jenkins
56c32ac39a Merge "Remove Rsyslog entirely" 2016-02-23 16:37:56 +00:00
Éric Lemoine
0417844b8d Remove Rsyslog entirely
Partially implements: blueprint heka

Change-Id: I1322d2dc870e6f8fe052926995d993e8a08a25db
2016-02-23 01:45:23 -08:00
Michal Rostecki
85398707c2 Pin Mesos to 0.27.1 version
Change-Id: I6a3e51a4e49d896d1a8dfcc554715e2cb6a8901e
Closes-Bug: 1548318
2016-02-23 09:12:50 +01:00
Angus Salkeld
2597bf8cfd Skip extend_start.sh if KOLLA_SKIP_EXTEND_START is defined
This is all kolla-mesos needs, so that we can run the extend_start
within the context of our start script. We need to do this to track
dependencies of the commands (one of which is the extend_start).

implements blueprint custom-extend-start

Change-Id: Ib844adc9c42dd8862281eb3f903d6c2b4695a34d
2016-02-23 11:09:08 +10:00
Éric Lemoine
916925c9a8 Add Heka to common role
Partially implements: blueprint heka
Change-Id: I9ddad09b3f16b323c7ed535243458b0de6620cdb
2016-02-19 20:32:00 +00:00
Jenkins
0943e12fca Merge "Added Elasticearch and its deployment." 2016-02-19 15:25:55 +00:00
SamYaple
690e6853de Move socket binding to named_volume
The extend_start.sh script for rsyslog is removed as it is no longer
needed. Docker no longer binds to /dev/log or /run/kolla/log

Closes-Bug: #1544545
Change-Id: Ic0a323a26ee4e9e15baf4598285844a8a4955f23
2016-02-16 14:42:41 +00:00
akwasniewska
792666dd79 Added Elasticearch and its deployment.
Part of ELK stack. Includes Dockerfiles for both Centos and Ubuntu.

Change-Id: I9f76adf084cd4f68e29326112b76ffd02b5adada
Partially-implements: blueprint central-logging-service
2016-02-13 07:53:24 +00:00
Jenkins
e8348d033a Merge "Move the install base type check to kolla-build" 2016-02-04 11:31:01 +00:00
Allen Gao
db53ad1ddf Move the install base type check to kolla-build
The install type is converted in kolla-build, so it will never
fail in dockerfile, move the check to kolla-build just above
the install type converting.

TrivialFix

Co-Authored-By: Jeffrey Zhang <jeffrey.zhang@99cloud.net>
Change-Id: I1500d3b47e909f94ea9f68c5245297733f63a70b
2016-02-04 16:48:12 +08:00
venkatamahesh
23b1a8c03a Fix some words spellings
Trivial Fix

Change-Id: Ic14778bb4e894490a3b6af9471ba01ab4da94601
2016-02-03 10:01:30 +00:00
Antoine Roux
b5c2bd22a2 Fix wrong behavior when the source is a directory
TrivialFix

Change-Id: Ie723fb35f15be0a500b428b2b58e6b4c5321df0c
2016-02-02 12:15:33 +00:00