30 Commits

Author SHA1 Message Date
Emilien Macchi
eee900890d Add Puppetlabs mirror for Ubuntu Xenial
Change-Id: Ibf5bd302b121abd64b3c74a6ec0cf8fecc455e6b
2018-01-03 17:19:41 -08:00
Jenkins
1e125a5194 Merge "Fix docker-deb components" 2017-10-09 07:23:08 +00:00
Ian Wienand
4ed1b11354 Fix docker-deb components
Switch to "stable" (missed in I6d096957495f03f47b5ab8f25664e83be18ba4f5)

Change-Id: I8e3f5cdc8e5200482c1ea110c6da3f953920a535
2017-10-09 15:06:14 +11:00
Mohammed Naser
1c338227fa
Add Ceph Luminous Debian mirrors
Change-Id: I60177c4783f5e0695ba4466fdbd181130b5934c1
2017-09-27 10:01:23 -04:00
Paul Belanger
0332443c07
Fixes needed for reprepro docker mirror
Change-Id: I4aab462ed62fe2d60b0572efd06804f063015ab8
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-05-03 10:42:25 -04:00
Paul Belanger
93be2fd82e
Add reprepro for docker
Add the bits needed to mirror apt.dockerproject.org into
openstack-infra.

Change-Id: Id8b34407fcc5b1705f3db17a5fc26a4a79034baa
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-05-03 09:21:42 -04:00
Paul Belanger
7e7956bd66 Fixes to ubuntu-mariadb mirror
Changes that are needed to make reprepro function properly.

Change-Id: I344f529e8edf7a9f272774db8dd42330919c4e65
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2017-03-02 13:59:25 -05:00
Paul Belanger
34e7120bcb
Mirror debian source packages
The debian packaging team will need access to the source packages when
doing builds.  This is the last step needed to have our debian images
use our AFS mirrors.

Change-Id: I7ad8c083e690e222ab1a77a07a89e29f59fb3c9b
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-09-12 08:17:17 -04:00
Jenkins
ef11d2f690 Merge "Configure jessie-security for our debian mirror" 2016-08-26 23:26:18 +00:00
Paul Belanger
6207deef52
Add source to ubuntu mirror distributions
This is a follow up patch to our previous attempt to mirror source
packages, we forgot to actually download the first pass of packages.
We have correctly added the code to update them.

Change-Id: Ia2776d60f2b6d8b526b6866462299c7bf2f6bc5a
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-08-18 21:11:44 -04:00
Jenkins
f2016cad73 Merge "OpenStack-CI Apt mirror for MariaDB" 2016-08-11 03:11:55 +00:00
Paul Belanger
89afa66bbe
Add jessie-newton-backports repo
This was requested by the Package-Deb team, which will contain
non-openstack package backports needed to build OpenStack packages.

Change-Id: Ife0b5cb8ece69aaca0c0c5e8140809f1da091fc9
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-07-27 09:41:56 -04:00
Paul Belanger
1436ec58be
Configure jessie-security for our debian mirror
This fixes a typo in our reprepro configuration for debian security.
Now we're use the jessie-security as the distribution file.

Change-Id: I87d70b160fcfd1321cd07f7594bdc18cd98ba5a3
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-07-25 18:20:44 -04:00
Jesse Pretorius
afa38f2a45
OpenStack-CI Apt mirror for MariaDB
This patch adds a mirror for MariaDB packages. The releases
mirrored is selective, only covering the currently supported
Ubuntu and MariaDB versions for OpenStack-Ansible.

Having this mirror available aids deployment projects which
consume these packages by ensuring that all apt packages needed
are available in mirror local to the nodepool cloud provider.

Change-Id: Ic549bbbd4f5dafc6555174f3ef3bd713b9a727d4
2016-07-21 12:20:00 -04:00
Paul Belanger
c85859ca2d
Add debian-ceph-jewel mirror to AFS
As more teams will be switching to jewel from hammer, we also need to
provide a debian mirror for it.

Change-Id: I0f5097672c0afd092380d841c665c3fdfa25f280
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-07-19 13:58:27 -04:00
Paul Belanger
bec8458406
Add reprepro to release slave
The Packaging-deb team will be starting to publish packages to AFS.
This patch is the first step to allow that.

Change-Id: I9d8d5ce384a371042928587c0debf0da37352ad8
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-07-04 12:00:05 -04:00
Paul Belanger
6f1a8b2423
Fixes for UAC mirror
We don't need UDebComponents since there is no debian-installer.
Additionally, fix a typo with our updates field.

Change-Id: I070ea1df8897a5388919e30bfbdd54e07fc3b30e
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-06-27 17:17:30 -04:00
Paul Belanger
2e7762ea06
Remove whitespaces for UCA erb file
Otherwise reprepro complains

Change-Id: I12c5c4a0c883771bcb058b40677b4051936ca4d0
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-06-27 16:43:55 -04:00
Jesse Pretorius
0f291dc788 OpenStack-CI Apt mirror for Ubuntu Cloud Archive
This patch adds a mirror for Ubuntu Cloud Archive. The releases
mirrored is selective, only covering the currently supported
Ubuntu and OpenStack versions.

Having this mirror available aids deployment projects which
consume these packages by ensuring that all apt packages needed
are available in mirror local to the nodepool cloud provider.

Note:
I have no real understanding of how puppet/system-config works
and don't know how to test this patch. If there's no
system-config gate check to validate that this works, please can
someone assist by testing and providing feedback.

Change-Id: Id658f2f29ce4a42eee2ef1ecdf935ada882da51e
2016-06-17 11:44:14 +01:00
Paul Belanger
0fb4078426
Fix typo in debian-ceph-hammer log files
Trivial change to fix logfile path names.

Change-Id: I27a77e0bc35776a106d33b45559ebda29aa7e1cd
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-05-01 09:15:47 -05:00
Clark Boylan
657bcc4a00 Don't mirror udeb on ceph debian mirror
The ceph debian mirror does not have udeb components so don't attempt to
mirror them. Attempting to mirror them makes reprepro fail.

Change-Id: Ica8e99092d762445af78bb0a7f7f789c8576a1c5
2016-04-15 10:38:36 -07:00
Clark Boylan
3878c06e1b Apt mirror for ceph hammer release
Mirror the trusty packages for the ceph hammer release to aid in process
of making ceph testing more robust. Use reprepro which is already in use
to mirror the main ubuntu trusty repos.

Change-Id: Ifd09272c7b1e07de9135be5a96be06153a3f611e
2016-04-14 14:01:27 -07:00
Paul Belanger
5b452e4df2 Increase verbosity for reprepro command
In an effor to better debug reprepo failures, lets increase the
logging.

Change-Id: I66073a26a60721221587b5e94825fdfdfe52fef9
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-04-01 17:12:30 -04:00
Paul Belanger
17cbda7375 Add trailing whitespace to reprepo distributions
Otherwise, we get the following errors:

  Error parsing /etc/reprepro/ubuntu/distributions, line 42: Second
  appearance of 'Origin' in the same chunk!

Change-Id: I11fb815eddae1efa7ff072f8065af5b9ddee5e85
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-04-01 14:08:12 -04:00
Clint Byrum
539205484b Disable automatic installation of backports
In Ubuntu, the archive configures backports as something you must
explicitly request when installing packages. One does this by specifying
a package name of 'backports/$packagename'. But our reprepro mirrors of
backports do not have this flag set, and so, all systems get backported
versions of packages, instead of the one from the released stable
archive.

Change-Id: I8f266dc7045e971567ed934d1206c7b83cacd178
2016-03-11 16:12:36 -08:00
Monty Taylor
7ec1b3d7e3 Split reprepro config to allow for debian and ubuntu
We can't colocation debian and ubuntu - so allow for each having their
own pool independent pool structure.

Change-Id: I9fe0fa9769a5c0f6a852844b2db0dfb620e91375
2016-02-08 14:16:53 -06:00
Monty Taylor
857b22519a Remove restricted and multiverse
The packages in restricted and multiverse are either non-free or
unsupported. While they're usually useful for desktop, they aren't
something that OpenStack should grow a dependency on.

Also remove non-free and contrib from debian. We don't do anything with
debian yet - but if we did, I'm pretty sure we would not want these.

Note: The existing restricted and multiverse dirs should be purged,
although it's not urgent to do so. 'reprepro --delete clearvanished'

Change-Id: I1d98ab1dea52598d01e3ce3d9a24306280a190fe
2016-02-08 12:29:16 -06:00
Monty Taylor
d00e7c0e5d Update paths for AFS mirror
In the current setup, the reprepro db and lists dirs are being written
into /root. Move them into AFS so that we store all the data in the same
place.

Also, update the script to point to the confdir for reprepro commands.

Note: This will require a manual move of the current db and lists dirs
from /root to /afs/.openstack.org/mirror/apt before this is run.

Change-Id: I2638621e6af98296704e680227fae174d8a0e541
2016-02-07 09:53:14 -06:00
Monty Taylor
a751c6c2b8 Update reprepro options file with valid options
Options are space delimited, not = delimeted. Also, AFS reports space
differently, so skip the space available check.

Change-Id: I097bc43481ecfb64d0c95f08c82bd3ceb5bd6be9
2016-02-06 15:19:10 -06:00
Monty Taylor
f1c86c66a3 Add AFS apt mirror
The reprepro class in this is in-tree rather than in its own module
purely for ease of getting started. It's also highly hard-coded rather
than flexible.

This change will need a mirror.apt volume and service/reprepro principal
and keytab to be created before it lands.

Allow for pool trimming after a 2 hour delay. Each devstack run of
apt-get update should be able to be assumed to be valid for the length
of the devstack. For that reason, only delete files that are
unreferenced during the subsequent mirror run, ensuring at least a 2
hour delay between becoming unreferenced and going away.

Local testing indicates that a trusty mirror is 86G.

Change-Id: I84f6a0391f80e6bf567c4bfc18a41bd270fe8c01
2016-02-05 10:50:04 -06:00