This fixes Debian's Release file headers when mirrored by reprepro.
Especially, this patch adds NotAutomatic and ButAutomaticUpgrades
headers needed to correctly setup a backport repository.
Change-Id: I5e0c2f11362cdb59bfd0c36ee148bf5d8aab43db
This adds the puppet5 pools for puppetlabs apt mirror.
We need these two pools to get latest puppet5 versions
on Debian and Ubuntu:
* http://apt.puppetlabs.com/pool/xenial/puppet5/
* http://apt.puppetlabs.com/pool/stretch/puppet5/
The yum puppetlabs mirror is correct and after this fix
we can properly use the latest version available in CI.
Change-Id: Ic5f7a20bcc8181f1dc55dedfaa60c622defe9c43
Currently this is broken on mirror-update.o.o, the reason seems to be
upstream security.debian.org is a separate pool, but we are trying to
add it into a single pool.
This is causing checksum issues on files we download.
For now, remove debian-security and update jobs to pull directly from
security.debian.org. A follow up patch will move this into its own
pool for reprepro creating mirror.debian-security.
Change-Id: Id918597aecc5114791811c7f30b6109da6a8d0af
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Our previous patch didn't work as expected, this is because the repo
data for security is not in the toplevel directory. This was the
reason for using suite.
This then means we need 2 stanza's for jessie and stretch, since the
suite field only supports a single entry.
Change-Id: I29944191beff261c79f819e434da35e2848877cb
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Follow-on from Ibf5bd302b121abd64b3c74a6ec0cf8fecc455e6b
The name in the updates file is actually "puppetlabs-debs-pc1". After
correcting this manually on mirror-update I got a good mirror run.
Change-Id: Icb06102730135ee33cc1dc29024f600e1d09fb04
Add the bits needed to mirror apt.dockerproject.org into
openstack-infra.
Change-Id: Id8b34407fcc5b1705f3db17a5fc26a4a79034baa
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Changes that are needed to make reprepro function properly.
Change-Id: I344f529e8edf7a9f272774db8dd42330919c4e65
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
The debian packaging team will need access to the source packages when
doing builds. This is the last step needed to have our debian images
use our AFS mirrors.
Change-Id: I7ad8c083e690e222ab1a77a07a89e29f59fb3c9b
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
This is a follow up patch to our previous attempt to mirror source
packages, we forgot to actually download the first pass of packages.
We have correctly added the code to update them.
Change-Id: Ia2776d60f2b6d8b526b6866462299c7bf2f6bc5a
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
This was requested by the Package-Deb team, which will contain
non-openstack package backports needed to build OpenStack packages.
Change-Id: Ife0b5cb8ece69aaca0c0c5e8140809f1da091fc9
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
This fixes a typo in our reprepro configuration for debian security.
Now we're use the jessie-security as the distribution file.
Change-Id: I87d70b160fcfd1321cd07f7594bdc18cd98ba5a3
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
This patch adds a mirror for MariaDB packages. The releases
mirrored is selective, only covering the currently supported
Ubuntu and MariaDB versions for OpenStack-Ansible.
Having this mirror available aids deployment projects which
consume these packages by ensuring that all apt packages needed
are available in mirror local to the nodepool cloud provider.
Change-Id: Ic549bbbd4f5dafc6555174f3ef3bd713b9a727d4
As more teams will be switching to jewel from hammer, we also need to
provide a debian mirror for it.
Change-Id: I0f5097672c0afd092380d841c665c3fdfa25f280
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
The Packaging-deb team will be starting to publish packages to AFS.
This patch is the first step to allow that.
Change-Id: I9d8d5ce384a371042928587c0debf0da37352ad8
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
We don't need UDebComponents since there is no debian-installer.
Additionally, fix a typo with our updates field.
Change-Id: I070ea1df8897a5388919e30bfbdd54e07fc3b30e
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
This patch adds a mirror for Ubuntu Cloud Archive. The releases
mirrored is selective, only covering the currently supported
Ubuntu and OpenStack versions.
Having this mirror available aids deployment projects which
consume these packages by ensuring that all apt packages needed
are available in mirror local to the nodepool cloud provider.
Note:
I have no real understanding of how puppet/system-config works
and don't know how to test this patch. If there's no
system-config gate check to validate that this works, please can
someone assist by testing and providing feedback.
Change-Id: Id658f2f29ce4a42eee2ef1ecdf935ada882da51e
The ceph debian mirror does not have udeb components so don't attempt to
mirror them. Attempting to mirror them makes reprepro fail.
Change-Id: Ica8e99092d762445af78bb0a7f7f789c8576a1c5
Mirror the trusty packages for the ceph hammer release to aid in process
of making ceph testing more robust. Use reprepro which is already in use
to mirror the main ubuntu trusty repos.
Change-Id: Ifd09272c7b1e07de9135be5a96be06153a3f611e
In an effor to better debug reprepo failures, lets increase the
logging.
Change-Id: I66073a26a60721221587b5e94825fdfdfe52fef9
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Otherwise, we get the following errors:
Error parsing /etc/reprepro/ubuntu/distributions, line 42: Second
appearance of 'Origin' in the same chunk!
Change-Id: I11fb815eddae1efa7ff072f8065af5b9ddee5e85
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
In Ubuntu, the archive configures backports as something you must
explicitly request when installing packages. One does this by specifying
a package name of 'backports/$packagename'. But our reprepro mirrors of
backports do not have this flag set, and so, all systems get backported
versions of packages, instead of the one from the released stable
archive.
Change-Id: I8f266dc7045e971567ed934d1206c7b83cacd178
We can't colocation debian and ubuntu - so allow for each having their
own pool independent pool structure.
Change-Id: I9fe0fa9769a5c0f6a852844b2db0dfb620e91375
The packages in restricted and multiverse are either non-free or
unsupported. While they're usually useful for desktop, they aren't
something that OpenStack should grow a dependency on.
Also remove non-free and contrib from debian. We don't do anything with
debian yet - but if we did, I'm pretty sure we would not want these.
Note: The existing restricted and multiverse dirs should be purged,
although it's not urgent to do so. 'reprepro --delete clearvanished'
Change-Id: I1d98ab1dea52598d01e3ce3d9a24306280a190fe
In the current setup, the reprepro db and lists dirs are being written
into /root. Move them into AFS so that we store all the data in the same
place.
Also, update the script to point to the confdir for reprepro commands.
Note: This will require a manual move of the current db and lists dirs
from /root to /afs/.openstack.org/mirror/apt before this is run.
Change-Id: I2638621e6af98296704e680227fae174d8a0e541
Options are space delimited, not = delimeted. Also, AFS reports space
differently, so skip the space available check.
Change-Id: I097bc43481ecfb64d0c95f08c82bd3ceb5bd6be9
The reprepro class in this is in-tree rather than in its own module
purely for ease of getting started. It's also highly hard-coded rather
than flexible.
This change will need a mirror.apt volume and service/reprepro principal
and keytab to be created before it lands.
Allow for pool trimming after a 2 hour delay. Each devstack run of
apt-get update should be able to be assumed to be valid for the length
of the devstack. For that reason, only delete files that are
unreferenced during the subsequent mirror run, ensuring at least a 2
hour delay between becoming unreferenced and going away.
Local testing indicates that a trusty mirror is 86G.
Change-Id: I84f6a0391f80e6bf567c4bfc18a41bd270fe8c01
