Our EPEL mirror script has been perpetually failing ever since 7 was
archived in July, and apparently 8 went EOL after that. Remove them
both so that we will get back to updating packages for EPEL 9.
Change-Id: I2995bf9171c58a6bc44143870c2f058daa211916
We currently only support x86_64 and aarch64 systems, and don't need
packages for other platforms nor separate bootable system image
files. Explicitly exclude them in the OpenEuler mirror script.
Change-Id: Ia1e741909b2a5129e10eedcba5ca4c87ccad5d91
openEuler22.03 LTS was out of data in May 2024, and the newest
LTS version is 24.03 LTS which will be maintained to 2026.03.
This Patch add the 24.03-LTS mirror.
Change-Id: Ifcee064959972bf871688baeff7b3288d7517da1
Now that CentOS 7, 8 and 8-stream have been removed from mirroring we
can drop the mirror script for these releases entirely. Note that
9-stream and beyond use the newer centos-stream script instead and are
not affected.
Once this is completed we should be able to clean up the afs volume for
centos entirely as well (though it is empty currently and has a very low
cost in that state).
Change-Id: I744c61e3386d4ea54efaae9c3a46fd08878263ff
There is a README and a few empty directories to clean up from the
8-stream mirror content. This should be safe to land at any time since
the mirror is no longer functional after upstream cleanup that we
synced.
Change-Id: I467c1f575e9461a8bf8d37697161e65114e5161a
This should cleanup our mirror update server so that we no longer have
configes (cron, scripts, logrotate rules, etc) for mirroring opensuse.
It won't clean up the afs volume, but we can get to that later (and it
will probably require manual intervention). This cleanup is done in a
way that it should be able to be applied to future cleanups too (like
when centos 8 stream goes away and everything is centos stream
specific).
Change-Id: Ib5d15ce800ff0620187345e1cfec0b7b5d65bee5
There are a number of issues with opensuse mirroring content cleanup
that this change aims to address. First up we fix the prefix for the
CentOS 7 networking content; it needed a repositories/ prefix. At the
same time we don't bother deleting the leaf data and instead delete the
more top level directory since we're cleaning this all up.
We then apply this top level cleanup to all of the repositories,
distributions, and updates. This is largely a noop (just some directory
removals) except in the case of update/ which still contains leap 15.2
update packages. These were apparently missed in the initial opensuse
cleaup.
After this lands we should end up with a largely empty volume.
Change-Id: Ic854fcecd1a0fabc388640a33da7e4e1f9ec07c0
We have removed CentOS 7 from nodepool now we can stop mirroring
pacakges for it. This deletes official CentOS 7 package mirror content
and OBS packages mirrored by the OpenSUSE mirror script for CentOS 7.
A followup change will remove the OpenSUSE mirroring entirely as this
was the last thing it was used for.
Change-Id: I484651b0845eaab933e98106684e0a2a6215b3d7
Those repos are produced by the Automotive SIG [1], are not used by
OpenStack and increase the size of the centos stream repositories
needlessly.
[1] https://sigs.centos.org/automotive/
Change-Id: I8a12956aa2079ce851ad0bb5ff60f49677f5b7d3
This change updates the opensuse mirror script to stop mirroring
opensuse 15. However, we do not entirely remove the opensuse mirroring
script as it is currently mirring some centos 7 packages from OBS for
kolla. We will clean this up more fully when we remove centos 7.
Depends-On: https://review.opendev.org/c/openstack/project-config/+/909776
Change-Id: I0c3546b79219180b796ca02fa8d82dba2316878a
Instead of using external public mirrors, the CentOS team is allowing
openinfra to sync to the core repo mirrors which should provide a more
reliable source for the repos [1].
In case of issues with the repos, the official way to contact CentOS
team is via a ticket to the centos-infra tracker [2].
[1] https://pagure.io/centos-infra/issue/1354
[2] https://pagure.io/centos-infra/issues
Change-Id: Iec8c664a35157de4527c2b83723f3947af959756
This consist of some iso files which are not
used and rsync also fails[1] for these, let's exclude
these.
[1]
rsync: read error: Connection timed out (110)
rsync error: error in socket IO (code 10) at io.c(801) [receiver=3.1.3]
Change-Id: I3accc16ff8a1e71e499a09e7aae6625e3a183a12
This is mostly a formality as upstream of us the content was already
removed and we synced that removal. But this will do a little extra
cleanup for us to make it look even less like a mirror of Fedora 36.
I also kept the structure of the file rather than deleting the code to
sync Fedora content. This should make it easy for someone to pick this
back up in the future if there is a need and ability to maintain it.
Change-Id: I976304727a06bd36eb05201043aac3861ee66937
For some reason the x86_64/ directories of centos mirrors contain i686
packages too. Since none of our systems rely on i686 lets go ahead and
exclude these packages entirely. This should save quite a bit of disk
space (almost halving the required disk space?).
Change-Id: I146765da021e8436365e39a6dca4db470a07fe81
We don't have fedora 37 images but are mirroring fedora 37. Clean up
this mirroring because if we add new up to date images we will add
fedora 38 and skip 37 entirely.
Also, while we are at it remove rawhide mirror content since we're
running up against AFS disk capacity and this will help clean up some
extra content that appears to be unused.
Change-Id: Ie845f4e1a87fb9b0c6a0d2ed86227273ff8a45d8
This reverts commit e76e0089d1c4a7fe781027feb7977ae874899443.
Reason for revert: Facebook mirrors are out of sync for more then 24h that does break CI and block progress. Let's try out another rax mirror
this time.
Change-Id: Ibb0a23ee790aeea5e4f5d05ce731791bd380976a
openEuler 20.03 LTS SP2 is unmaintained any more. This patch drop
the mirror and clean up the mirror files.
Change-Id: I9c0c5faf81b8fa3f60b4dedf2e726e9ec44a35c0
This mirror contains less data - only epel and fedora, thus
updated more quickly and was suggested by mirror maintainer
to be used instead in the meanwhile.
Change-Id: I22d4a3a1aadc5784cd4cc38f7af26a4b6d95c93a
If you are running these jobs by hand you are doing something that
will be expected to take a long time (initial sync, recovery, etc.).
Make these scripts assume interactivity and default to *not* running
under timeout -- it's too easy to forget NO_TIMEOUT when running
manually and having the job killed.
We already have an UNDER_CRON variable set so that we only send stats
when running ... under cron. Reuse this here for the timeout flag.
Change-Id: Ic2d2f39bb18d247c853284512fe0dc37485c00a4
This reverts commit cc2dd16d3a7194a4185ad6e1da854cb4fde01b1c.
Reason for revert: rax mirrors not synched for 15 hours and causing
issues, facebook mirror is up to date so let's switch to it.
Change-Id: Iaf94540f22e2b49c74ab0704ac94fd1554ce5bbc
Related-Bug: #1988397
Facebook mirror is out of sync for some days, so i'm proposing to use
rackspace one. This reverts [1] as it seems it is accepting rsync
connections properly.
[1] https://review.opendev.org/c/opendev/system-config/+/824829
Change-Id: Ic0076191157be8947f62ce18d5dd37f1f0ac3337
kernel.org has been rejecting rsync attempts with an over-capacity
message for several days now. Switch to the facebook mirror which
seems to be working for 8-stream.
Change-Id: I98de9dd827a3c78a023b677da854089593d5a454
openEuler 20.03 LTS SP2 was out of data in May 2022, and the newest
LTS version is 22.03 LTS which will be maintained to 2024.03.
This Patch add the 22.03-LTS mirror
Change-Id: I2eb72de4eee22a7a8739320ead8376c999993928
Add released Fedora 36 to the mirror. Traditionally we have kept two
releases (prior and current) around; but depending on what is broken
often we drop the prior release earlier if it is not worth fixing;
this is what happened with F34. Ergo this is adding 36 and leaving
35, for now.
Change-Id: I9864666be0a6e32edc730b736f81d8883411bcb2
In our onging quest to find a stable upstream source, switch this to
the facebook mirror which seems to have been working well enough for
centos.
While we're here, reduce the frequency a bit as there's no need to
sync every two hours; it's a bit unfriendly to the remote end.
Change-Id: I50f38b58b3f0c0557fb1e2e0667a17a4f1d1dec6
It appears our opensuse mirror upstream has added an extra opensuse/ in
the path to the opensuse packages that we mirror.
Currently we fail with:
rsync: [sender] change_dir "/distribution/leap/15.2/repo" (in opensuse) failed: No such file or directory (2)
Browsing the repo via https we see the content exists at:
https://mirror.clarkson.edu/opensuse/opensuse/distribution/leap/15.2/repo/
which includes an extra opensuse/ path segment. Now it is possible that
https and rsync have different root dirs, but considering the current
error trying this seems reasonable.
Change-Id: I37aa701af409a58d228c22d664ad0f49a23a1fc5
We build our own images from scratch using yum/dnf and don't rely on the
isolinux/ or images/ content. Clean this up from our mirrors to reduce
their size and time to sync.
Change-Id: Ifa47c8ae1f3a080e69e4c00b0c2ef38f4094e1a2
This removes debug and non-oss packages from our opensuse mirrors. These
shouldn't be needed by any jobs so we don't need to mirror them. The
goal here is to reduce overall disk consumption where possible.
Change-Id: Ic48f421e8e7cf7bae039b68b8ed3bc2a5c8e278b
We don't have CentOS 7 arm64 test instances so we remove the aarch64
packages for CentOS 7. Additionally we remove unneeded source and
alternative arch packages from Epel for CentOS 7 and 8.
Change-Id: I8b5c6906c2ce698a02b794e635e8f8ba613c0fef
Put the excludes in the order seen at a URL like
http://mirrors.us.kernel.org/fedora/releases/35/
Remove "Docker" and "CloudImages" which doesn't exist now, add
"Kinoite" and "Silverblue" which we don't use.
Change-Id: I07711cb83f88844cd036b81a198908498b380733
Our current mirror is out of sync, it has happened twice now. It's
been several years since we switched away from kernel.org mirrors
(Ie6050fbf20259df39eab11f8e326d58351d98ea5) so it might be worth
trying again (they are currently in sync). Also we are using the
".us" version here, to keep things more local to the update server.
Change-Id: I29cf3895e7fa8e401a1d686119e56b4fddb0cc47
openEuler yum mirror in Russia is down. This patch change the
rsync url to the official HongKong one.
This patch also fix the openEuler mirror url nit.
Change-Id: Ifb930e34fd7f16f77ba55bc489e5389c641139de
We have removed Fedora 34 from our CI system. Fedora has a short
lifetime for each release, and in this particular case Fedora 34 did not
boot reliably in all our clouds. Now that the images have been removed
we can remove the release from our mirrors too.
Change-Id: I07dfca0ef88dc9531e4cb2c67ebbca5e0503594e
In CS9 the layout of the repos has changed and the SIGs repos are in a
separatee directory under centos-stream [1] so we need to add a new
rsync command. These repos includes messaging for rabbitmq-server, nfv
for openvswitch and storage for ceph.
[1] http://mirror.stream.centos.org/
Change-Id: I90890aade7ad5f42e15c4c171ed2c2545f2310c4
Current mirror http://mirror.dal10.us.leaseweb.net/centos/8-stream
is hitting issues and is impacting all CS8 jobs.
Switching to facebook mirror fixes the issue.
Related-Bug: #1958510
Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
Change-Id: Ibddbee60c4318fd7bd34f281af95a20bf172c572
Currently dfw.mirror.rackspace.com is used for
syncing CS9 content on OpenDev mirror. But somehow it is
rejecting rsync connections.
Switching to facebook mirror[1] might fix the issue.
[1]. https://admin.fedoraproject.org/mirrormanager/mirrors/CentOS/9-stream/x86_64
Related-Bug: #1957950
Signed-off-by: Chandan Kumar (raukadah) <chkumar@redhat.com>
Change-Id: I119e468d6b38e4b3a0f73ab0e839f3bba85fd039
Tumbleweed images were an interesting idea to add forward looking
testing of a very new and up to date linux distro. Unfortunately, the
images don't receive the attention they deserve to remain in our CI
system, and nothing seems to use the images anyway. Clean up our
opensuse mirrors and stop mirroring tumbleweed as one step in this clean
up process.
This depends on the change that removes the CI label/images.
Depends-On: https://review.opendev.org/c/openstack/project-config/+/824071
Change-Id: Ie1488b453463da750e1a08536116e44ec129828e
This is a re-implementation of
I195ebee548071b0b89bd5bf64b251595271178ca that puts 9-stream in a
separate AFS volume
(Note the automated volume name "mirror.centos-stream" comes just
short of the limit)
Change-Id: I483c2982a6931e7d6fc97ab82f7750b72d2ef265
This reverts commit 8591ce2b5c689b5e438fc0bfe9d410be7e344fb1.
It did not click that this is written to use
/afs/.openstack.org/mirror/centos-stream as the base directory. The
mirror/ directory has volumes mounted in it -- i.e. centos-stream has
to be a new volume (and also has to be "vos released" separately, the
existing script won't do it).
The simplest way to do this is to treat this separately. I'll propose
this in a follow-on.
Change-Id: If7b8239adf7635da4f0c317287d23daf5ab0f4bf
