File has unexpected size (14998916 != 15001236). Mirror sync in progress?

[spowelljr]

Hi, I have started getting the following error when trying to install cri-o:

 > [linux/arm64 stage-1 15/39] RUN sh -c "echo 'deb https://download.opensuse.org/repositories/devel:/kubic:/libcontainers:/stable:/cri-o:/1.22/xUbuntu_20.04/ /' > /etc/apt/sources.list.d/devel:kubic:libcontainers:stable:cri-o:1.22.list" &&     curl -LO https://download.opensuse.org/repositories/devel:/kubic:/libcontainers:/stable:/cri-o:/1.22/xUbuntu_20.04/Release.key &&     apt-key add - < Release.key &&     clean-install cri-o cri-o-runc:
#76 43.70    - Filesize:15001236 [weak]
#76 44.08 Get:3 https://download.opensuse.org/repositories/devel:/kubic:/libcontainers:/stable/xUbuntu_20.04  cri-o-runc 1.0.1~0 [2620 kB]
#76 44.63 Fetched 2728 kB in 4s (707 kB/s)
#76 44.63 E: Failed to fetch https://provo-mirror.opensuse.org//repositories/devel:/kubic:/libcontainers:/stable:/cri-o:/1.22/xUbuntu_20.04/arm64/cri-o_1.22.0~0_arm64.deb  File has unexpected size (14998916 != 15001236). Mirror sync in progress? [IP: 91.193.113.70 443]
#76 44.63    Hashes of expected file:
#76 44.63     - SHA256:4083cae1b0cb721930b4eacb72fc13fba38bfebd0c9e9bf2d5b2350e412957ce
#76 44.63     - SHA1:b5498aab7c1b1a2bbf6e1f42cf407153fd451952 [weak]
#76 44.63     - MD5Sum:bf253a670518c00ecceb650a1c11ca9e [weak]
#76 44.63     - Filesize:15001236 [weak]
#76 44.63 E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

[haircommander]

yeah I hit this as well, but don't yet understand why it's happening

[haircommander]

I was able to install on debian 10 now. I think the OBS repos just neeed to sync. Is it working for you now @spowelljr

[spowelljr]

Yup, it worked for me, thanks!

[spowelljr]

Hi @haircommander, I'm getting this again File has unexpected size (20107660 != 20107360). Mirror sync in progress? is there a way to resolve this? The unfortunate thing is this job blocks our release process so if there is a way to make this more stable it would be much appreciated.

[haircommander]

I am sorry @spowelljr it is out of my control, and I don't have the capacity right now to find anything else.
Which version are you hitting it with?

[spowelljr]

Failed to fetch https://provo-mirror.opensuse.org/repositories/devel:/kubic:/libcontainers:/stable:/cri-o:/1.22/xUbuntu_20.04/amd64/cri-o_1.22.0~0_amd64.deb File has unexpected size (20107660 != 20107360). Mirror sync in progress?

I'm running another build right now to see if the issue is resolved.

[spowelljr]

It failed, with a slightly different one this time.

Failed to fetch https://provo-mirror.opensuse.org/repositories/devel:/kubic:/libcontainers:/stable/xUbuntu_20.04/amd64/crun_1.2-1_amd64.deb File has unexpected size (251432 != 251616). Mirror sync in progress?

[lsm5]

i'll rebuild crun now

[lsm5]

@spowelljr rebuilt crun 1.2-2 just now, give it a try.

Stale mirror issues happen frequently on OBS. podman team had a similar issue which went away after a retry. Starting with 22.04 LTS, we should try and reduce dependence on OBS packages wherever possible.

[medyagh]

@lsm5 we still see this issue and now we cant install podman with the same error.

this is blocking minikube release

[lsm5]

@medyagh can you send the installation logs please? Is it still only the crun package being a problem or do you see a similar but separate issue with the podman package as well?

[lsm5]

On a newly created 20.04 instance, I see a

E: Failed to fetch https://provo-mirror.opensuse.org/repositories/devel:/kubic:/libcontainers:/stable/xUbuntu_20.04/Packages.gz  Hash Sum mismatch
   Hashes of expected file:
    - Filesize:12605 [weak]
    - SHA256:5348a3f0c5446e4c806ff71d755441f513b13599f5e18e16efab77e469639c97
    - SHA1:65dbc5da6d89236a2bfac73825a085efd7a6e82f [weak]
    - MD5Sum:0335a88fb1a2400b4a976817dba3920a [weak]
   Hashes of received file:
    - SHA256:2c3c5ae2ddd8e6d5234496b289d023f5f75b9c21f7ecbde1c7fe62612c17d6b1
    - SHA1:6f38ba6241b16aefa6314bf16d5a40e00f5ef4da [weak]
    - MD5Sum:3e3b023ec1b807ac59fb4d99cc2ae377 [weak]
    - Filesize:12605 [weak]
   Last modification reported: Mon, 25 Oct 2021 14:32:23 +0000
   Release file created at: Tue, 26 Oct 2021 21:32:07 +0000
E: Some index files failed to download. They have been ignored, or old ones used instead.

If you're seeing this too, it's likely that provo-mirror.opensuse.org is messed up.

Can you try adding the kubic repos for ubuntu as mentioned at https://podman.io/getting-started/installation but with the additional change: s/download.opensuse.org/downloadcontent.opensuse.org/g

I see no issues with downloadcontent.opensuse.org.

HTH.

[lsm5]

I'll check with the OBS admins tomorrow about mirror issues.

[gbraad]

It is now resolved. It can successfully pull now.

[saschagrunert]

Awesome, glad it has been resolved. Closing this issue for now, feel free to reopen if the issue comes back.

[spowelljr]

Just as an update on this issue, we've been experiencing this issue pretty consistently as of lately, I'm going to try @lsm5's suggestion above #5343 (comment).