mrepo RHEL7 mirror using lftp dies with Error 11 after downloading 65 files

[bodinewilson]

I'm trying to synch a RHEL7 mirror, which previously working great using the certs from a live RHEL7 machine, but I've recently run into an issue:

It looks like an mrepo mirror run will consistently fail with return code 11 after downloading 65 files from the repository.

A second run will result in the next set of 65 files being added, and dying with code 11, and soforth.

Run One:

<--- HTTP/1.1 200 OK
<--- Server: Apache
<--- ETag: "8a41e55b31e7252527fea055669ff482:1476097733"
<--- Last-Modified: Thu, 06 Oct 2016 12:11:11 GMT
<--- Accept-Ranges: bytes
<--- Content-Length: 35920
<--- Content-Type: audio/x-pn-realaudio-plugin
<--- Date: Fri, 15 Sep 2017 19:50:29 GMT
<--- X-Cache: TCP_HIT from a184-27-178-114.deploy.akamaitechnologies.com (AkamaiGHost/9.1.0.4-20866905) (-)
<--- Connection: keep-alive
<--- EJ-HOST: rhej02.web.prod.ext.phx2.redhat.com
<--- X-Akamai-Request-ID: 9ae2af4
<---
---- Receiving body...
---- Received all
Transferring file `Packages/kmod-oracleasm-2.0.8-19.el7.x86_64.rpm'
mrepo: Mirroring failed for https://cdn.redhat.com/content/dist/rhel/server/7/7Server/x86_64/os with message:
Failed with return code: 11
rhel7s-x86_64: Removing lock /var/cache/mrepo/rhel7s-x86_64/update-os.lock
rhel7s-x86_64: Repository os changed (new: 65, removed: 0)
rhel7s-x86_64: New packages:
khmeros-bokor-fonts-5.0-17.el7.noarch.rpm
khmeros-fonts-common-5.0-17.el7.noarch.rpm
khmeros-handwritten-fonts-5.0-17.el7.noarch.

End of Second Run:

<--- HTTP/1.1 200 OK
<--- Server: Apache
<--- ETag: "43e43e86470c0f48d6375cdc89706070:1481041688"
<--- Last-Modified: Mon, 14 Nov 2016 03:34:35 GMT
<--- Accept-Ranges: bytes
<--- Content-Length: 665452
<--- Content-Type: audio/x-pn-realaudio-plugin
<--- Date: Fri, 15 Sep 2017 20:04:04 GMT
<--- X-Cache: TCP_HIT from a184-27-178-114.deploy.akamaitechnologies.com (AkamaiGHost/9.1.0.4-20866905) (-)
<--- Connection: keep-alive
<--- EJ-HOST: edgejavaappa3.prod.a4.vary.redhat.com
<--- X-Akamai-Request-ID: 9b864ec
<---
---- Receiving body...
---- Received all
Transferring file `Packages/krb5-devel-1.14.1-27.el7_3.x86_64.rpm'
mrepo: Mirroring failed for https://cdn.redhat.com/content/dist/rhel/server/7/7Server/x86_64/os with message:
Failed with return code: 11
rhel7s-x86_64: Removing lock /var/cache/mrepo/rhel7s-x86_64/update-os.lock
rhel7s-x86_64: Repository os changed (new: 65, removed: 0)
rhel7s-x86_64: New packages:
kmod-oracleasm-2.0.8-19.el7.x86_64.rpm
kmod-oracleasm-2.0.8-8.el7.x86_64.rpm
kmod-qed-8.7.1.20-1.el7_2.x86_64.rpm
kmod-qed-firmware-8.7.1.20-1.el7_2.x86_64.rpm
kmod-qede-8.7.1.20-1.el7_2.x86_64.rpm
kmod-qla2xxx-8.07.00.33.07.3_k-1.el7_2.x86_64.rpm
kmod-redhat-i40e-1.6.27_k_dup7.3-1.el7_3.x86_64.rpm
kmod-redhat-i40evf-1.6.27_k_dup7.3-1.el7_3.x86_64.rpm
kmod-redhat-ixgbe-4.4.0_k_rh7.4_z-2.el7_3.x86_64.rpm
kmod-redhat-ixgbevf-3.2.2_k_rh7.4_z-1.el7_3.x86_64.rpm
kmod-redhat-megaraid_sas-07.700.00.00-rh1.el7_3.x86_64.rpm

[bodinewilson]

Hi Guys,
looks like the issue was with lftp 4.0.9 which shipped stock with our version of EL6.

I've compiled the latest version from http://lftp.yar.ru and we're using that to mirrior. That's got us past that particular issue.