Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update fallback mirror list #485

Merged
merged 1 commit into from
Feb 10, 2022
Merged

Conversation

hoffie
Copy link
Contributor

@hoffie hoffie commented Feb 6, 2022

Some of the currently listed mirrors are no longer part of the official mirror list by qt.io, some return 404, some don't fully mirror the tree (especially online/).

The updated list has been generated via the following one-liner:

for mirror in $(curl -s https://download.qt.io/static/mirrorlist/ | grep -oP 'href="\K(http.*)(?=">HTTP</a>)' | sed -re 's|^http:|https:|; s|([^/])$|\1/|'); do code=$(curl -I "${mirror}online/qtsdkrepository/windows_x86/desktop/qt6_623/qt.qt6.623.win64_msvc2019_64/6.2.3-0-202201260729qtbase-Windows-Windows_10_21H2-MSVC2019-Windows-Windows_10_21H2-X86_64.7z" --write-out '%{response_code}' --silent -o /dev/null); [[ $code == 200 ]] && echo "    ${mirror}"; done

aqt/settings.ini Outdated
https://mirrors.sjtug.sjtu.edu.cn/qt/
https://mirrors.tuna.tsinghua.edu.cn/qt/
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is problematic because it limit access connections unknown condition, maybe outside of china, and randomly failed, So it is listed in black list and it had been failed in past CI tests.
Could you remove blacklisted host?

Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Or if it is healthy, please also update blacklist.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the pointer, should have caught that myself. I've updated the PR to avoid adding blacklisted entries.
While the mirror is currently reachable for me, it's rather slow and I don't know the history, so it might be better to keep it as-is.

Some of the currently listed mirrors are no longer part of the official
mirror list by qt.io, some return 404, some don't fully mirror the
tree.

The list has been generated via the following one-liner:
blacklist=$(sed -rne '/blacklist:/,/fallbacks:/p ' aqt/settings.ini); for mirror in $(curl -s https://download.qt.io/static/mirrorlist/ | grep -oP 'href="\K(http.*)(?=">HTTP</a>)' | sed -re 's|^http:|https:|; s|([^/])$|\1/|'); do grep -qF "$(sed -re 's|^https?://([^/]+).*$|\1|' <<<"${mirror}")" <<<"$blacklist" && continue; code=$(curl -I "${mirror}online/qtsdkrepository/windows_x86/desktop/qt6_623/qt.qt6.623.win64_msvc2019_64/6.2.3-0-202201260729qtbase-Windows-Windows_10_21H2-MSVC2019-Windows-Windows_10_21H2-X86_64.7z" --write-out '%{response_code}' --silent -o /dev/null); [[ $code == 200 ]] && echo "    ${mirror}"; done
@hoffie hoffie force-pushed the remove-dead-mirrors branch from 062e391 to 10e5bdf Compare February 6, 2022 22:55
@miurahr
Copy link
Owner

miurahr commented Feb 10, 2022

Thank you.

@miurahr miurahr merged commit d5f264f into miurahr:master Feb 10, 2022
@miurahr miurahr added this to the version 2.1 milestone Apr 13, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants