"I use the same proxy for requests to 300 websites from china, and httpx and requests behave completely differently."

[wjsw1781]

same code ,same proxies!
success rate verry diffrrence

this is requests success rate!

this is httpx success rate!

I am a user from China. I suspect that when using a proxy with requests, the process of obtaining the DNS IP does not go through the proxy, or it directly uses the system's DNS to obtain the IP. At this point, it has already been intercepted by the Great Firewall of China, leading to the retrieval of an incorrect IP and ultimately causing a SOCKSHTTP timeout. However, httpx does not have this issue. I think it might be a bug in requests, but I can't find the cause. I also don't know how to fix it.

Since our project extensively uses the requests library, we cannot quickly switch to httpx. I hope you can help me solve this bug. We have debugged up to the point of establishing the SOCKS connection and found that both are the same, but the final success rates are completely different. httpx can achieve a 90% success rate, while requests only reaches a 20% success rate.

I would prefer to know and fix this bug.

[wjsw1781]

this is my website_list! the proxies server in oversea!

in china ,if not use proxies, success rate is 0%!
in china , if use proxies ,requests can to 20%!
in china , if use proxies ,httpx can to 90%!

I think the design of proxies in requests is worse than in httpx, but I don't know exactly where it falls short.

https://google.es
https://world.wng.org
https://cna.com.tw
https://partycasino.com
https://appspot.com
https://bitchute.com
https://taiwandaily.net
https://ndr.de
https://hdzog.com
https://pornhubpremium.com
https://spark.adobe.com
https://diamond.jp
https://livemint.com
https://japantimes.co.jp
https://cfr.org
https://android.com
https://vyprvpn.com
https://viber.com
https://christianpost.com
https://vpn.ht
https://google.sk
https://atc.org.au
https://dailymail.co.uk
https://pinterest.com
https://setn.com
https://gfkari.blog.jp
https://scmp.com
https://cyberprotection.pro
https://thumbzilla.com
https://spaceplace.nasa.gov
https://shadowsocks.org
https://ultravpn.com
https://thewire.in
https://epochtimes.com
https://pixiv.net
https://tube8.com
https://pchome.com.tw
https://ghostpath.com
https://Pastebin.com
https://fox.com
https://google.ae
https://project-syndicate.org
https://virginia.gov
https://surfshark.com
https://radio.garden
https://switchvpn.net
https://thejakartapost.com
https://lazygirls.info
https://tiktok.com
https://myfreecams.com
https://totheglory.im
https://news.google.com
https://bastillepost.com
https://archive.org
https://pornhub.com
https://acevpn.com
https://camfrog.com
https://business-humanrights.org
https://torproject.org
https://bloomberg.com
https://voyager.jpl.nasa.gov
https://udn.com
https://hk01.com
https://cyberghostvpn.com
https://adult-empire.com
https://wikileaks.org
https://hongkongfp.com
https://warontherocks.com
https://cbc.ca
https://asia.nikkei.com
https://kucoin.com
https://rfa.org
https://cdn.v2ex.com
https://av28.com
https://mobile.abc.net.au
https://pds.nasa.gov
https://danawa.com
https://bild.de
https://vocaroo.com
https://google.co.jp
https://yadi.sk
https://vine.co
https://pornhublive.com
https://tibet.net
https://nbc.com
https://9522bet.com
https://focus.de
https://wionews.com
https://zoom.us
https://epochstories.com
https://afr.com
https://clips4sale.com
https://hurriyet.com.tr
https://dalailama.com
https://lemonde.fr
https://periscope.tv
https://rthk.hk
https://zippyshare.com
https://theinitium.com
https://limetorrents.info
https://m-team.cc
https://plurk.com
https://twitpic.com
https://purevpn.com
https://vpnmentor.com
https://avg.com
https://newyorker.com
https://peoplenews.tw
https://usmgtcg.ning.com
https://chinamediaproject.org
https://rfi.fr
https://breitbart.com
https://google.hu
https://theporndude.com
https://nutaku.net
https://google.com
https://indianexpress.com
https://freedomhouse.org
https://secretchina.com
https://hidemyass.com
https://jp.tube8.com
https://kabochan.blog.jp
https://falundafa.org
https://huffpost.com
https://theconversation.com
https://fembed.com
https://spiegel.de
https://gofundme.com
https://youporn.com
https://gric.pixnet.net
https://ruten.com.tw
https://bitmex.com
https://deviantart.com
https://tigervpn.com
https://vpnunlimitedapp.com
https://nownews.com
https://upmedia.mg
https://runescape.com
https://allmusic.com
https://Etherscan.io
https://brazzers.com
https://thenewslens.com
https://efukt.com
https://foreignpolicy.com
https://marine.rutgers.edu
https://google.pt
https://classified.creaders.net
https://zerohedge.com
https://slideshare.net
https://newtalk.tw
https://digifinex.com
https://hrw.org
https://4everproxy.com
https://toomics.com
https://citizenpowerforchina.org
https://sponichi.co.jp
https://windscribe.com
https://radio.nrk.no
https://wikimedia.org
https://proxysite.com
https://adultism.com
https://robotics.jpl.nasa.gov
https://twitcasting.tv
https://Snapchat.com
https://rusvpn.com
https://t66y.com
https://google.rs
https://blogspot.com
https://apkmirror.com
https://economist.com
https://jkforum.net
https://spys.one
https://welt.de
https://thetibetpost.com
https://4shared.com
https://hbo.com
https://nicovideo.jp
https://biggo.com.tw
https://vpnsecure.me
https://privatevpn.com
https://phayul.com
https://line.me/en/
https://hangouts.google.com
https://asiaone.com
https://newslanes.com
https://anyporn.com
https://google.bg
https://touchvpn.net
https://digg.com
https://disqus.com
https://nhentai.net
https://messages.android.com
https://thediplomat.com
https://messenger.com
https://wikibooks.org
https://bbc.com
https://xvideos.com
https://hoover.org
https://mastodon.social
https://sendspace.com
https://dailymotion.com
https://google.com/drive
https://Feedburner.com
https://strongvpn.com
https://vpn.ac
https://Blogger.com
https://protonvpn.com
https://n-tv.de
https://xtube.com
https://sueddeutsche.de
https://CEX.io
https://e-hentai.org
https://hanime.tv
https://forever21.com
https://vpncity.com
https://amnesty.org
https://ko.vpnmentor.com
https://handelsblatt.com
https://n6matome.blog.jp
https://twitch.tv
https://afreecatv.com
https://rawstory.com
https://thepolicy.us
https://youjizz.com
https://independent.co.uk
https://hideipvpn.com
https://Picasa.google.com
https://nrk.no
https://dropbox.com
https://hulu.com
https://timesofindia.indiatimes.com
https://ishr.ch
https://theintercept.com
https://ug.wiktionary.org
https://wretch.cc
https://9news.com.au
https://milliyet.com.tr
https://hqporner.com
https://yomou.syosetu.com
https://ndtv.com
https://qz.com
https://jiji.com
https://plus.google.com
https://theepochtimes.com
https://eporner.com
https://storm.mg
https://slate.com
https://sankei.com
https://bbc.co.uK
https://4cdn.org
https://onejav.com
https://windy.com
https://haberturk.com
https://spankwire.com
https://greatfire.org
https://flickr.com
https://hide.me
https://islamqa.info
https://trust.zone
https://playstation.com
https://towardsdatascience.com
https://tumblr.com
https://ipvanish.com
https://france24.com
https://google.kz
https://todayonline.com
https://pressenza.com
https://rsf.org
https://badoo.com
https://rferl.org
https://lesoir.be
https://duckduckgo.com
https://dailytelegraph.com.au
https://taiwannews.com.tw
https://pornhd.com
https://SoundCloud.com
https://middleeasteye.net
https://home.gamer.com.tw
https://tunnelbear.com
https://heise.de
https://4chan.org
https://wattpad.com
https://tineye.com
https://cleanadulthost.com
https://wilsoncenter.org
https://goodreads.com
https://istockphoto.com
https://beeg.com
https://thehindu.com
https://dizionari.corriere.it
https://nytimes.com
https://Hootsuite.com
https://channelnewsasia.com
https://tagesschau.de
https://avgle.com
https://getlantern.org
https://flipboard.com
https://freetibet.org
https://tapatalk.com
https://whatsapp.com
https://dlsite.com
https://imagefap.com
https://europapress.es
https://eyny.com
https://news.on.cc
https://time.com
https://airasia.com
https://localbitcoins.com
https://inoreader.com
https://instagram.com
https://google.gr
https://tnaflix.com
https://knowyourmeme.com
https://proxy.sh
https://Reddit.com
https://e-ir.info
https://pri.org
https://reuters.com
https://bravotube.net
https://imgur.com
https://fxnetworks.com
https://newsweekjapan.jp
https://gumroad.com
https://openvpn.net
https://books.com.tw
https://binance.com
https://vanpeople.com
https://abc.net.au
https://nbcnews.com
https://fc2.com
https://Ask.com
https://pornpics.com
https://google.dk
https://cam4.com
https://sat.gob.mx
https://expressvpn.com
https://facebook.com
https://archiveofourown.org
https://vimeo.com
https://rule34.xxx
https://google.nl
https://theatlantic.com
https://hrf.org
https://jamestown.org
https://unwire.hk
https://goosevpn.com
https://frontlinedefenders.org
https://ttv.com.tw
https://google.co.kr
https://medium.com
https://hotnewhiphop.com
https://disp.cc
https://github.com
https://tw.appledaily.com
https://youtube.com
https://turbobit.net
https://drtuber.com
https://nordvpn.com
https://bitfinex.com
https://aljazeera.com
https://fastestvpn.com
https://tibetcesky.blogspot.com
https://hk.appledaily.com
https://ntdtv.com
https://straitstimes.com
https://privateinternetaccess.com
https://ign.com
https://cecc.gov
https://change.org
https://fivethirtyeight.com
https://wikipedia.org
https://feedly.com
https://xnxx.com
https://ustream.tv
https://mag2.com
https://syfy.com
https://yomiuri.co.jp
https://tibet.ca
https://dailysabah.com
https://voanews.com
https://womany.net
https://wsj.com
https://heritage.org
https://international.thenewslens.com
https://minghui.org
https://haroprocloset.blog.jp
https://rutube.ru
https://mingpao.com
https://theguardian.com
https://businessinsider.com
https://hotspotshield.com
https://startpage.com
https://humanrightshouse.org
https://cactusvpn.com
https://russian.rfi.fr

[wjsw1781]

我知道原因所在了
感谢 requests 和 httpx 的设计