-
Notifications
You must be signed in to change notification settings - Fork 740
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix: decode special characters in proxy username
and password
#2696
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The changes seem safe enough to me, so feel free to merge.
My question is: do we know the actual mechanism of where the bug (from the Slack thread) is originating? I cannot find a single use of proxyInfo.username
or .password
in Crawlee codebase (we always just parse it from the URL with decodeURIComponent
).
Btw. if somebody is expecting the |
I guess some custom handling, I am also not entirely sure. I would guess they work with the response of
Yes, if someone was too lazy to report a bug and instead implemented a workaround without telling us, their code will break. Not much we can do about that, to me this is a clear bug. |
Also note that this is inconsistent with the SDK, if you use the proxy config password option, there is no encoding, if you use a proxy URL with the password, it will be encoded. This only confirms that we really should fix it. I asked for more details about the actual problem, but we should do this regardless of that I'd say. |
* fix: decode special characters in proxy `username` and `password` Related: apify/crawlee#2696 * encode username and hostname in `composeDefaultUrl`
When using
newProxyInfo
function, theusername
andpassword
extracted fromproxyUrl
are now properly decoded.https://apify.slack.com/archives/C0L33UM7Z/p1727966399183259