Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add new HTTP client curl-cffi #292

Closed
siddiqkaithodu opened this issue Jul 12, 2024 · 1 comment · Fixed by #387
Closed

Add new HTTP client curl-cffi #292

siddiqkaithodu opened this issue Jul 12, 2024 · 1 comment · Fixed by #387
Assignees
Labels
enhancement New feature or request. t-tooling Issues with this label are in the ownership of the tooling team.

Comments

@siddiqkaithodu
Copy link
Contributor

siddiqkaithodu commented Jul 12, 2024

Since we use HTTPX , Isn't better to use curl_cffi instead or use it an optional client that switches when the HTTPX gets defeated in the AntiBot war.

I am thinking about intelligently switching between multiple http clients. (The same as of proxy rotation)

@fnesveda fnesveda added the t-tooling Issues with this label are in the ownership of the tooling team. label Jul 12, 2024
@vdusek vdusek added the enhancement New feature or request. label Jul 15, 2024
@vdusek
Copy link
Collaborator

vdusek commented Jul 15, 2024

Hi, thanks for the issue. I think we can split this one into two parts. First, we can (probably, needs further investigation) switch from httpx to curl_cffi, which seems better meet our use-case. The second part would be the switching, which should be part of a separate issue/discussion.

@vdusek vdusek assigned vdusek and janbuchar and unassigned vdusek Jul 16, 2024
@vdusek vdusek added this to the 94th sprint - Tooling team milestone Jul 16, 2024
@vdusek vdusek assigned vdusek and unassigned janbuchar Jul 22, 2024
@vdusek vdusek changed the title Curl Cffi Client Add new HTTP client curl-cffi Jul 31, 2024
@vdusek vdusek closed this as completed in 9c06260 Aug 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request. t-tooling Issues with this label are in the ownership of the tooling team.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants