Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

JAV Library Scraper Broke #112

Open
Zero177768 opened this issue May 14, 2024 · 8 comments
Open

JAV Library Scraper Broke #112

Zero177768 opened this issue May 14, 2024 · 8 comments
Labels
bug Something isn't working Cloudflare issue The issue is due to a Cloudflare challenge or protection.

Comments

@Zero177768
Copy link

JavLibrary Scraper is throwing a 403 error.
If I manually run it will find the info but can not access it to download.
See screen shots.
Screenshot 2024-05-13 195807
Screenshot 2024-05-13 195918
Screenshot 2024-05-13 195957
Screenshot 2024-05-13 200037

Thanks :)
Troy

@Zero177768
Copy link
Author

I think this is a CloudFlare issue

@Zero177768
Copy link
Author

Untitled

@Zero177768
Copy link
Author

But This one works After I pass Cloud
Untitled2
Flare

@Zero177768
Copy link
Author

Is there an Addon for Ember that can pass cloud Flare ?
Or is this not possible?

@Zero177768
Copy link
Author

I can get Plex to pull Metadata using the instructions below, But Plex does not add the posters and metadata to the folder where the file is located only ember will do that.

Here are the instructions for plex to pull Metadata:

https://github.com/Xavier-Lam/JAV.bundle?tab=readme-ov-file

JAVLibrary
Recently, JAVLibrary reenabled cloudflare challenge. To bypass it, you have to follow these steps:

  1. Visit JAVLibrary on your server and pass the challenge.

  2. After you can see content on JAVLibrary

     2.1)open developer tools of your browser by pressing F12,
    
     2.2)refresh the page
    
     2.3)choose Network tab and select Doc
    
     2.4)choose the first request, copy the User-Agent header in your request and cf_clearance cookie value to the 
           configuration in your plex agent Settings
    

Note:

The source IP address you visit JAVLibrary should be identical to your plex server outbound IP address, if you are using a proxy, the address would be the outbound IP address of your proxy;
The cf_clearance value may change frequently, especially when you are using a proxy, every time your IP changes, the cf_clearance changes;
Every time you update your browser, the User-Agent would change.
Or simply, you can use this project: CF-Clearance-Scraper to get cf_clearance cookie.

@adultmm
Copy link
Owner

adultmm commented Jul 10, 2024

Yes, this scraper is broken because of the CloudFlare challenge. Unfortunately, I haven't found any solution for this type of challenge yet, and FlareSolverr doesn't work with it either.

Every idea or solution for this problem is very welcome.

@adultmm adultmm added bug Something isn't working Cloudflare issue The issue is due to a Cloudflare challenge or protection. labels Jul 10, 2024
@adultmm
Copy link
Owner

adultmm commented Jul 10, 2024

The CF-Clearance-Scraper is not working either.

python main.py -v -f cookies.json https://www.javlibrary.com/en/?v=javme5tj34
[19:14:24] [INFO] Launching headless browser...
[19:14:26] [INFO] Going to https://www.javlibrary.com/en/?v=javme5tj34...
[19:14:27] [INFO] Solving Cloudflare challenge [Managed]...
[19:14:58] [ERROR] Failed to retrieve a Cloudflare clearance cookie.

@adultmm
Copy link
Owner

adultmm commented Aug 16, 2024

Jav.Guru scraper has been implemented in v1.0.0-beta2.

There isn't runtime information and fewer images, but it works as far as I could test. Give it a try and let me know if you find any problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Cloudflare issue The issue is due to a Cloudflare challenge or protection.
Projects
None yet
Development

No branches or pull requests

2 participants