Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

literotica.com: Get Story URLs from Web Page with 'Show More' author list #1075

Open
CountZero85 opened this issue May 30, 2024 · 2 comments

Comments

@CountZero85
Copy link

I noticed on literotica that when authors have a lot of individual stories (enough that the indicator shows load more ) or very long series it will only scrape a portion of the authors works

ex https://www.literotica.com/authors/BlaQQuill/works/stories , Blaquil it scrapes till volume 64 not 65

or a more extreme example

JukeboxEMCSA ; https://www.literotica.com/authors/JukeboxEMCSA/works/stories

Has over 700 stories only scrapes 50 or so

@JimmXinu
Copy link
Owner

The site limits the author story list now and uses javascript to fetch more data when you click 'Show More'. FFF doesn't have javascript.

As a work around, after you've clicked 'Show More', you can select the text on the page containing the story links you want, and then if you drag/drop the selected text into FFF's download URLs edit box, FFF will pick out the story URLs.

If someone wants to put in the effort, it should be possible to override the before_get_urls_from_page() and/or get_urls_from_page() methods for the literotica adapter.

@JimmXinu JimmXinu changed the title literotica.com incorrect scrapping literotica.com: Get Story URLs from Web Page with 'Show More' author list May 30, 2024
@dbhmw
Copy link
Contributor

dbhmw commented Jan 6, 2025

@CountZero85 Could you try this FanFicFare-calibre.zip? This version is from this repo if you want to build it yourself.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants