Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Danbooru] Prevents download whole source gallery. #2025

Open
gphg opened this issue Nov 14, 2021 · 2 comments
Open

[Danbooru] Prevents download whole source gallery. #2025

gphg opened this issue Nov 14, 2021 · 2 comments

Comments

@gphg
Copy link

gphg commented Nov 14, 2021

Related to this: #1747

Some source link don't specified the original gallery source link, but the artist galleries instead. It ended up downloads the whole artist gallery. For example, this one.

My suggestion is prevent it or an option to allow download or not.

Link example above aren't the only one. There are many.

mikf added a commit that referenced this issue Nov 23, 2021
Each entry in such a list can now also include a subcategory
'<category>:<subcategory>'
and it is possible to use '*' or an empty string as placeholder
'*:<subcategory>', ':<subcategory>', '<category>:*'

For example
  "blacklist": "imgur,*:tag,gfycat:user" or
  "blacklist": ["imgur", "*:tag", "gfycat:user"]
will filter all 'imgur' extractors, all extractors  with a 'tag'
subcategory (e.g. https://danbooru.donmai.us/posts?tags=bonocho),
and all 'gfycat' user extractors.
@mikf
Copy link
Owner

mikf commented Nov 23, 2021

There are blacklist & whitelist option to select which extractors can be spawned by another, but they could only differentiate between site names like patreon, pixiv, etc.

With 010d65d it is now possible to also select by subcategory and use placeholders, so you can allow only single posts from all sites and reject everything major like user profiles or searches:

"whitelist": ["*:post", "*:image", "*:tweet", "*:work"]

This will only download from Patreon posts, but ignore the user profile link from your example above. Same with Twitter tweets and Pixiv artworks.

mikf added a commit that referenced this issue Jan 6, 2022
and not just in the commit message of 010d65d
@gphg
Copy link
Author

gphg commented Aug 19, 2022

How to get this works on fanbox.cc?

Edit: specific site.

Edit 2: I figured it out. The docs explains whitelist and blacklist. Here's my configuration:

"danbooru": {
  "blacklist": ["fanbox:creator"]
},

Extractors within its subcategory can be views on gallery-dl --list-extractors.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants