Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[pixiv] artwork not downloading #6339

Closed
mmoisall opened this issue Oct 18, 2024 · 4 comments
Closed

[pixiv] artwork not downloading #6339

mmoisall opened this issue Oct 18, 2024 · 4 comments
Labels
duplicate site:change

Comments

@mmoisall
Copy link

it supposed to download user's all artwork but missing one of them

gallery-dl https://www.pixiv.net/users/56514424
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-09-06 112630 - samoinu - pixiv - 雨-0(84199360_p0).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-09-01 135800 - samoinu - pixiv - 9月-0(84093524_p0).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-08-27 124309 - samoinu - pixiv - 日周-0(83972265_p0).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-07-29 153509 - samoinu - pixiv - 夏-0(83314977_p0).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-07-24 025538 - samoinu - pixiv - おはよう。-0(83182542_p0).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-07-22 030945 - samoinu - pixiv - ⭐️-0(83137722_p0).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-07-21 115255 - samoinu - pixiv - 背景-0(83124871_p0).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-07-21 115255 - samoinu - pixiv - 背景-1(83124871_p1).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-07-21 115255 - samoinu - pixiv - 背景-2(83124871_p2).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-07-21 115255 - samoinu - pixiv - 背景-3(83124871_p3).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-07-21 115255 - samoinu - pixiv - 背景-4(83124871_p4).png

but it's working when I use the artwork's link

gallery-dl https://www.pixiv.net/artworks/85960783
[pixiv][warning] 85960783: 'sanity_level' warning
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-0(85960783_p0).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-1(85960783_p1).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-2(85960783_p2).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-3(85960783_p3).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-4(85960783_p4).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-5(85960783_p5).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-6(85960783_p6).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-7(85960783_p7).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-8(85960783_p8).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-9(85960783_p9).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-10(85960783_p10).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-11(85960783_p11).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-13(85960783_p13).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-14(85960783_p14).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-15(85960783_p15).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-16(85960783_p16).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-17(85960783_p17).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-18(85960783_p18).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-19(85960783_p19).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-20(85960783_p20).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-21(85960783_p21).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-22(85960783_p22).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-23(85960783_p23).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-24(85960783_p24).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-25(85960783_p25).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-26(85960783_p26).png
.\gallery-dl\pixiv - 56514424 - samoinu -\2020-11-28 103300 - samoinu - pixiv - 2020-1-27(85960783_p27).png

my config

    "pixiv": {
      "directory": [
        "pixiv - {user[id]} - {user[name]} -"
      ],
      "filename": "{date:%Y-%m-%d %H%M%S} - {user[name]} - pixiv - {title}-{num}({filename}).{extension}",
      "refresh-token": "*****",
      "sanity-level": 6,
      "ugoira": true,
    },

version : gallery_dl 1.27.6

what should I do to download all images with user id?
@mikf
Copy link
Owner

mikf commented Oct 18, 2024

Duplicate of #4327

@mikf mikf marked this as a duplicate of #4327 Oct 18, 2024
@mikf
Copy link
Owner

mikf commented Oct 18, 2024

You've already opened another issue in this regard: #5435

/artwork/ URLs work now, but downloading restricted works by user ID has not been resolved yet.

@mikf mikf moved this to Pixiv Sanity Level in v1.27.6 Oct 18, 2024
@mikf mikf added this to v1.27.6 Oct 18, 2024
@espressoelf
Copy link

espressoelf commented Oct 21, 2024 •
edited
Loading

/artwork/ URLs work now, but downloading restricted works by user ID has not been resolved yet.

Does this apply to downloads initiated from a bookmarks-list, too? I'm trying to download my favorites, https://www.pixiv.net/en/users/0000000/bookmarks/artworks?rest=hide, and there's one favorite that makes gallery-dl crash. I'm running the dev version, pulled 2024-10-19 20:26:24.

[urllib3.connectionpool][debug] https://www.pixiv.net:443 "GET /ajax/illust/104582860 HTTP/11" 404 37
[pixiv][error] An unexpected error occurred: TypeError - 'NoneType' object is not subscriptable (key 'urls'). Please run gallery-dl again with the --verbose flag, copy its output and report this issue on https://github.com/mikf/gallery-dl/issues .
[pixiv][debug]
Traceback (most recent call last):
  File "/opt/pypy/lib/pypy3.10/site-packages/gallery_dl/job.py", line 151, in run
    for msg in extractor:
  File "/opt/pypy/lib/pypy3.10/site-packages/gallery_dl/extractor/pixiv.py", line 65, in items
    files = self._extract_files(work)
  File "/opt/pypy/lib/pypy3.10/site-packages/gallery_dl/extractor/pixiv.py", line 122, in _extract_files
    return self._extract_ajax(work, body)
  File "/opt/pypy/lib/pypy3.10/site-packages/gallery_dl/extractor/pixiv.py", line 189, in _extract_ajax
    url = self._extract_ajax_url(body)
  File "/opt/pypy/lib/pypy3.10/site-packages/gallery_dl/extractor/pixiv.py", line 243, in _extract_ajax_url
    original = body["urls"]["original"]
TypeError: 'NoneType' object is not subscriptable (key 'urls')

The ajax call returns

{"error":true,"message":"","body":[]}

I hope this isn't the wrong issue, there's quite a lot of them open currently.

mikf added a commit that referenced this issue Oct 22, 2024
@mikf
[pixiv] fix exception when processing deleted sanity_level work (#6339)
2d15e64 
#6339 (comment)
mikf added a commit that referenced this issue Oct 22, 2024
@mikf
[pixiv] implement 'sanity_level' workaround for user artworks results
7567494 
(#4327, #5435, #6339)
@mikf
Copy link
Owner

mikf commented Oct 22, 2024 •
edited
Loading

Detecting limit_sanity_level works for /users/ID/artworks results is now possible: 7567494. It needs a PHPSESSID cookie to be able to detect R-18 works, though.

@espressoelf Should be fixed in 2d15e64. It previously caught only some but not all exceptions when handling empty results.

@mikf mikf closed this as completed Oct 22, 2024
@topchaser topchaser mentioned this issue Oct 27, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
duplicate site:change
Projects
No open projects
v1.27.6
Status: Pixiv Sanity Level
Milestone
No milestone
Development

No branches or pull requests
3 participants
@espressoelf @mikf @mmoisall