[Site Request] 4chan Archives

[cheese529]

Imgur will be purging all NSFW content on May 15th which is in less than 10 days and all of the original 4chan archives are hosted using Imgur so it would be nice if we could get a chance to download everything before it gets purged. Here's the website https://4chanarchives.com/ and here's an example thread https://4chanarchives.com/board/hr/thread/2693240

[mikf]

Duplicate of #1262 and #2418

nvm

[cheese529]

do you think it would be possible to get this site added asap? We only have until May 15th before everything on here is purged thx to imgur. I even tried to use chat gpt to write a python script in efforts of doing this but I had zero luck :/

[mikf]

Well, here you go: 1406f71

The board extractor supports starting from a given page, e.g. https://4chanarchives.com/board/c/100

[mikf]

Use this to write metadata for all posts

    "postprocessors": [
        {
            "name": "metadata",
            "event": "post",
            "filename": "{no}.json"
        }
    ]

to only write the posted text, add "format": "{com}"

[cheese529]

Thank you so much for this! Do I just copy that python code and paste it into my gallery-dl folder where the rest of the extractors are in order for it to work?

[mikf]

That wouldn't be enough. What you can do is put this file in a separate directory, potentially fix any gallery_dl imports, and use -X path/to/directory to load additional extractors from it.

Or you grab the new release.

[cheese529]

thank you very much for doing this on such quick notice, it works perfectly!