Extracting videos from twitter links

[JCatesPH]

I am going to start working on a way to extract videos from twitter links so they may be rehosted easily. I will be using python and Twitter's API.

Let me know if this is helpful or my skills can be redirected to something better.

[Ghostwaffles]

I've been using https://www.savetweetvid.com/ as a bootleg solution, it's not too efficient but it works. Maybe something similar?

[JCatesPH]

They may be using the python-twitter API in that. It would be similar, but I also wanted it to store them based on location and log data about them in json or other format.

[craigjsmith]

Take a look at https://github.com/ytdl-org/youtube-dl. Command line program for downloading video from most sites, including Twitter. Super easy to implement in any application.

[JCatesPH]

Thank you @craigjsmith ! I found it before seeing your response but am using that now.

[craigjsmith]

Nice, let me know if I can help. I think it's important that we get the videos extracted asap, many will be deleted!

[miker2049]

fyi, from the thread on #32, @hunterwilliams shared a node app that, if feasible, just needs to be integrated

[Ghostwaffles]

I have all the videos here downloaded and organized (somewhat), I can begin to upload them to Google Drive or somewhere else if you want

[hunterwilliams]

Yeah if you wanted it can be integrated or used to help with overall archiving process including twitter. https://github.com/hunterwilliams/link-archival - 100% made with this purpose in mind. It doesn't use any official apis which is both a plus and minus. Will continue to improve it if it seems useful or integrate if desired.

[JCatesPH]

Oh that's great @hunterwilliams . I wrote a gui tool with the hope of making submission as easy as possible but realized downloading an executable defeats the purpose.

I am coming from the computational science side so don't worry about user interface usually.

The tool I wrote is mostly using https://github.com/ytdl-org/youtube-dl without many additions, but I could make it add or extract links/entries from a csv file if desired.

[JCatesPH]

Perhaps the easiest option is just periodically feeding the .md files through the tool at https://github.com/hunterwilliams/link-archival

I was trying to make a low-tech person able to submit as easily as possible.

[valadect]

Ive created a shell script that will download all the videos available youtube twitter etc and also screenshot all the webpages, it will also store them in their respected geographical location. https://github.com/valadect/pbbackup

[JCatesPH]

You are the best @valadect