Skip to content

Latest commit

 

History

History
36 lines (30 loc) · 1.17 KB

README.md

File metadata and controls

36 lines (30 loc) · 1.17 KB
Raw

Wayback-Tool

A tool to fetch and verify the existence of endpoints from the Wayback Machine API.

Features

  • Pull urls from Wayback Machine
  • Check those urls and provide url, status code, response length, content-type, and redirect url
  • Multithreaded
  • Load and output to/from file
  • Accepts stdin as input
  • Optimizations made around old domains and timeouts

Usage:

Fetch urls:

$ python waybacktool.py pull --host example.com  
http://example.com/example.html  
https://example.com/testing.js  
https://example.com/test.css

Check urls:

$ python waybacktool.py pull --host example.com | python waybacktool.py check 
http://example.com/example.html, 200, 1024, text/html
https://example.com/testing.js, 301, 58, text/plain; charset=utf-8, https://example.com/testing1234.js
https://example.com/test.css, 403, 103, text/html

The reason this was designed in two pieces is that you can apply grep transformations to the output of the fetch urls. For example, the following is a valid use:

$ python waybacktool.py pull --host example.com | grep html | python waybacktool.py check 
http://example.com/example.html, 200, 1024, text/html

Hope you all can use this!