purl

proxy urls

A simple script to proxy full urls from stdin through your favorite http proxy tool very quickly for analysis

Usage:

Examples:

$ cat urls.txt | purl -p http://127.0.0.1:8080 -c 50
$ cat domains.txt | httprobe --prefer-https -c 50 | waybackurls | purl -p http://127.0.0.1:8080
$ cat resolved.txt | gau -b png,jpg,gif | purl -p http://127.0.0.1:8080

$ purl -help

Flag	Description	Example
-p	specify http proxy	cat resovled.txt | purl -p http://127.0.0.1:8080
-h	specify header/s to include in every request. Supports duplicate flags	cat resovled.txt | purl -p http://127.0.0.1:8080 -h "X-Forwarded-For: example.com" -h "X-Wife: divorced"
-H	specify file path that contains a list of headers to use. This will resend the same url(request) but with the next header in the file. Use -h flag for headers you want to include in every request	cat resovled.txt | purl -p http://127.0.0.1:8080 -H headers.txt
-b	specify cookie VALUE to include in request	cat resovled.txt | purl -p http://127.0.0.1:8080 -b "cookie value"
-B	specify file path that contains the cookie VALUE to include in request	cat resovled.txt | purl -p http://127.0.0.1:8080 -B cookie.txt
-c	set the concurrency. Default value 1. Use this setting to increase the rate at which the urls are sent to your proxy tool.	cat resovled.txt | purl -p http://127.0.0.1:8080 -c 5
-t	set the timeout in milliseconds. Default 10000. If you are getting any timeout errors, increase this	cat resovled.txt | purl -p http://127.0.0.1:8080 -t 100000

$ go get -u github.com/dumorewithcode/purl