Simple script that scrape for http proxies from Free Proxy List Website, and stored it inside a text file. This script make use of requests and BeautifulSoup4.
- git clone the script
- cd into the folder
jun@b:~$ cd proxy_list_scrapper
- create new virtual environment
jun@b:~$ python3 -m venv .venv
- get into the environment
jun@b:~$ source .venv/bin/activate
- install dependencies
(.venv) jun@b:~$ pip install -r requirements.txt
- run the script.
(.venv) jun@b:~$ python app.py
- get our of virtual environment
(.venv) jun@b:~$ deactivate