Skip to content

The script will visit the specified website using random proxies and user agents, and log the visit details to the console.

License

Notifications You must be signed in to change notification settings

rumbis/Proxy-Scraper-and-Visit-Script

Repository files navigation

# Proxy Scraper and Visit Script

This repository contains a Python scraper and a JavaScript visit script for web scraping and website visits.

## Python Scraper

The Python scraper is built using [Beautiful Soup](https://www.crummy.com/software/BeautifulSoup/bs4/doc/) library and [Requests](https://docs.python-requests.org/en/latest/) library for making HTTP requests.

### Prerequisites

- Python 3.x
- Beautiful Soup library
- Requests library

### Usage

1. Install the required dependencies:

   ```bash
   pip install beautifulsoup4 requests
  1. Modify the scraper.py file to specify the target website and the data you want to scrape.

  2. Run the scraper.py file:

    python scraper.py
  3. The scraped data will be displayed in the console or saved to a file, depending on your implementation.

JavaScript Visit Script

The JavaScript visit script uses Puppeteer library for automated website visits.

Prerequisites

  • Node.js
  • Puppeteer library

Usage

  1. Install the required dependencies:

    npm install puppeteer
  2. Modify the visit.js file to specify the target websites, proxies, user agents, and other options as needed.

  3. Run the visit.js file:

    node visit.js
  4. The script will visit the specified website using random proxies and user agents, and log the visit details to the console.

About

The script will visit the specified website using random proxies and user agents, and log the visit details to the console.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published