Skip to content

hallelx2/Web-Scrapers

Repository files navigation

Job Scraper Project

Introduction

This project is a collection of web scrapers designed to extract job postings from popular job search websites such as Indeed, SimplyHired, and Google. The scrapers use Selenium for web page automation and Beautiful Soup for parsing HTML content.

Author

  • Halleluyah Darasimi Oludele

Installation

To set up this project on your local machine, follow these steps:

  1. Clone the repository to your local machine.

  2. Install the required dependencies using pipenv:

  3. Run the scrapers using the provided scripts.

Usage

To use the scrapers, execute the following commands:

  • For Indeed scraper: python scrape_indeed.py

  • For SimplyHired scraper: python scrape_simplyhired.py

  • There are jupyter notebooks available for the scraping and you can run your code directly in them

Dependencies

  • Selenium: Python library for web automation.
  • Beautiful Soup: Python library for parsing HTML and XML documents.

License

This project is licensed under the MIT License - see the LICENSE file for details.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published