Skip to content

Latest commit

 

History

History
28 lines (20 loc) · 1010 Bytes

README.md

File metadata and controls

28 lines (20 loc) · 1010 Bytes

online-marketplace-scraper

Scrape an online marketplace for their listings.

Installation

Clone this repo to your machine https://github.com/radihuq/online-marketplace-scraper.git

Dependencies

This scraper uses the simple_html_dom_PHP library. You can find the original project here, or check out an uploaded repo here.

Usage

  1. (Optional) uncomment & provide database credentials to write to database
  2. Edit the $file variable with the website you wish to scrape.
  3. Edit the $pages variable with the maximum number of pages you wish to scrape
  4. Run the script

Screenshot

Console Screenshot With Parsed Data

Limitations

This scraper was built for & tested on one online marketplace; it probably will not work with many other online marketplaces.

Author

This scraper was created by Radiun Huq. You can reach him at:

Email: radi@mrhuq.com

Twitter: @radiunhuq