Skip to content

Scrape a (specific) online marketplace for their listings.

Notifications You must be signed in to change notification settings

radihuq/online-marketplace-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 

Repository files navigation

online-marketplace-scraper

Scrape an online marketplace for their listings.

Installation

Clone this repo to your machine https://github.com/radihuq/online-marketplace-scraper.git

Dependencies

This scraper uses the simple_html_dom_PHP library. You can find the original project here, or check out an uploaded repo here.

Usage

  1. (Optional) uncomment & provide database credentials to write to database
  2. Edit the $file variable with the website you wish to scrape.
  3. Edit the $pages variable with the maximum number of pages you wish to scrape
  4. Run the script

Screenshot

Console Screenshot With Parsed Data

Limitations

This scraper was built for & tested on one online marketplace; it probably will not work with many other online marketplaces.

Author

This scraper was created by Radiun Huq. You can reach him at:

Email: radi@mrhuq.com

Twitter: @radiunhuq

About

Scrape a (specific) online marketplace for their listings.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages