Node script that will use Selenium to scrape card information from NBA Topshot including card names, rarity, and lowest cost at the moment.
Explore the docs »
View Demo
·
Report Bug
·
Request Feature
Node script that will use Selenium to scrape card information from NBA Topshot including card names, rarity, and lowest cost at the moment. This project is a fun way to keep track of the value of NBA moments from NBA Topshot. It relies on the marketplace being available, and the script basically scans all the items that is on the marketplace using selenium to do an infinite scroll + capturing all the data once infinite scroll is completed. At the moment, the script should not take more than 1 hour to run. Optimizations are always welcome.
Data is scraped once per day and updated onto this repo. This data can be found in the data folder and follows the naming convention: topshot_data_${date in mmddyyyy format}.
To get a local copy up and running follow these simple steps.
This is an example of how to list things you need to use the software and how to install them.
- npm
npm install npm@latest -g
- Clone the repo
git clone https://github.com/kennymkchan/nba-topshot-scraper
- Install NPM packages
npm install
- Run the script to start scraping
node index.js
Contributions are what make the open source community such an amazing place to be learn, inspire, and create. Any contributions you make are greatly appreciated.
- Fork the Project
- Create your Feature Branch (
git checkout -b feature/AmazingFeature) - Commit your Changes (
git commit -m 'Add some AmazingFeature') - Push to the Branch (
git push origin feature/AmazingFeature) - Open a Pull Request
Distributed under the MIT License. See LICENSE for more information.
Kenny Chan - @github
Project Link: https://github.com/kennymkchan/nba-topshot-scraper