This is a simple web scraper that scrapes a website and saves the data to a SQLite database. It uses Node.js and the Cheerio library for scraping the website, and the sqlite3 library for working with the database.
To install the necessary packages, run the following command:
npm install
To run the scraper, use the following terminal command:
node index.js
This will scrape the website and save the data to a SQLite database. If the database file does not exist, it will be created.
scraper/scraper.js- Contains the function for scraping the website.database/createDB.js- Contains the function for creating the SQLite database.database/database.js- Contains the functions for working with the SQLite database.index.js- The main file that runs the scraper and saves the data to the database.
This project is licensed under the MIT License - see the LICENSE file for details.