Web scraper to get the financial numbers of a company
- Install scrapy and selenium
- Download the chrome webdriver
- Download the files
- In terminal, run the command './scraper'
This scraper was designed for investing.com and yahoo finance
This was designed for linux systems
The most crucial file that contains the spider is /investing-spider/investing_scraper/investing_scraper/spiders/my_investing.py
This file contains the scrapy + selenium code
The file scraper is just bash code designed to make input easier