$ pip install scrapy scrapy-splash
$ docker run -p 8050:8050 scrapinghub/splash
Modify SPLASH_URL in settings.py to you IP Address.
SPLASH_URL = 'http://192.168.99.100:8050'
Run spider
$ cd bgp_bots
$ scrapy crawl BGPSpider -o BGP.json
-
Notifications
You must be signed in to change notification settings - Fork 0
p0we7/bgp_sample
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
BGP Crawler
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published