scrapy爬虫，配合无头浏览器splash使用。
- 启动splash的容器：
docker run -itd -p 8050:8050 scrapinghub/splash
- 进入conda环境：
conda activate scrapy
- 创建爬虫
scrapy startproject xxx
cd xxx
scrapy genspider example example.com
- 启动爬虫
cd xxx
scrapy crawl example-
Notifications
You must be signed in to change notification settings - Fork 0
License
XinyuDu/scrapy
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published