You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If we extract the WARC write code from the spider and then create a WARC read routine we can implement a scrapy cache storage which reads and writes WARC files. This could be very handy to create archives from running old spiders just changing the cache setting.
The text was updated successfully, but these errors were encountered:
If we extract the WARC write code from the spider and then create a WARC read routine we can implement a scrapy cache storage which reads and writes WARC files. This could be very handy to create archives from running old spiders just changing the cache setting.
The text was updated successfully, but these errors were encountered: