A Scrapy-based Flickr API scraper to download images based on user-defined categories and tags. Ideal for creating categorized image datasets.
- Downloads images across multiple user-defined categories.
- Allows setting unique tags and image limits for each category.
- Python 3.6 or higher
- Scrapy
Clone the repository and install Scrapy:
git clone https://github.com/deepinvalue/flickr-scraper.git
cd flickr-scraper
pip install scrapy
- Rename
config.sample.json
toconfig.json
. - Edit
config.json
with your Flickr API key, specify the images storage path, and detail each category with its tags and image limits.
scrapy crawl flickr