IKEA UK Product Scraper

This project is a web scraper for IKEA UK's website. It uses Scrapy to scrape product data and Next.js for the frontend.

Features

• Discover the latest cheapest products from IKEA UK
• Categorize products by room type

Prerequisites

Python scraper

python3 -m venv venv

source venv/bin/activate

pip install -r requirements.txt

Frontend

npm install
# or recommend
bun

Scrape and format data

rm data.jsonl && touch data.jsonl

source venv/bin/activate

scrapy runspider main.py -o data.jsonl

python3 filter.py

• Display the data on a frontend page

npm run dev
# or
bun dev

Open http://localhost:3000 with your browser to see the result.

This is a Next.js project bootstrapped with create-next-app.

Getting Started

First, run the development server:

npm run dev
# or
yarn dev
# or
pnpm dev
# or
bun dev

Learn More

To learn more about Scrapy and Next.js, take a look at the following resources:

• Scrapy Documentation - learn about Scrapy features and API.
• Next.js Documentation - learn about Next.js features and API.

Acknowledgments

• A Stackoverflow about scrape IKEA website
• Inpiration from 宜家特价榜 https://ikea-lp.netlify.app