Utilizing Scrapy to scrape data, which is then stored in a PostgreSQL database and visualized through an HTML-based web server, all within a Dockerized environment.
- Install Docker on your system.
- Install Git (if not already installed).
-
Clone the repository:
git clone https://github.com/stehlfi1/Scrapy-reality-project.git
-
Navigate to the project directory:
cd Scrapy-reality-project
-
Build and Launch the Docker Compose:
docker-compose up --build
-
Access App:
- Open your web browser and go to
http://localhost:8070
.
- Open your web browser and go to
-
To Stop the Services:
docker-compose down
- If facing authentication errors, make sure to restart the Docker containers.
docker-compose down docker-compose up