Scrape Debian Wiki News is a Python script that retrieves content from the Debian Wiki's News page and converts it into Markdown format.
- Clone the repository using Git:
git clone git@github.com:VinneyJ/Debian-News-Scraper.git
-
Navigate to the project folder.
-
Create a virtual environment using virtualenv.
-
Activate the virtual environment:
- On macOS and Linux:
source venv/bin/activate - On Windows:
venv\Scripts\activate
- Install the required dependencies using pip:
pip install -r requirements.txt
- Install the current directory as an editable package.
pip install -e .
After setting up the project and installing the dependencies, you can run the script as follows:
python3 src/scrape_debian.py
This will execute the script, scrape the Debian Wiki News page, and save the content in Markdown format.
You can run the provided tests to ensure the script's functionality:
pytest tests -vv
To format the code use
black . && isort .
To lint the code use
pylint src/ tests/
If you have any questions or need assistance, please don't hesitate to reach out. Thank you for using Scrape Debian Wiki News!