This would have multiple GUI programs to scrap pages using PySide6 and BeautifulSoup.
GUI based advanced web-scrappers. Scrapping can be applied to many use cases for instance, downloading images from a given web-page.
This you can find in the file named 'gui_pyqt6_scrapper.py'. You can scrap a given page using multiple web-agents. It is important to keep switching agents to avoid getting blocked by websites under suspicion. This scrapper allows you to search for given tags in the page for example, you can search for all occurrences of h1 tag, p tag and so on. Additionally, you can download all the images from a scrapped page in a given folder which you get to choose.
- Create a Virtual Environment using Python
- Install packages in requirements.txt
That's it, ready to run the program. Pyside6/PyQt6 are bulky packages which can consume upto 1 GB on your system but they're like very feature rich and advanced compared to Tkinter.
- Any operating system with Python 3 installed should work.
- Pyside6/PyQt6
- BeautifulSoup
- Requests
- Generic familiarity with web scrapping
- Simply run the file once virtual environment is activated and relevant packages are installed.
python gui_pyqt6_scrapper.py
Contributors names and contact info
ex. Apfirebolt - @amitprafull
This project is licensed under the MIT License - see the LICENSE.md file for details