Skip to content

A simple web scraper using beautifulsoup and requests

License

Notifications You must be signed in to change notification settings

mushahidq/py_webScraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

f954172 · Mar 31, 2021

History

9 Commits
Apr 9, 2020
Mar 29, 2021
Mar 31, 2021
Apr 26, 2020
Mar 29, 2021
Apr 9, 2020
Mar 29, 2021
Apr 9, 2020
Apr 9, 2020
Apr 9, 2020
Apr 9, 2020

Repository files navigation

py_webScraper

A simple web scraper using beautifulsoup and requests

File Descriptions:

simmpleWebScraper.py : It is a simple web scraper built using requests and beautifulsoup to get data from any website.

googleImages.py : Contains a google images web scraper to obtain images from Google using ChromeWebDriver, Selenium and BeutifulSoup

googleImagesWithRequests.py : This webscraper for google images uses the requests library and beautifulsoup. sampleGoogleImages.html : This is the page which is obtained when using the requests library.

As it can be seen that using the WebDriver more images can be obtained because it enables the use of Javascript while using the requests library we get pure HTML and CSS.