Using the yad2 website, scrape and collect information about apartments in your area.
*currently => Haifa, Israel
- edit the "config.json" file with the parameters of the search
using strings with format "<minimum_value>-<maximum_value>"
for Any value enter "-1"
Exemple:{ "rooms": "2--1", "price": "-1-2600", "floor": "-1--1", }
- using int format.
to include the parameter in search = 1
to exclude the parameter in search = 0
Exemple:{ "parking": 0, "elevator": 1 }
- Install dependencies
pip install -r requirements.txt
- Run in your terminal
python scrape.py
After the program finish running, an output file "apartment_listings" will be created with all the apartments found.
- Scarpe single page of the webside
- Scrape all possible pages of the search results. Save in the output file
- Scrape each item for additional details and images
- Add support for other file formats. (currently only works with .csv)
See the open issues for a full list of proposed features (and known issues).
Leonid Sobol - leonis313@gmail.com
Project Link: https://github.com/Leo-project-A/Apartment_hunting