Skip to content

Latest commit

 

History

History
12 lines (10 loc) · 370 Bytes

README.md

File metadata and controls

12 lines (10 loc) · 370 Bytes

Joblystic Crawler

  1. Extract job links

    1. Visit job listing pages
    2. Extract job listings links
    3. Filter job listings to only include software engineering ones
    4. Send them to Worker to store them in the database
      1. Send them to the next stage to extract job details
  2. Extract job details:

    1. Visit job details pages
    2. Extract job details