Skip to content

skim0514/mongular

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

mongular


Mongular is a website crawling & web mirroring service.

It allows users to build a database of websites and offline browse these websites.


Dependencies:

  • Database: MongoDB
  • FrontEnd: Angular
  • BackEnd: Java Spring

  • How To Use:

    1. Build Backend using mvn spring-boot:run
    2. Crawl and get websites using API

    API Explanation

    • Post
      • /website - crawl the given website from the link
        • Param 1: web - full website path
      • /tutorial - adds metadata to database - used more as helper function
        • Param 1: tutorial - class storing metadata.
    • Get
      • /tutorials - gets all tutorials stored in database
      • /tutorials/id/{id} - get tutorial from id number
      • /comparison - compares website between two different dates.
        • Param 1: prev - date to compare with
        • Param 2: next (optional) - date to compare to
      • /websites - gets parsed website from link and date if applicable
        • Param 1: web - absolute link to website
        • Param 2: date (optional) - date of link to get from - gets closest result
      • /websites/dates - gets all days a website was crawled
        • Param 1: web - absolute link of website

    About

    No description, website, or topics provided.

    Resources

    Stars

    Watchers

    Forks

    Releases

    No releases published

    Packages

    No packages published