Feature Request — Rewrite webscraper to use SIS login #801
Assignees
Labels
back-end
back-end related (usually in python and sql)
Feature Request
New Feature Request
python
Pull requests that update Python code
tech debt
Technical Debt Cleanup, things work, but could hurt us in the future
Comments
martig7
added
tech debt
martig7
added a commit
that referenced
this issue
Sep 29, 2023
martig7
added a commit
that referenced
this issue
Sep 29, 2023
martig7
added a commit
that referenced
this issue
Oct 3, 2023
martig7
added a commit
that referenced
this issue
Oct 4, 2023
martig7
added a commit
that referenced
this issue
Oct 4, 2023
martig7
added a commit
that referenced
this issue
Oct 6, 2023
martig7
added a commit
that referenced
this issue
Oct 7, 2023
martig7
added a commit
that referenced
this issue
Oct 10, 2023
martig7
added a commit
that referenced
this issue
Oct 13, 2023
martig7
added a commit
that referenced
this issue
Oct 13, 2023
martig7
added a commit
that referenced
this issue
Oct 16, 2023
martig7
added a commit
that referenced
this issue
Oct 31, 2023
martig7
added a commit
that referenced
this issue
Nov 10, 2023
martig7
added a commit
that referenced
this issue
Nov 21, 2023
martig7
added a commit
that referenced
this issue
Nov 29, 2023
martig7
pushed a commit
that referenced
this issue
Nov 29, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Job
The SIS course catalog has a lot more info in a far more standard way when viewing while logged in using an RCSID. If we could just prompt for login info from whoever is running the script we could allow any maintainer to use their own account to generate a csv file with all of the courses without having to go through the registrar.
Describe a possible solution
Part 1. Send a request to sis.rpi.edu, orompt the user for their RCSID and their password.
Part 2. Get the DUO code which shows up, give the user the code
Part 3. Navigate to Course Search, select the correct term on the drop-down.
Part 4. For every subject in the course search subject dropdown, select the subject, parse all courses on the page, and then go back to the course search page.
Context
Our current solution is bad.
The text was updated successfully, but these errors were encountered: