Add an option to process only last rows

[annagav]

What are the relevant tickets?

Related to https://github.com/mitodl/hq/issues/4550 and https://github.com/mitodl/hq/issues/4503

Description (What does it do?)

This PR attempts to reduce the time the task is running and to prevent unnecessary reprocessing of the whole sheet, since it is only getting longer.
Add a log info message to state which rows got processed.

How can this be tested?

You would need to set up google sheets to run locally. Follow the instructions here.

Here is the list of vars that you need set in your .env file in your local mitxonline:

MITX_ONLINE_BASE_URL=<your_ngrok_url>
MITOL_GOOGLE_SHEETS_DRIVE_CLIENT_ID=<your_client_id>
MITOL_GOOGLE_SHEETS_DRIVE_CLIENT_SECRET=<your_secret>
MITOL_GOOGLE_SHEETS_DRIVE_API_PROJECT_ID=<your_google_project_id>
MITOL_GOOGLE_SHEETS_PROCESSOR_APP_NAME=mitxonline-refunds-local
MITOL_GOOGLE_SHEETS_ENROLLMENT_CHANGE_SHEET_ID=<sheet_id>
MITOL_GOOGLE_SHEETS_REFUNDS_REQUEST_WORKSHEET_ID=0
MITOL_GOOGLE_SHEETS_PROCESS_ONLY_LAST_ROWS_NUM=30
GOOGLE_DOMAIN_VERIFICATION_TAG_VALUE=<unique_code>
CSRF_TRUSTED_ORIGINS=<your_ngrok_url_without_https>,

To test the changes of google sheets in your mitxonline instance you would need to :

1. In ol-django run pants package ::
2. Then copy the file to your mitxonline repo: cp dist/mitol-django-google-sheets-2023.12.19.1.tar.gz ../mitxonline
3. In mitxonline in pyproject.toml

-mitol-django-google-sheets = "2023.12.19.1"
+mitol-django-google-sheets = {path = "mitol-django-google-sheets-2023.12.19.1.tar.gz", develop = true}

4. In Dockerfile move COPY . /app before RUN poetry install
5. Run docker-compose build

When your task is running successfully you should see logs about the rows that are being processed, "Going to process the sheet starting with row 6"
"Ignored rows in Enrollment Change Request sheet (Refunds): [6, 7, 8]"
"Processed rows with errors in Enrollment Change Request sheet (Refunds): [6, 7, 8]"

Try setting MITOL_GOOGLE_SHEETS_PROCESS_ONLY_LAST_ROWS_NUM=2 in your .env file, then clear all the errors from the sheet and wait the task to run again. It should process only the last 2 rows. By default it is set to 30 rows. If the number of filled out rows is less the MITOL_GOOGLE_SHEETS_PROCESS_ONLY_LAST_ROWS_NUM it will process all rows.

[rachellougee]

During my tests, I set MITOL_GOOGLE_SHEETS_PROCESS_ONLY_LAST_ROWS_NUM = 3 but it started to process the last 4 rows I assume it's because ID starts with 2, so the first row is row 15 (Going to process the sheet starting with row 15), which is ID 12 in my spreadsheet.

I don't think it is a big deal. Functionality works great.