You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, the mass-build pipeline sends an individual webhook request for each of thousands of courses to open-discussions/mitopen, triggering celery tasks there to update the search index for each course. It would be more efficient to send fewer webhook requests containing groups of sites to be updated: either all sites in a single request as the final step of the pipeline, or subgroups of courses as the final step within each batch of the pipeline.
Plan/Design
TBD
The text was updated successfully, but these errors were encountered:
mbertrand
changed the title
Mass-build pipeline should not send individual webhook requests to mitopen/discussions
Mass-build pipeline should not send individual webhook requests to mit-open/discussions
Jan 19, 2024
Description/Context
Currently, the mass-build pipeline sends an individual webhook request for each of thousands of courses to open-discussions/mitopen, triggering celery tasks there to update the search index for each course. It would be more efficient to send fewer webhook requests containing groups of sites to be updated: either all sites in a single request as the final step of the pipeline, or subgroups of courses as the final step within each batch of the pipeline.
Plan/Design
TBD
The text was updated successfully, but these errors were encountered: