Migrate ol-home to ol-home0

[cdrini]

Sub-tasks

• Create ol-home0 node #4058 Create ol-home0
• Move infobase to Python 3 ol-home0 #4059 Move infobase to ol-home0
• Switch infogami submodule to infogami master Switch infogami submodule to infogami master #4249 (comment)
• Create solr-updater docker service AGAIN #4287 Move solrupdater to ol-home0
  • TODO: Deploy it Scripts for production deployments #4395
• Create importbot docker service #4324 Move ImportBot to ol-home0 --> make-a-service - Port ID?, Nagios,
• Use empty str instead of None in HTTP headers infogami#134 Use empty str instead of None in HTTP headers
• Create cron jobs docker-compose service #4383 Move cron jobs to ol-home0 (Make one service for all cron jobs -- Caution on the double run)
  • internetarchive/olsystem#110 Replace references of ol-home with ol-home0
  • internetarchive/olsystem#118 DRAFT: Fix cron job oldump to run in Docker
  • cron-jobs service stuck in restart loop #4707 cron-jobs service stuck in restart loop
• Deployments should be triggered from ol-home0 #4318 Deployments should be triggered from ol-home0
  • Scripts for production deployments #4395 Scripts for production deployments
  • Reboot Docker services on specified servers #4457 Reboot Docker services on all production servers

Deployment Scratchpad

[cclauss]

Two versions of solrupdater -- We want to put into separate docker service -- Create a new service in parallel to home service - Get starting command from home.

Push local changes into that service.

ol-home is the KEY. (solr-updater, importbot, cron jobs)

• freeze ol-home
• fabfile must use build dir vs. deploy dir (do not do the deploy step on ol-home)
• Confirm that all code is pointing to deploy.

Developers are still using Python 2 --> 3

• Switch to infogami master -- lose the .yml file
• Default to PYENV_VERSION to Py3
• ImportBot to Py3 issue and PRs

Confirm:

• Remove ol-home from fabfile -- specifically from rsync (i.e. freeze code on ol-home) internetarchive/olsystem#110
• Confirm that Python scripts on ol-home run from the deploys directory, not from the "build" (/1/...) directory
• Literally, update git update submodule to point master SHA

[cclauss]

Questions:

• What is the status of / action plan for Updates to node_modules on image rebuild not reflected in container's node_modules volume #2032 ?
• What is meant by deploys vs build directories
• Does fabfile.rsync_repo() work as is?

[cdrini]

Is it ok if we revert this back to be about ol-home? I think we were swapping the places of #4060 and #4318. I've organized them as:

• This issue (Migrate ol-home to ol-home0 #4060) -> Goal is deprecate ol-home. Lists all the services that will need to be moved over.
• Deployments should be triggered from ol-home0 #4318 Deployments should be triggered from ol-home0 -> goal is the command we run for deploying should happen on ol-home0, not ol-home
• Improve docker-based environment/deployment #4382 Improve Docker-based environment/deployment -> Our Docker-based deploys are super manual and a bit of a mess :P The goal is to fix that.

[mekarpeles]

The remaining issues are as follows, which are being moved to a followup issue:

• Remove infobase ol-home:7000 -> ol-home0:7000 reverse proxy
  • remove ol-home proxypass to ol-home0 for infobase + update config
• Can we dump stats-solr and move from ol-home to ol-home0?
  • Investigate if we can remove stats_solr #4426 Can we remove it?
• can we reclaim 4gb of RAM from ol-home (until we can decommission)
• INCOMPLETE; anything else?
• Remove ol-home