Research Best Practices on Accessing Source Content from Hugo

[mattsqd]

Summary

This is just a proof of concept, not to merge.
Using Hugo JSON endpoints as a migration source for a Drupal migration.

Solution

It shows how we can use JSON endpoints provided by HUGO to be the source data for a Drupal migration.
The corresponding code in Drupal that does the migrating is stored here GSA/digital-gov-drupal#1.
This shows that you can expose the images in Hugo and migrate them into Drupal. We should be able to do this for all the content we need rather than attempting to parse .md files.

How To Test

1a. You already have the Drupal environment checked out locally: move into it in your terminal
1b. You have not worked with the Drupal environment yet: git clone git@github.com:GSA/digital-gov-drupal.git && cd digital-gov-drupal
2. Checkout the feature branch: git checkout feature/migrate-image-example
3a. If you have not worked with the Drupal environment yet, see the documentation.
3b. If you have worked with the Drupal environment already: lando start && lando si
4. Enable the migration scripts and run the migration: ./drush.sh en -y digital_gov_migration && ./drush.sh migrate:import json_images (See 'Notes' below about the errors you'll see)
5. Login to Drupal: ./drush.sh uli
6. The files migrated from Hugo can be seen at http://digitalgov.lndo.site/admin/content/files

Notes

There are 9 images that 403 during the migration. You can see which ones with ./drush.sh migrate:messages json_imagesor in the document titled Digital.gov missing images in the shared drive.

[github-actions]

🔍 Preview in Federalist

[mattsqd]

Research and code used for this:
https://www.drupal.org/docs/8/api/migrate-api/migrate-source-plugins/migrating-data-from-xml-json-or-soap-source
https://www.drupal.org/project/migrate_plus
https://understanddrupal.com/lessons/migrating-json-files-drupal/
https://github.com/dinarcon/ud_migrations/blob/master/ud_migrations_json_source/migrations/udm_json_source_image.yml
https://github.com/dinarcon/ud_migrations/blob/master/ud_migrations_json_source/sources/udm_data.json