Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates migrations with using field_unique_id as default for parse_entity_lookups #204

Merged
merged 17 commits into from
Aug 16, 2021
Merged

Updates migrations with using field_unique_id as default for parse_entity_lookups #204

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
5046172
First pass at changing the default for parse_entity_type to using
Aug 11, 2021
788ab50
Takes out debug call.
Aug 11, 2021
be98f9e
Fixes migration field field_display_hint
Aug 12, 2021
e203c38
Fixes upload functions in util.js
Aug 12, 2021
f256d1a
Fixes missed areas that needed updating.
Aug 12, 2021
ff208e9
Fixes some csv typos
Aug 12, 2021
692f332
Fixed another typo
Aug 12, 2021
0ccbbaa
fixes status message check during migration to be more specific
Aug 12, 2021
3338e07
Fixes tests to ignore the drupal update message, if it's present
Aug 16, 2021
da7d729
Removes setting of deadline_ms
Aug 16, 2021
6fbd179
Another try to get the doMigration function to operate predictably.
Aug 16, 2021
5908273
adds debug
Aug 16, 2021
2c1bf8b
Tweak to util.js
Aug 16, 2021
8e142af
Fixes a few tests, by replace Equals with Contains
Aug 16, 2021
e30bc87
Fixes typo
Aug 16, 2021
a41384c
Brings util.js inline with the one in 10-migration-backend-tests
Aug 16, 2021
d13cf42
changes access to accessTerms in a function call and
Aug 16, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 7 additions & 6 deletions codebase/config/sync/migrate_plus.migration.idc_ingest_media_audio.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -67,11 +67,12 @@ process:
delimiter: '||'
strict: false
-
plugin: entity_lookup
bundle_key: vid
bundle: islandora_access
entity_type: taxonomy_term
value_key: name
plugin: parse_entity_lookup
defaults:
entity_type: taxonomy_term
bundle: islandora_access
bundle_key: vid
value_key: field_unique_id
field_original_name: original_name
field_media_audio_file/target_id:
plugin: file_import
Expand All @@ -92,7 +93,7 @@ process:
entity_type: node
bundle: islandora_object
bundle_key: type
value_key: title
value_key: field_unique_id
field_media_use:
-
plugin: skip_on_empty
Expand Down
17 changes: 9 additions & 8 deletions codebase/config/sync/migrate_plus.migration.idc_ingest_media_document.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -67,11 +67,12 @@ process:
delimiter: '||'
strict: false
-
plugin: entity_lookup
bundle_key: vid
bundle: islandora_access
entity_type: taxonomy_term
value_key: name
plugin: parse_entity_lookup
defaults:
entity_type: taxonomy_term
bundle: islandora_access
bundle_key: vid
value_key: field_unique_id
field_original_name: original_name
field_media_document/target_id:
plugin: file_import
Expand All @@ -92,7 +93,7 @@ process:
entity_type: node
bundle: islandora_object
bundle_key: type
value_key: title
value_key: field_unique_id
field_media_use:
-
plugin: skip_on_empty
Expand All @@ -105,9 +106,9 @@ process:
-
plugin: entity_lookup
entity_type: taxonomy_term
value_key: name
bundle_key: vid
bundle: islandora_media_use
bundle_key: vid
value_key: name
status: constants/STATUS
destination:
plugin: 'entity:media'
Expand Down
17 changes: 9 additions & 8 deletions codebase/config/sync/migrate_plus.migration.idc_ingest_media_extracted_text.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -68,11 +68,12 @@ process:
delimiter: '||'
strict: false
-
plugin: entity_lookup
bundle_key: vid
bundle: islandora_access
entity_type: taxonomy_term
value_key: name
plugin: parse_entity_lookup
defaults:
entity_type: taxonomy_term
bundle: islandora_access
bundle_key: vid
value_key: field_unique_id
field_media_file/target_id:
plugin: file_import
source: '@_download_filepath'
Expand All @@ -92,7 +93,7 @@ process:
entity_type: node
bundle: islandora_object
bundle_key: type
value_key: title
value_key: field_unique_id
field_media_use:
-
plugin: skip_on_empty
Expand All @@ -105,9 +106,9 @@ process:
-
plugin: entity_lookup
entity_type: taxonomy_term
value_key: name
bundle_key: vid
bundle: islandora_media_use
bundle_key: vid
value_key: name
status: constants/STATUS
destination:
plugin: 'entity:media'
Expand Down
13 changes: 7 additions & 6 deletions codebase/config/sync/migrate_plus.migration.idc_ingest_media_file.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -67,11 +67,12 @@ process:
delimiter: '||'
strict: false
-
plugin: entity_lookup
bundle_key: vid
bundle: islandora_access
entity_type: taxonomy_term
value_key: name
plugin: parse_entity_lookup
defaults:
entity_type: taxonomy_term
bundle: islandora_access
bundle_key: vid
value_key: field_unique_id
field_original_name: original_name
field_media_file/target_id:
plugin: file_import
Expand All @@ -92,7 +93,7 @@ process:
entity_type: node
bundle: islandora_object
bundle_key: type
value_key: title
value_key: field_unique_id
field_media_use:
-
plugin: skip_on_empty
Expand Down
17 changes: 9 additions & 8 deletions codebase/config/sync/migrate_plus.migration.idc_ingest_media_image.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -67,11 +67,12 @@ process:
delimiter: '||'
strict: false
-
plugin: entity_lookup
bundle_key: vid
bundle: islandora_access
entity_type: taxonomy_term
value_key: name
plugin: parse_entity_lookup
defaults:
entity_type: taxonomy_term
bundle: islandora_access
bundle_key: vid
value_key: field_unique_id
field_original_name: original_name
field_media_image/target_id:
plugin: file_import
Expand All @@ -93,7 +94,7 @@ process:
entity_type: node
bundle: islandora_object
bundle_key: type
value_key: title
value_key: field_unique_id
field_media_use:
-
plugin: skip_on_empty
Expand All @@ -105,9 +106,9 @@ process:
-
plugin: entity_lookup
entity_type: taxonomy_term
value_key: name
bundle_key: vid
bundle: islandora_media_use
bundle_key: vid
value_key: name
status: constants/STATUS
destination:
plugin: 'entity:media'
Expand Down
13 changes: 7 additions & 6 deletions codebase/config/sync/migrate_plus.migration.idc_ingest_media_remote_video.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -33,11 +33,12 @@ process:
delimiter: '||'
strict: false
-
plugin: entity_lookup
bundle_key: vid
bundle: islandora_access
entity_type: taxonomy_term
value_key: name
plugin: parse_entity_lookup
defaults:
entity_type: taxonomy_term
bundle: islandora_access
bundle_key: vid
value_key: field_unique_id
field_media_oembed_video: url
field_media_of:
plugin: parse_entity_lookup
Expand All @@ -46,7 +47,7 @@ process:
entity_type: node
bundle: islandora_object
bundle_key: type
value_key: title
value_key: field_unique_id
status: constants/STATUS
destination:
plugin: 'entity:media'
Expand Down
17 changes: 9 additions & 8 deletions codebase/config/sync/migrate_plus.migration.idc_ingest_media_video.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -67,11 +67,12 @@ process:
delimiter: '||'
strict: false
-
plugin: entity_lookup
bundle_key: vid
bundle: islandora_access
entity_type: taxonomy_term
value_key: name
plugin: parse_entity_lookup
defaults:
entity_type: taxonomy_term
bundle: islandora_access
bundle_key: vid
value_key: field_unique_id
field_original_name: original_name
field_media_video_file/target_id:
plugin: file_import
Expand All @@ -92,7 +93,7 @@ process:
entity_type: node
bundle: islandora_object
bundle_key: type
value_key: title
value_key: field_unique_id
field_media_use:
-
plugin: skip_on_empty
Expand All @@ -104,9 +105,9 @@ process:
-
plugin: entity_lookup
entity_type: taxonomy_term
value_key: name
bundle_key: vid
bundle: islandora_media_use
bundle_key: vid
value_key: name
status: constants/STATUS
destination:
plugin: 'entity:media'
Expand Down
24 changes: 13 additions & 11 deletions codebase/config/sync/migrate_plus.migration.idc_ingest_new_collection.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -99,7 +99,7 @@ process:
entity_type: node
bundle: collection_object
bundle_key: type
value_key: title
value_key: field_unique_id
field_access_terms:
-
plugin: skip_on_empty
Expand All @@ -110,22 +110,24 @@ process:
delimiter: '||'
strict: false
-
plugin: entity_lookup
bundle_key: vid
bundle: islandora_access
entity_type: taxonomy_term
value_key: name
plugin: parse_entity_lookup
defaults:
entity_type: taxonomy_term
bundle: islandora_access
bundle_key: vid
value_key: field_unique_id
field_title_language:
-
plugin: skip_on_empty
method: process
source: title_language
-
plugin: entity_lookup
entity_type: taxonomy_term
bundle: language
bundle_key: vid
value_key: name
plugin: parse_entity_lookup
defaults:
entity_type: taxonomy_term
bundle: language
bundle_key: vid
value_key: field_unique_id
field_alternative_title:
-
plugin: skip_on_empty
Expand Down
Loading