Preservation failure: media versus node change date may not be consistently in the swift ingest (meta header) versus audit report

[jefferya]

Repository v2 preservation audit failed for Node 172. When audit tested later in the day, the audit passed. The window for including nodes & media for consideration is 31 days. Or is this Drupal cache related (as "2024-06-22" is the media change date whereas "2024-07-29" node change data)?

 diff _leaf_bagger_audit_2024-08-30T_14-35-31.csv _leaf_bagger_audit_2024-08-30T_20-37-04.csv

drupal_id,drupal_changed,swift_id,swift_timestamp,swift_meta_changed,swift_bytes,status

-172,2024-06-22T10:35:38+00:00,aip_172.zip,2024-08-23T14:44:42,2024-07-29T19:45:43+00:00,3339,st
+172,2024-07-29T19:45:43+00:00,aip_172.zip,2024-08-23T14:44:42,2024-07-29T19:45:43+00:00,3339,

[jefferya]

Keep open; see if reoccurs.

[jefferya]

Example:

• 1207,2024-12-12T06:55:42+00:00,aip_1207.zip,2025-01-16T21:32:25,2024-12-12T06:55:33+00:00,6279626,st

[jefferya]

To reproduce:

• use the single ID argument.
• changed date/time stored with Swift is always the Drupal Node and take into consideration the change date/time of the associated Drupal Media like the alternate batch by date workflow

To fix:

• enhance single processing
  • visit media attached and find the most recent date from the Drupal Node and associated Media

    leaf-isle-bagger/rootfs/var/www/leaf-isle-bagger/leaf-bagger.py

    Lines 83 to 85 in bc9e8cf

    	if args.force_single_node:
    	node_list = drupalUtilities.id_list_from_arg(session, args)
    	logging.info(node_list)

  • base on https://github.com/cwrc/islandora_bagger/blob/3d833fb6c15b454d378642076e5c3b368b198ebd/src/Plugin/AddMediaJson.php#L36