Data

The data powering the portal can come in a variety of forms. Content is displayed through records harvested from an external OAI feed (Read more on data modeling and mapping on how to configure your OAI feed). Discrete files can also be uploaded to the portal to display on an exhibit; these files, however, need no configuration beyond what is built-in. The sections below will deal with items coming through an OAI feed.

Data Modeling

By default, data is modeled according to the schema of the Michigan Service Hub. What this means is that translates XML records from an OAI feed, parsing each record and picking out predefined fields that will show up on the portal's website. The fields that show up on the portal can be changed or added to; however, this is beyond the scope of this guide. Your XML data can be most any shape, but what you'll have to do is make sure you can associate a field within your XML record to a Solr field that Spotlight recognizes. If you look here, you can see that the Michigan Service Hub's metadata profile is mapped to do just that. Please refer to the mapping guide for further details.

Indexing

Your initial index is run from your Solr server's web page at http://NAME_OF_YOUR_SERVER/solr/#/portal/dataimport//dataimport. See your mapping instructions page for more details on this. Subsequent reharvests and additions came be performed within the portal. To do this, login to the portal as an administrator. Go to Site Administration. Click on Import Management. If you want to add items to an existing harvest (if your OAI feed now contains more items), click Update. If you want to clear out your entire index, click Reindex. Important: please know that reindexing will trigger an automatic exhibit backup and restore, in addition to reharvesting your data. This might take many hours. This process can be monitored either from the Import Management page or the Solr data import page (http://NAME_OF_YOUR_SERVER/solr/#/portal/dataimport//dataimport).

Data Backup and Restore

The data stored within the portal should not been seen as preserved for long term storage. This portal is simply a display interface. Please use your own archival storage system to store your important digital files. There are, however, useful configuration files and settings that should be saved by the portal administrator for restoration purposes/backup. Perhaps the most important of these files is your exhibit data. These are configuration settings and uploaded files and items not associated with your portal's OAI feed. This data is located on the server at var/lib/docker/volumes/spotlight_webdata/_data/spotlight/backup/files. If you are trying to restore your current portal from a previous backup, go to the portal. Login as an administrator. Go to Site Administration, Manage backups. Select Restore for the backup you want. If you are migrating exhibit data from an old server to a new one, you'll need to take the contents of the backup (there should be at minimum 4 files in a backup folder), and go to each Exhibit dashboard. Select the General tab under Configuration. Click on Import data and import the appropriate json file (labeled according to exhibit name). Reharvesting data using Site Adminstration/Import Management/Reindex will trigger an automatic exhibit backup and reimport. This could take many hours depending upon the size of your portal OAI feed.

You OAI harvester configuration files are also worth preserving; you will have set this up when initially installing the server. Please refer to the installation instructions as well as the mapping instruction page for more information about this data.