Skip to content

v0.5.0

Pre-release
Pre-release
Compare
Choose a tag to compare
@kerchner kerchner released this 19 Apr 14:56
· 149 commits to master since this release
0.5.0
4d5cb52

Version 0.5.0 is focused on:

  • Continued work on SFM UI, including:
    • adding screens for credentials
    • refinement of seed set and seed screens
    • tracking changes made by users to collections, seed sets, seeds, and credentials
  • Keeping records for WARC files that are created during harvesting.
  • Adding the Sina Weibo harvester.
  • Enhancements to the Twitter harvester, including user timelines and the sample stream.
  • Initial support for export. In this release, export to CSV, Excel, JSON, and others is supported for Flickr photos and exports must be requested using the Admin interface. (Export for other types of social media content and SFM UI screens for requesting and retrieving exports are forthcoming.)

Release notes for specific components:

For a complete list of tickets, see sfm-ui milestone 0.5.0.

Steps to give it a try:

  1. Get a set of Twitter API keys
  2. Get a set of Flickr API keys.
  3. Bring up an instance of SFM using prod.docker-compose.yml.
  4. Log into the SFM UI (http://localhost/) as "testuser" using password "password".
  5. Using the "My Credentials" link, create a new Credentials. Select “testuser” as the user and enter “twitter” as the platform. For token, enter:
    {
                   "key": "<YOUR KEY>",
                   "secret": "<YOUR SECRET>"
    }
  1. Click My Collections and then the Add New Collections button. Enter a collection name and select the group you created as the group. Click Save.
  2. Click on the collection you just created and then the Add Seedset button. Enter a name and select "Flickr user" for harvest type. For harvest options, enter {"sizes": ["Thumbnail", "Original"]}. Select the credentials you created as the credentials. Click Save.
  3. To create a seed, go to the Admin site and click "Add Seed". Select the seed set you just created as the seed set. Either enter a flickr username as the token.
  4. Update the seed set, but don't change anything.
  5. Wait
  6. Go back to admin site and look at the list of harvest. Expected result is a harvest record for each harvest.
  7. From the commandline, execute docker exec -it sfmdocker_sfmflickrharvester_1 find /tmp/collection -name "*.warc.gz". Expected result is path for a WARC.
Assets 2
Loading