Skip to content

Releases: gwu-libraries/sfm-twitter-harvester

Version 3.0.0

24 Apr 14:50
Compare
Choose a tag to compare

Support for Twitter API v.2

See also sfm-ui

  • Added support (with twarc2) for harvesting from search, academic search, user timeline, and filtered stream endpoints
  • Search and academic search harvests allow for harvesting Tweets by specific date ranges.
  • Search and academic search allow for limiting harvests to a specific number of Tweets (useful vis-a-vis new monthly caps per Twitter app/credential)
  • Implemented stream harvesting, including support for adding and deleting multiple streaming rules
  • Incorporated twarc-csv for handling CSV and Excel exports from Twitter v.2 data
  • Unit tests written for v.2 harvester and exporter
  • Implemented user-friendly error handling for v.2 endpoints

Version 2.5.0

01 Nov 19:49
Compare
Choose a tag to compare

Upgrades Python version from 3.6 to 3.8 (sfm-ui #1071)

2.4.0...2.5.0

Version 2.4.0

16 Jul 19:35
801b6bd
Compare
Choose a tag to compare
  • Implements fine-grained data directories and data volumes (sfm-ui #1051).
  • Updates reference to sfm base Docker image.
  • Adds or updates environment variables for Postgres and RabbitMQ.
  • Upgrades Twarc.
  • Updates integration tests.

Version 2.3.0

04 May 13:46
Compare
Choose a tag to compare

No changes in this release.

Version 2.2.0

10 Sep 16:19
Compare
Choose a tag to compare

2.1.0...2.2.0

Version 2.1.0

03 Jan 15:51
Compare
Choose a tag to compare

Changes in this release:

  • Upgraded Python libraries, including Twarc
  • Fixed gwu-libraries/sfm-ui#958 where a JSON export would fail, but status in the web interface would remain at "Running"

2.0.2...2.1.0

Version 2.0.2

13 Aug 21:03
Compare
Choose a tag to compare

No significant changes in this release.

Version 2.0.1

07 Aug 17:55
Compare
Choose a tag to compare

Warcprox fix.

Version 2.0.0

26 Jul 02:46
Compare
Choose a tag to compare

Changes in this release:

  • Upgraded to python3
  • Handle error messages.

Version 1.12.1

15 Jun 15:51
Compare
Choose a tag to compare

Upgraded Twarc to fix problem exporting tweet text.