Releases: gwu-libraries/sfm-twitter-harvester
Releases · gwu-libraries/sfm-twitter-harvester
Version 3.0.0
Support for Twitter API v.2
See also sfm-ui
- Added support (with twarc2) for harvesting from search, academic search, user timeline, and filtered stream endpoints
- Search and academic search harvests allow for harvesting Tweets by specific date ranges.
- Search and academic search allow for limiting harvests to a specific number of Tweets (useful vis-a-vis new monthly caps per Twitter app/credential)
- Implemented stream harvesting, including support for adding and deleting multiple streaming rules
- Incorporated twarc-csv for handling CSV and Excel exports from Twitter v.2 data
- Unit tests written for v.2 harvester and exporter
- Implemented user-friendly error handling for v.2 endpoints
Version 2.5.0
Upgrades Python version from 3.6 to 3.8 (sfm-ui #1071)
Version 2.4.0
- Implements fine-grained data directories and data volumes (sfm-ui #1051).
- Updates reference to sfm base Docker image.
- Adds or updates environment variables for Postgres and RabbitMQ.
- Upgrades Twarc.
- Updates integration tests.
Version 2.3.0
No changes in this release.
Version 2.2.0
- Added language parameter for Twitter filter gwu-libraries/sfm-ui#943
- Upgrade python dependencies
Version 2.1.0
Changes in this release:
- Upgraded Python libraries, including Twarc
- Fixed gwu-libraries/sfm-ui#958 where a JSON export would fail, but status in the web interface would remain at "Running"
Version 2.0.2
No significant changes in this release.
Version 2.0.1
Warcprox fix.
Version 2.0.0
Changes in this release:
- Upgraded to python3
- Handle error messages.
Version 1.12.1
Upgraded Twarc to fix problem exporting tweet text.