Skip to content

URLFrontier 2.4

Latest
Compare
Choose a tag to compare
@klockla klockla released this 27 Sep 08:33
· 3 commits to master since this release

What's Changed

This release fixes some bugs (see detailed list below) and adds the following notables changes:

  • Ignite backend has been removed
  • Two new API methods have been added:
    • GetURLStatus to retrieve information about a particular URL in the frontier
    • ListURLs to retrieve all URLs known in the frontier

Detailed list of changes

  • PutURLs calls failing with java.lang.IllegalStateException #77 by @michaeldinzinger in #78
  • Modifying the delete functionality for ignite.purge (Issue #74) by @michaeldinzinger in #81
  • Modifying functionality for rocksdb.purge to use abstract method by @michaeldinzinger in #82
  • Preventing IgniteHeartbeat race condition on the start of IgniteService (Issue #72) by @michaeldinzinger in #79
  • Fix mistake for config forwarding in constructor DistributedFrontierS… by @michaeldinzinger in #83
  • Making the metrics variables for GetURLs protected by @michaeldinzinger in #84
  • Bump grpc-protobuf from 1.50.2 to 1.53.0 in /API by @dependabot in #85
  • Bump ch.qos.logback:logback-classic from 1.4.4 to 1.4.12 in /service by @dependabot in #89
  • Ability to set URL limit for specific domain by @zaibacu in #91
  • Add method to get URL Status (returns an URLItem) by @klockla in #92
  • adds dependabot by @jnioche in #97
  • Fix #87, similar behaviour re-blocking whether specitying a key or not by @jnioche in #99
  • Add method ListURLs to list all URLs known in the frontier with their next fetch date by @klockla in #93
  • Remove Ignite, implements #96 by @jnioche in #100
  • Added test case for discussion #94 by @klockla in #101
  • Better organisation of Maven plugins and update their version by @jnioche in #102
  • Reformat some files which were not passing mvn verify by @klockla in #104
  • Improved handling of dependencies and updated their versions by @jnioche in #105
  • Reverted back to GRPC 1.66.0 and updated protoc to 3.25.5 by @klockla in #106
  • Prerelease 2.4 by @jnioche in #107

New Contributors

Full Changelog: 2.3.1...2.4