v0.7.1

Full Changelog: v0.7.0...v0.7.1

• Fix critical bug where some goroutines wait forever.

v0.7.0

Full Changelog: v0.6.2...v0.7.0

• Added semaphore based locking for TF calls.

v0.6.2

Full Changelog: v0.5.0...v0.6.2

• Fix critical regression from v0.5.0 for certain model output types.
• Add e2e testing via endly - note: successfully running the e2e requires a build using a branch that blocks on Docker container runs, or some luck with timing.

v0.5.0

Full Changelog: v0.4.1...v0.5.0

• Tools v2
• Logging fixes

2023-05-18 update - found breaking bug, marking as pre-release.

Startup changes, performance, bug fix

• Support concurrency safe usage of gmetric
• Add Memory Profiling endpoint
• Rewire to return error on startup
• Fix case where model reload recovers but health point does not.

Full Changelog: v0.3.2...v0.4.1

Improve health UX

Added timeout for model reload of 5 minutes.
May add configuration endpoints to support per-model timeouts.

Fixed health endpoint

Full Changelog: v0.3.0...v0.3.1

Added Health endpoint

What's Changed

• Repeat model input keys in JSON request payload no longer cause panic… by @dchoi-specificmedia in #11
• Cache key error by @dchoi-specificmedia in #13
• Fix logging error for batch size greater than 1 by @dchoi-specificmedia in #9
• Add health endpoint for model reload.
• Code reformatting and cleanup.

Full Changelog: v0.2.2...v0.3.0

Release 0.2.2

v0.2.2

patched validation

Release 0.2.1

• added layer hashes