Skip to content

Releases: xorbitsai/inference

v0.2.1

23 Aug 11:55
d199011
Compare
Choose a tag to compare

What's new in 0.2.1 (2023-08-23)

These are the changes in inference v0.2.1.

New features

  • FEAT: Adding support for stream returning completion results by @takatost in #368

Enhancements

  • ENH: including default context length into model family by @Bojun-Feng in #374

Bug fixes

New Contributors

Full Changelog: v0.2.0...v0.2.1

v0.2.0

19 Aug 15:49
7ed7a02
Compare
Choose a tag to compare

What's new in 0.2.0 (2023-08-19)

These are the changes in inference v0.2.0.

New features

Enhancements

Bug fixes

Documentation

Others

Full Changelog: v0.1.3...v0.2.0

v0.1.3

09 Aug 10:46
4d2f61c
Compare
Choose a tag to compare

What's new in 0.1.3 (2023-08-09)

These are the changes in inference v0.1.3.

Enhancements

Bug fixes

Documentation

Others

Full Changelog: v0.1.2...v0.1.3

v0.1.2

04 Aug 10:36
98765f2
Compare
Choose a tag to compare

What's new in 0.1.2 (2023-08-04)

These are the changes in inference v0.1.2.

New features

Enhancements

  • ENH: select q4_0 as default quantization method for ggmlv3 model in benchmark by @pangyoki in #293
  • ENH: disable gradio telemetry by @UranusSeven in #299

Bug fixes

Others

Full Changelog: v0.1.1...v0.1.2

v0.1.1

03 Aug 15:47
b21d927
Compare
Choose a tag to compare

What's new in 0.1.1 (2023-08-03)

These are the changes in inference v0.1.1.

New features

Enhancements

Bug fixes

  • BUG: fix import torch error even if user don't want to launch torch model by @pangyoki in #274
  • BUG: empty legacy model dir by @UranusSeven in #276

Tests

Documentation

Full Changelog: v0.1.0...v0.1.1

v0.1.0

28 Jul 13:13
37ca23a
Compare
Choose a tag to compare

What's new in 0.1.0 (2023-07-28)

These are the changes in inference v0.1.0.

New features

Enhancements

Bug fixes

Tests

Documentation

Full Changelog: v0.0.6...v0.1.0

v0.0.6

24 Jul 07:05
b753f98
Compare
Choose a tag to compare

What's new in 0.0.6 (2023-07-24)

These are the changes in inference v0.0.6.

Enhancements

Bug fixes

Documentation

New Contributors

Full Changelog: v0.0.5...v0.0.6

v0.0.5

19 Jul 11:32
c9d42c6
Compare
Choose a tag to compare

What's new in 0.0.5 (2023-07-19)

These are the changes in inference v0.0.5.

New features

Enhancements

Bug fixes

Documentation

Full Changelog: v0.0.4...v0.0.5

v0.0.4

14 Jul 12:15
80003e1
Compare
Choose a tag to compare

What's new in 0.0.4 (2023-07-14)

These are the changes in inference v0.0.4.

New features

Bug fixes

Documentation

Others

Full Changelog: v0.0.3...v0.0.4

v0.0.3

11 Jul 13:52
12ed8a3
Compare
Choose a tag to compare

What's new in 0.0.3 (2023-07-11)

These are the changes in inference v0.0.3.

Bug fixes

Documentation

Full Changelog: v0.0.2...v0.0.3