Skip to content

GPTQModel v1.4.2

Compare
Choose a tag to compare
@Qubitium Qubitium released this 16 Dec 15:44
· 95 commits to main since this release
7b4ae93

What's Changed

⚡ MacOS gpu (MPS) + cpu inference and quantization support
⚡ Added Cohere 2 model support

Full Changelog: v1.4.1...v1.4.2