gguf-quantization

A package for quantizing LLMs

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install gguf-quantization

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Files
0.1.0 2024-07-13    

Issues with this package?

Page last updated 2024-07-13 05:01:58 UTC