YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
readme TODO
all quants are imatrix, except for Q8 and BF16
- Downloads last month
- 21
Hardware compatibility
Log In to add your hardware
1-bit
4-bit
5-bit
6-bit
8-bit
16-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support