YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)
EXL2 quants of CodeLlama2-34B-instruct
2.70 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.65 bits per weight
6.00 bits per weight
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support