Quantized Llama models in 2,4, and 8 bit versions
Divyanshu Kumar
divyanshusingh
AI & ML interests
NLP, CV, Federated Learning
Recent Activity
updated
a model
about 1 month ago
mili-ai/gliner_large_v2.1-onnx
updated
a Space
5 months ago
enkryptai/README
updated
a collection
5 months ago
Quantized-Llama
Organizations
Collections
2
models
12
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1660005014100-60406e85076aa73940921532.jpeg)
divyanshusingh/Mistral-7B-Instruct-v0.2-GGUF
Updated
•
6
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1660005014100-60406e85076aa73940921532.jpeg)
divyanshusingh/Mistral-7B-Instruct-v0.3-GGUF
Updated
•
8
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1660005014100-60406e85076aa73940921532.jpeg)
divyanshusingh/Mistral-Nemo-Instruct-2407-GGUF
Updated
•
8
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1660005014100-60406e85076aa73940921532.jpeg)
divyanshusingh/Mistral-7B-Instruct-v0.1-GGUF
Updated
•
5
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1660005014100-60406e85076aa73940921532.jpeg)
divyanshusingh/Llama-2-7b-chat-GGUF
Updated
•
15
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1660005014100-60406e85076aa73940921532.jpeg)
divyanshusingh/CodeLlama-7b-GGUF
Updated
•
14
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1660005014100-60406e85076aa73940921532.jpeg)
divyanshusingh/Llama-3-8b-Instruct-GGUF
Updated
•
13
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1660005014100-60406e85076aa73940921532.jpeg)
divyanshusingh/Llama-3.1-8b-Instruct-GGUF
Updated
•
20
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1660005014100-60406e85076aa73940921532.jpeg)
divyanshusingh/lora_ft_indicbart
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1660005014100-60406e85076aa73940921532.jpeg)
divyanshusingh/my_awesome_model
Updated
datasets
None public yet