unsloth/DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit
Text Generation
•
Updated
•
90.1k
•
16
Unsloth 4-bit Dynamic Quants
Unsloths Dynamic 4bit Quants selectively skips quantizing certain parameters; greatly improving accuracy while only using <10% more VRAM than BnB 4bit
Note DeepSeek-R1 Distill Models:
-
unsloth/DeepSeek-R1-Distill-Qwen-14B-unsloth-bnb-4bit
Text Generation • Updated • 17.4k • 17 -
unsloth/DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit
Text Generation • Updated • 19.3k • 6
unsloth/phi-4-unsloth-bnb-4bit
Text Generation • Updated • 84.9k • 39Note Text-based LLMs:
-
unsloth/Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit
Text Generation • Updated • 8.15k • 10 -
unsloth/Meta-Llama-3.1-8B-Instruct-unsloth-bnb-4bit
Text Generation • Updated • 322 • 1 -
unsloth/Llama-3.2-3B-Instruct-unsloth-bnb-4bit
Text Generation • Updated • 92.6k • 3 -
unsloth/Llama-3.2-1B-Instruct-unsloth-bnb-4bit
Text Generation • Updated • 34k • 1 -
unsloth/Mistral-Small-24B-Base-2501-unsloth-bnb-4bit
Text Generation • Updated • 1.67k • 2
unsloth/Llama-3.2-11B-Vision-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 72.9k • 20Note Vision Models:
-
unsloth/Qwen2.5-VL-7B-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 5.31k • 12 -
unsloth/Qwen2.5-VL-72B-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 774 • 3 -
unsloth/Qwen2.5-VL-3B-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 2.1k • 4 -
unsloth/Qwen2-VL-7B-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 43k • 9 -
unsloth/Qwen2-VL-2B-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 18.8k • 5 -
unsloth/Pixtral-12B-2409-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 3.85k • 5 -
unsloth/Llama-3.2-11B-Vision-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 1.08k • 3 -
unsloth/QwQ-32B-Preview-unsloth-bnb-4bit
Text Generation • Updated • 874 • 18 -
unsloth/Qwen2.5-3B-Instruct-unsloth-bnb-4bit
Text Generation • Updated • 29.5k • 2