Edit Models filters

Inference Providers

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

24,209

Full-text search

Active filters: 4-bit

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated 9 days ago • 18.5k • 37

Valdemardi/DeepSeek-R1-Distill-Qwen-32B-AWQ

Text Generation • Updated 22 days ago • 18.2k • 22

unsloth/Qwen2.5-VL-7B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated 11 days ago • 5.31k • 12

unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit

Text Generation • Updated 9 days ago • 92.8k • 16

Valdemardi/DeepSeek-R1-Distill-Llama-70B-AWQ

Text Generation • Updated 22 days ago • 26.9k • 12

cognitivecomputations/DeepSeek-V3-AWQ

Text Generation • Updated 9 days ago • 7.22k • 19

prithivMLmods/Blazer.1-2B-Vision

Image-Text-to-Text • Updated 27 days ago • 605 • 7

unsloth/DeepSeek-R1-Distill-Qwen-14B-unsloth-bnb-4bit

Text Generation • Updated 10 days ago • 17.4k • 17

unsloth/DeepSeek-R1-Distill-Qwen-32B-unsloth-bnb-4bit

Text Generation • Updated 9 days ago • 1.51k • 5

prithivMLmods/Blaze.1-7B-Vision

Image-Text-to-Text • Updated 27 days ago • 375 • 7

unsloth/DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit

Text Generation • Updated 10 days ago • 19.3k • 6

unsloth/DeepSeek-R1-Distill-Llama-70B-bnb-4bit

Text Generation • Updated 9 days ago • 16.8k • 15

internlm/internlm3-8b-instruct-gptq-int4

Text Generation • Updated 27 days ago • 306 • 3

mlx-community/DeepSeek-R1-Distill-Qwen-32B-MLX-4Bit

Updated 22 days ago • 1.17k • 4

casperhansen/deepseek-r1-distill-llama-70b-awq

Updated 3 days ago • 3.89k • 12

unsloth/DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit

Text Generation • Updated 10 days ago • 90.1k • 16

waldie/DeepSeek-R1-Distill-Qwen-32B-4bpw-h6-exl2

Updated 22 days ago • 412 • 6

mlx-community/DeepSeek-R1-Distill-Llama-8B-4bit

Updated 22 days ago • 183k • 5

inarikami/DeepSeek-R1-Distill-Qwen-32B-AWQ

Text Generation • Updated 19 days ago • 73.4k • 4

stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

Text Generation • Updated 12 days ago • 5.55k • 7

unsloth/Qwen2.5-VL-3B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated 11 days ago • 2.1k • 3

unsloth/Qwen2.5-VL-72B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated 11 days ago • 774 • 3

unsloth/Qwen2.5-VL-72B-Instruct-bnb-4bit

Image-Text-to-Text • Updated 11 days ago • 2.35k • 4

roleplaiapp/Janus-Pro-7B-LM-Q4_K_S-GGUF

Text Generation • Updated 9 days ago • 2.17k • 3

syubraj/MedicalChat-Phi-3.5-mini-instruct

Text Generation • Updated 3 days ago • 3

BioMistral/BioMistral-7B-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 134 • 5

sdasd112132/Vision-8B-MiniCPM-2_5-Uncensored-and-Detailed-4bit

Visual Question Answering • Updated Jun 1, 2024 • 413 • 28

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated 9 days ago • 677k • 56

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Aug 20, 2024 • 748k • 8

Qwen/Qwen2-VL-2B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated Sep 21, 2024 • 252k • 21