Edit Models filters

Inference Providers

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,940

Full-text search

Active filters: awq

TechxGenus/DeepSeek-V2-Lite-AWQ

Text Generation • Updated Jul 4, 2024 • 285 • 1

arcee-ai/Arcee-Nova-AWQ

Text Generation • Updated Jul 16, 2024 • 80 • 1

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 283k • 96

casperhansen/mistral-nemo-instruct-2407-awq

Text Generation • Updated Sep 27, 2024 • 42.9k • 9

solidrust/Meta-Llama-3.1-8B-Instruct-abliterated-AWQ

Text Generation • Updated Sep 3, 2024 • 179 • 3

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25, 2024 • 74.5k • 46

Qwen/Qwen2-VL-2B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 21, 2024 • 5.82k • 20

Qwen/Qwen2-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25, 2024 • 78.5k • 44

Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 2.19k • 6

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 13.7k • 17

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 837k • 55

solidrust/Gemma-2-Ataraxy-9B-AWQ

Text Generation • Updated Sep 20, 2024 • 178 • 1

ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4

Text Generation • Updated Dec 7, 2024 • 961 • 3

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 25.1k • 22

Qwen/Qwen2.5-Coder-14B-Instruct-AWQ

Text Generation • Updated about 1 month ago • 16.9k • 6

TechxGenus/Mistral-Large-Instruct-2411-AWQ

Updated Nov 19, 2024 • 822 • 6

andretisch/llava-saiga-8b-awq

Updated Dec 2, 2024 • 43 • 1

KirillR/QwQ-32B-Preview-AWQ

Text Generation • Updated Nov 27, 2024 • 407k • 23

kosbu/Athene-V2-Chat-AWQ

Text Generation • Updated Nov 29, 2024 • 1.02k • 6

OPEA/QwQ-32B-Preview-int4-sym-mixed-awq-inc

Updated Dec 23, 2024 • 46 • 1

casperhansen/llama-3.3-70b-instruct-awq

Text Generation • Updated Dec 6, 2024 • 58k • 27

lambdalabs/Llama-3.3-70B-Instruct-AWQ-4bit

Updated Dec 10, 2024 • 1.65k • 3

casperhansen/qwq-32b-preview-awq

Updated Dec 15, 2024 • 71 • 1

RichardErkhov/zake7749_-_Llama-3.2-1B-it-chinese-kyara-awq

Updated Dec 22, 2024 • 7 • 1

kosbu/QVQ-72B-Preview-AWQ

Image-Text-to-Text • Updated Dec 25, 2024 • 886 • 8

jsbaicenter/Llama-3.3-70b-Instruct-AWQ-4BIT-GEMM

Updated 1 day ago • 26 • 1

OPEA/DeepSeek-V3-int4-sym-awq-inc

Updated about 11 hours ago • 112 • 3

internlm/internlm3-8b-instruct-awq

Text Generation • Updated 27 days ago • 493 • 3

PrunaAI/djuna-Q2.5-Veltha-14B-0.5-AWQ-4bit-smashed

Updated 21 days ago • 32 • 1

casperhansen/deepseek-r1-distill-qwen-14b-awq

Updated 3 days ago • 6.12k • 8