Edit Models filters

Inference Providers

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,939

Full-text search

Active filters: awq

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated 9 days ago • 18.5k • 37

Valdemardi/DeepSeek-R1-Distill-Qwen-32B-AWQ

Text Generation • Updated 22 days ago • 18.2k • 22

Valdemardi/DeepSeek-R1-Distill-Llama-70B-AWQ

Text Generation • Updated 22 days ago • 26.9k • 12

cognitivecomputations/DeepSeek-V3-AWQ

Text Generation • Updated 9 days ago • 7.22k • 19

casperhansen/deepseek-r1-distill-llama-70b-awq

Updated 3 days ago • 3.89k • 12

inarikami/DeepSeek-R1-Distill-Qwen-32B-AWQ

Text Generation • Updated 19 days ago • 73.4k • 4

stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

Text Generation • Updated 12 days ago • 5.55k • 7

BioMistral/BioMistral-7B-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 134 • 5

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 32.2k • 56

ibnzterrell/Meta-Llama-3.3-70B-Instruct-AWQ-INT4

Text Generation • Updated Dec 7, 2024 • 22.8k • 18

PointerHQ/Qwen2.5-VL-72B-Instruct-Pointer-AWQ

Image-Text-to-Text • Updated 2 days ago • 319 • 2

TheBloke/30B-Epsilon-AWQ

Text Generation • Updated Nov 9, 2023 • 62 • 3

TheBloke/Wizard-Vicuna-7B-Uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 121 • 7

TheBloke/Mistral-7B-v0.1-AWQ

Text Generation • Updated Nov 9, 2023 • 1.6k • 30

TheBloke/Mistral-7B-Instruct-v0.1-AWQ

Text Generation • Updated Nov 9, 2023 • 12.6k • 38

TheBloke/llava-v1.5-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 123 • 35

TheBloke/deepseek-coder-33B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 15.2k • 35

MohamedRashad/AceGPT-13B-chat-AWQ

Text Generation • Updated Nov 18, 2023 • 54 • 3

TheBloke/open-llama-3b-v2-wizard-evol-instuct-v2-196k-AWQ

Text Generation • Updated Nov 30, 2023 • 135 • 1

TheBloke/deepseek-llm-7B-chat-AWQ

Text Generation • Updated Nov 29, 2023 • 90 • 2

TheBloke/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • Updated Dec 11, 2023 • 36.8k • 43

TheBloke/Rogue-Rose-103b-v0.2-AWQ

Text Generation • Updated Dec 16, 2023 • 7.56k • 4

BioMistral/BioMistral-7B-DARE-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 94 • 3

Qwen/CodeQwen1.5-7B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 67 • 12

casperhansen/llama-3-8b-instruct-awq

Text Generation • Updated Jun 8, 2024 • 14.3k • 22

Qwen/Qwen2-7B-Instruct-AWQ

Text Generation • Updated Aug 21, 2024 • 937 • 20

cecibas/Midnight-Miqu-70B-v1.5-4bit

Text Generation • Updated Jun 7, 2024 • 693k • 3

PrunaAI/Undi95-Llama-3-LewdPlay-8B-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 84 • 1

casperhansen/deepseek-coder-v2-instruct-awq

Text Generation • Updated Jul 3, 2024 • 239 • 12

TechxGenus/DeepSeek-V2-Lite-Chat-AWQ

Text Generation • Updated Jul 4, 2024 • 53 • 2