Edit Models filters

Inference Providers

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,940

Full-text search

Active filters: awq

casperhansen/deepseek-r1-distill-qwen-32b-awq

Updated 3 days ago • 8.95k • 5

Valdemardi/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-AWQ

Text Generation • Updated 19 days ago • 860 • 3

casperhansen/mistral-small-24b-instruct-2501-awq

Updated 12 days ago • 3.06k • 6

v2ray/GPT4chan-24B-AWQ

Text Generation • Updated 7 days ago • 9 • 1

Orion-zhen/DeepSeek-R1-Distill-Qwen-32B-abliterated-AWQ

Updated 5 days ago • 20 • 1

CAPsMANyo/DeepSeekR1-Qwen2.5-Coder-32B-Preview-AWQ

Updated 4 days ago • 58 • 1

casperhansen/mpt-7b-8k-chat-awq

Text Generation • Updated Nov 4, 2023 • 28 • 3

casperhansen/falcon-7b-awq

Text Generation • Updated Nov 4, 2023 • 33 • 1

casperhansen/vicuna-7b-v1.5-awq

Text Generation • Updated Oct 31, 2023 • 29 • 3

casperhansen/vicuna-7b-v1.5-awq-gemv

Text Generation • Updated Oct 31, 2023 • 25 • 1

casperhansen/mpt-7b-8k-chat-awq-gemv

Text Generation • Updated Oct 31, 2023 • 21

casperhansen/opt-125m-awq

Text Generation • Updated Oct 31, 2023 • 281 • 3

casperhansen/tinyllama-1b-awq

Text Generation • Updated Oct 31, 2023 • 5.17k

Bomml/Llama-2-70B-chat-w4-g128-awq

Text Generation • Updated Sep 16, 2023

TheBloke/Llama-2-7B-Chat-AWQ

Text Generation • Updated Nov 9, 2023 • 6.26k • 20

TheBloke/Llama-2-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 911 • 16

TheBloke/Llama-2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 139 • 13

TheBloke/CodeLlama-13B-Python-AWQ

Text Generation • Updated Nov 9, 2023 • 13 • 2

TheBloke/CodeLlama-13B-Instruct-AWQ

Text Generation • Updated Nov 9, 2023 • 65 • 9

TheBloke/CodeLlama-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 178 • 4

TheBloke/Llama-2-13B-chat-AWQ

Text Generation • Updated Nov 9, 2023 • 6.25k • 26

TheBloke/Llama-2-70B-AWQ

Text Generation • Updated Nov 9, 2023 • 459 • 14

TheBloke/Llama-2-70B-Chat-AWQ

Text Generation • Updated Nov 9, 2023 • 6.38k • 23

TheBloke/Luban-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 24 • 1

TheBloke/CodeLlama-34B-Instruct-AWQ

Text Generation • Updated Nov 9, 2023 • 31 • 2

TheBloke/CodeLlama-34B-AWQ

Text Generation • Updated Nov 9, 2023 • 65 • 2

TheBloke/Marcoroni-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 22

TheBloke/CodeLlama-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 129 • 5

TheBloke/CodeLlama-7B-Instruct-AWQ

Text Generation • Updated Nov 9, 2023 • 85 • 4

TheBloke/CodeLlama-34B-Python-AWQ

Text Generation • Updated Nov 9, 2023 • 17 • 2