Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

Misc with no match

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

104

Full-text search

Active filters: llama.cpp

google/gemma-7b-it-GGUF

Updated Aug 14, 2024 • 26 • 41

google/gemma-2b-it-GGUF

Updated Jun 27, 2024 • 46 • 13

google/codegemma-2b-GGUF

Text Generation • Updated Jun 27, 2024 • 11 • 24

google/codegemma-7b-it-GGUF

Text Generation • Updated Jun 27, 2024 • 37 • 54

google/gemma-2-2b-it-GGUF

Updated Aug 27, 2024 • 354 • 79

dumb-dev/flan-t5-xxl-gguf

Updated Oct 29, 2024 • 760 • 10

dwikitheduck/gen-sql-1-Q4_K_M-GGUF

Updated Nov 18, 2024 • 2 • 1

JackCloudman/QwQ-32B-Preview-jackterated-GGUF

Text Generation • Updated Dec 3, 2024 • 117 • 6

lianghsun/Llama-3.2-Taiwan-3B-Instruct-GGUF

Text Generation • Updated 28 days ago • 1.07k • 6

carsenk/llama3.2_3b_122824_uncensored

Text Generation • Updated Dec 31, 2024 • 372 • 2

carsenk/llama3.2_1b_2025_uncensored

Text Generation • Updated Jan 1 • 374 • 2

carsenk/llama3.2_1b_2025_uncensored_v2

Text Generation • Updated 26 days ago • 1.08k • 4

mradermacher/llama3.2_3b_122824_uncensored-GGUF

Updated 21 days ago • 737 • 1

mradermacher/llama3.2_3b_122824_uncensored-i1-GGUF

Updated 3 days ago • 1.5k • 2

DavidLanz/Llama-3.2-Taiwan-3B-Instruct-GGUF

Text Generation • Updated 20 days ago • 85 • 1

nvjob/Drugban-7B-it-ru-gguf

Updated 17 days ago • 29 • 1

XeTute/Intellect_V0.1-1.8B-GGUF

Text Generation • Updated 7 days ago • 22 • 1

Novaciano/L3.2-2025_SuperUncensored_Q5-GGUF

Text Generation • Updated about 1 month ago • 64 • 1

Novaciano/L3.2-1b-SuperUncensored_V2-IQ3_XXS-GGUF

Text Generation • Updated 22 days ago • 63 • 1

Mozzipa/ko_vicuna_7b_ggml_q4

Updated Apr 20, 2023 • 4

ManthanKulakarni/JQL_LLaMa_GGML

Text Generation • Updated Jun 26, 2023 • 2

mys/ggml_llava-v1.5-7b

Updated Oct 9, 2023 • 1.78k • 108

mys/ggml_llava-v1.5-13b

Updated Oct 10, 2023 • 1.08k • 53

mys/ggml_bakllava-1

Updated Oct 19, 2023 • 17.1k • 75

wasmedge/llama2

Text Generation • Updated Nov 11, 2023 • 72 • 8

alvarobartt/lince-zero-7b-GGUF

Text Generation • Updated Nov 1, 2023 • 15

vietgpt/dama-2-7b-chat-gguf

Text Generation • Updated Nov 17, 2023 • 14 • 1

FlexingD/yarn-mistral-7B-64k-instruct-alpaca-cleaned-GGUF

Updated Dec 4, 2023 • 184 • 5

jdluzen/Mistral-7B-Instruct-v0.2-GGUF

Updated Dec 24, 2023 • 10

jacobhoffmann/CodeLlama-13B-TestGen-Dart_v0.2-GGUF

Text Generation • Updated Dec 11, 2024 • 96