Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,128

Full-text search

Active filters: GGUF

tensorblock/YuE-s1-7B-anneal-en-cot-GGUF

Text Generation • Updated 14 days ago • 1.32k • 27

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Aug 20, 2024 • 748k • 9

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated 12 days ago • 132k • 2

Mozilla/llava-v1.5-7b-llamafile

Updated Aug 19, 2024 • 24.1k • 178

andrijdavid/MobileLLaMA-1.4B-Base-GGUF

Text Generation • Updated Jan 2, 2024 • 212 • 2

MaziyarPanahi/LongAlpaca-13B-GGUF

Text Generation • Updated Feb 26, 2024 • 106 • 3

MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF

Text Generation • Updated Feb 28, 2024 • 248 • 8

Virt-io/Google-Colab-Imatrix-GGUF

Updated Apr 27, 2024 • 8

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15, 2024 • 620k • 74

LiteLLMs/Mixtral-8x22B-v0.1-GGUF

Updated Apr 18, 2024 • 146 • 1

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 82.1k • 126

LiteLLMs/WizardLM-2-8x22B-GGUF

Updated Apr 18, 2024 • 53 • 4

MaziyarPanahi/Llama-3-8B-Instruct-64k-GGUF

Text Generation • Updated Apr 25, 2024 • 804k • 13

LiteLLMs/French-Alpaca-Llama3-8B-Instruct-v1.0-GGUF

Updated May 28, 2024 • 311 • 4

XeTute/AURORA-V1-1.1B-GGUF

Text Generation • Updated 10 days ago • 7 • 4

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 1.01M • 78

LiteLLMs/aya-23-8B-GGUF

Updated May 28, 2024 • 74 • 2

LiteLLMs/aya-23-35B-GGUF

Updated May 28, 2024 • 78 • 1

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 6, 2024 • 761k • 11

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated Jun 20, 2024 • 808k • 16

legraphista/glm-4-9b-chat-IMat-GGUF

Text Generation • Updated Jun 20, 2024 • 431 • 5

legraphista/glm-4-9b-chat-GGUF

Text Generation • Updated Jun 20, 2024 • 1.54k • 20

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 23, 2024 • 815k • 17

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29, 2024 • 827k • 38

legraphista/gemma-2-2b-it-IMat-GGUF

Text Generation • Updated Jul 31, 2024 • 1.15k • 2

MaziyarPanahi/gemma-2-2b-it-GGUF

Text Generation • Updated Aug 1, 2024 • 861k • 13

legraphista/Hermes-3-Llama-3.1-8B-IMat-GGUF

Text Generation • Updated Aug 16, 2024 • 313 • 1

legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF

Text Generation • Updated Aug 16, 2024 • 206 • 1

legraphista/c4ai-command-r-plus-08-2024-IMat-GGUF

Text Generation • Updated Aug 31, 2024 • 142 • 6

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • Updated Sep 4, 2024 • 813k • 6