TheBloke/Falcon-180B-GGUF
Updated
•
18
•
20
Scotch & SOTA 🥃 Pt. 2: Quantized Small Boi LLM 👉👈
Run on potato, sir. GGUF & GPTQ are good friends.
Note ~~~ imagine ~~~
TheBloke/Llama-2-13B-chat-GPTQ
Text Generation • Updated • 32.7k • 362Note Probably the go-to for chat on a GPU rig
TheBloke/CodeLlama-34B-GPTQ
Text Generation • Updated • 74 • 20Note Probably the go-to for code on a GPU rig
-
TheBloke/COTHuginn-4.5-19B-GGUF
Updated • 227 • 7 -
TheBloke/Pygmalion-2-13B-GGUF
Text Generation • Updated • 2.03k • 27
TheBloke/Nous-Hermes-13B-Code-GGUF
Updated • 325 • 8Note nous hermes has been particularly good to me locally
TheBloke/MythoMax-L2-Kimiko-v2-13B-GPTQ
Text Generation • Updated • 50 • 23Note this one has some big fans 🪭
-
TheBloke/Airoboros-L2-70b-2.2-GGUF
Updated • 250 • 13
TheBloke/Spicyboros-70B-2.2-GGUF
Updated • 211 • 21Note toxic
TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ
Text Generation • Updated • 779 • 573Note toxic
-
mistralai/Mistral-7B-v0.1
Text Generation • Updated • 520k • 3.56k