GGUF LoRA adapters - a ggml-org Collection

ggml-org 's Collections

llama.cpp presets

GGUF LoRA adapters

Gemma 1.1 GGUFs

GGUF LoRA adapters

updated 19 days ago

Adapters extracted from fine tuned models, using mergekit-extract-lora

ggml-org/LoRA-Llama-3-Instruct-abliteration-8B-F16-GGUF

Updated Nov 1, 2024 • 43 • 1
ggml-org/LoRA-Qwen2.5-1.5B-Instruct-abliterated-F16-GGUF

Updated 19 days ago • 85 • 2
ggml-org/LoRA-Qwen2.5-3B-Instruct-abliterated-F16-GGUF

Updated Jan 9 • 59 • 1
ggml-org/LoRA-Qwen2.5-7B-Instruct-abliterated-v3-F16-GGUF

Updated Jan 8 • 168 • 3
ggml-org/LoRA-Qwen2.5-14B-Instruct-abliterated-v2-F16-GGUF

Updated Jan 8 • 93 • 1
ggml-org/LoRA-Qwen2.5-32B-Instruct-abliterated-F16-GGUF

Updated Jan 9 • 283 • 4
ggml-org/LoRA-Qwen2.5-72B-Instruct-abliterated-F16-GGUF

Updated 20 days ago • 47
ggml-org/LoRA-llama-3-70B-Instruct-abliterated-F16-GGUF

Updated 20 days ago • 41
ggml-org/LoRA-phi-4-abliterated-F16-GGUF

Updated Jan 9 • 270 • 2

Note --- Reasoning models (may need special system message):
ggml-org/LoRA-SmallThinker-3B-Preview-F16-GGUF

Updated Jan 9 • 54
ggml-org/LoRA-Deepthink-Reasoning-7B-F16-GGUF

Updated Jan 8 • 116
ggml-org/LoRA-Deepthink-Reasoning-Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • Updated 27 days ago • 34
ggml-org/LoRA-Llama-3.1-8B-MultiReflection-F16-GGUF

Updated Jan 8 • 29

Note --- Other models:
ggml-org/LoRA-Qwen2.5-Coder-7B-Instruct-F16-GGUF

Updated Jan 8 • 43
ggml-org/LoRA-Human-Like-Qwen2.5-7B-Instruct-F16-GGUF

Updated Jan 8 • 25
ggml-org/LoRA-Qwerus-Qwen2.5-7B-Instruct-F16-GGUF

Updated Jan 8 • 23