Melvin56/Dria-Agent-a-3B-abliterated-GGUF

Original Model : huihui-ai/Dria-Agent-a-3B-abliterated

All quants are made using the imatrix option.

Model Size (GB)
Q2_K_S 1.19
Q2_K 1.27
Q3_K_M 1.60
Q3_K_M 1.60
Q4_0 1.83
Q4_K_M 1.92
Q5_K_M 2.22
Q6_K 2.53
Q8_0 3.28
F16 6.17
Downloads last month
209
GGUF
Model size
3.09B params
Architecture
qwen2

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for Melvin56/Dria-Agent-a-3B-abliterated-GGUF