About
GGUF Quantizations of https://huggingface.co/01-ai/Yi-1.5-9B
Provided Quantizations
| Link | Type |
|---|---|
| GGUF | Q2_K |
| GGUF | Q3_K_S |
| GGUF | Q3_K_M |
| GGUF | Q3_K_L |
| GGUF | Q4_0 |
| GGUF | Q4_K_S |
| GGUF | Q4_K_M |
| GGUF | Q5_0 |
| GGUF | Q5_K_S |
| GGUF | Q5_K_M |
| GGUF | Q6_K |
| GGUF | Q8_0 |
In a circular citation, I borrowed the format of this file from https://huggingface.co/mradermacher/copy_of_wildjailbreak_13-GGUF.
- Downloads last month
- 14
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model’s pipeline type.
Model tree for larenspear/Yi-1.5-9B-Chat-GGUF
Base model
01-ai/Yi-1.5-9B