Hugging Face's logo

second-state
/
Megrez-3B-Instruct-GGUF

Text Generation
GGUF
English
Chinese
llama
Inference Endpoints
conversational
Model card Files Community
apepkuss79 commited on
Commit
4f14824
·
verified ·
1 Parent(s): 6f9297d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -87,4 +87,4 @@ pipeline_tag: text-generation
87
  | [Megrez-3B-Instruct-Q8_0.gguf](https://huggingface.co/second-state/Megrez-3B-Instruct-GGUF/blob/main/Megrez-3B-Instruct-Q8_0.gguf) | Q8_0 | 8 | 3.10 GB| very large, extremely low quality loss - not recommended |
88
  | [Megrez-3B-Instruct-f16.gguf](https://huggingface.co/second-state/Megrez-3B-Instruct-GGUF/blob/main/Megrez-3B-Instruct-f16.gguf) | f16 | 16 | 5.84 GB| |
89
 
90
- *Quantized with llama.cpp (commit: b92a14a8)*
 
87
  | [Megrez-3B-Instruct-Q8_0.gguf](https://huggingface.co/second-state/Megrez-3B-Instruct-GGUF/blob/main/Megrez-3B-Instruct-Q8_0.gguf) | Q8_0 | 8 | 3.10 GB| very large, extremely low quality loss - not recommended |
88
  | [Megrez-3B-Instruct-f16.gguf](https://huggingface.co/second-state/Megrez-3B-Instruct-GGUF/blob/main/Megrez-3B-Instruct-f16.gguf) | f16 | 16 | 5.84 GB| |
89
 
90
+ *Quantized with llama.cpp b4381*