llmware
/

qwen-2-0.5b-gguf

Model card Files Files and versions Community

qwen-2-0.5b-instruct-gguf

qwen-2-0.5b-instruct-gguf is Q4_K_M (int 4) quantized version of Qwen2 0.5b Instruct, providing a very fast, very small inference implementation, optimized for AI PCs.

qwen-2-0.5b-instruct-gguf is a leading chat model known for its high accuracy and strong math and logical capabilities.

Model Description

Developed by: Qwen
Quantized by: llmware
Model type: qwen2-0.5b-instruct
Parameters: 0.5 billion
Model Parent: Qwen/Qwen2 0.5B-Instruct
Language(s) (NLP): English
License: Apache 2.0
Uses: General purpose chat
RAG Benchmark Accuracy Score: NA
Quantization: Q4_K_M

Model Card Contact

llmware on github

llmware website

Downloads last month: 0

GGUF

Model size

494M params

Architecture

qwen2

4-bit

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API has been turned off for this model.

Model tree for llmware/qwen-2-0.5b-gguf

Base model

Qwen/Qwen2-0.5B

Finetuned

Qwen/Qwen2-0.5B-Instruct

Quantized

(54)

this model