llmware
/

tiny-llama-chat-gguf

Text Generation

Model card Files Files and versions Community

tiny-llama-chat-gguf

tiny-llama-chat-gguf is an GGUF Q4_K_M int4 quantized version of TinyLlama-Chat, providing a very fast, very small inference implementation, optimized for AI PCs.

tiny-llama-chat is the official chat finetuned version of tiny-llama.

Model Description

Developed by: TinyLlama
Quantized by: llmware
Model type: llama
Parameters: 1.1 billion
Model Parent: TinyLlama-1.1B-Chat-v1.0
Language(s) (NLP): English
License: Apache 2.0
Uses: Chat and general purpose LLM
RAG Benchmark Accuracy Score: NA
Quantization: int4

Model Card Contact

llmware on github

llmware website

Downloads last month: 0

GGUF

Model size

1.1B params

Architecture

llama

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API has been turned off for this model.

Model tree for llmware/tiny-llama-chat-gguf

Base model

TinyLlama/TinyLlama-1.1B-Chat-v1.0

Quantized

(77)

this model