Hugging Face's logo

venkycs
/
Zyte-1B-gguf

GGUF
English
tinyllama
leader
dpo
chat
Inference Endpoints
conversational
Model card Files Community

Model Card for Model ID

Here is original model https://huggingface.co/aihub-app/zyte-1B

LM Studio - https://lmstudio.ai (Fully Supported, make sure you select Zypher template format for inference with model.)

We have chosen to upload our model exclusively in the Q8 format, taking into account its compact size. This decision strikes an optimal balance between speed, performance, and memory usage, ensuring efficient and effective utilization of resources.

Model Card Authors

Special thanks to Venkatesh Siddi for his invaluable support in the conversion of the model to the GGUF format. His expertise and assistance have been instrumental in this process. Connect with him on LinkedIn: https://www.linkedin.com/in/venkycs/

Downloads last month
6
GGUF
Model size
1.1B params
Architecture
llama

8-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.