📟 Relay v0.1 (Mistral Nemo 2407): 4-bit (bnb)

This model page includes the 4-bit bitsandbytes version of relay-v0.1-Mistral-Nemo-2407. For more details about the model, and how it should be used, please see that model page.

Downloads last month: 10

Safetensors

Model size

6.97B params

Tensor type

F32

FP16

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for danlou/relay-v0.1-Mistral-Nemo-2407-4bit

Base model

mistralai/Mistral-Nemo-Base-2407

Finetuned

danlou/relay-v0.1-Mistral-Nemo-2407

Quantized

(4)

this model

Dataset used to train danlou/relay-v0.1-Mistral-Nemo-2407-4bit

Collection including danlou/relay-v0.1-Mistral-Nemo-2407-4bit

📟 Relay

Collection

Turning base LLMs into IRCs, for more natural and versatile chat applications. • 5 items • Updated Dec 13, 2024