Not reccomended for use with context sizes above 8192 (#8676)

using Q_8 output tensors and token embeddings

using bartowski's imatrix dataset

GGUF

Model size

8.03B params

Architecture

llama

4-bit

6-bit

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for Reiterate3680/Sekhmet_Aleph-L3.1-8B-v0.1-GGUF

Base model

Quantized

(3)

this model