Artefact2
/

Midnight-Rose-70B-v2.0.3-GGUF

Inference Endpoints

Model card Files Files and versions Community

Midnight-Rose-70B-v2.0.3-GGUF

1 contributor

History: 9 commits

Artefact2's picture

Upload Midnight-Rose-70B-v2.0.3-Q2_K.gguf with huggingface_hub

8fd4108 verified about 1 year ago

.gitattributes

2.1 kB

Upload Midnight-Rose-70B-v2.0.3-Q2_K.gguf with huggingface_hub about 1 year ago
Midnight-Rose-70B-v2.0.3-Q2_K.gguf

25.5 GB
LFS

Upload Midnight-Rose-70B-v2.0.3-Q2_K.gguf with huggingface_hub about 1 year ago
Midnight-Rose-70B-v2.0.3-Q3_K_L.gguf

36.1 GB
LFS

Upload Midnight-Rose-70B-v2.0.3-Q3_K_L.gguf with huggingface_hub about 1 year ago
Midnight-Rose-70B-v2.0.3-Q3_K_M.gguf

33.3 GB
LFS

Upload Midnight-Rose-70B-v2.0.3-Q3_K_M.gguf with huggingface_hub about 1 year ago
Midnight-Rose-70B-v2.0.3-Q4_K_M.gguf

41.4 GB
LFS

Upload Midnight-Rose-70B-v2.0.3-Q4_K_M.gguf with huggingface_hub about 1 year ago
Midnight-Rose-70B-v2.0.3-Q4_K_S.gguf

39.2 GB
LFS

Upload Midnight-Rose-70B-v2.0.3-Q4_K_S.gguf with huggingface_hub about 1 year ago
Midnight-Rose-70B-v2.0.3-Q5_K_M.gguf

48.8 GB
LFS

Upload Midnight-Rose-70B-v2.0.3-Q5_K_M.gguf with huggingface_hub about 1 year ago
Midnight-Rose-70B-v2.0.3-Q5_K_S.gguf

47.5 GB
LFS

Upload Midnight-Rose-70B-v2.0.3-Q5_K_S.gguf with huggingface_hub about 1 year ago
Midnight-Rose-70B-v2.0.3-imatrix.dat

24.9 MB
LFS

Upload Midnight-Rose-70B-v2.0.3-imatrix.dat with huggingface_hub about 1 year ago