Hugging Face's logo

lodrick-the-lafted
/
Olethros-8B

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
lodrick-the-lafted commited on
Commit
e9d2bcb
·
verified ·
1 Parent(s): f94b85e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +30 -1
README.md CHANGED
@@ -9,4 +9,33 @@ datasets:
9
 
10
  <img src=https://huggingface.co/lodrick-the-lafted/Olethros-8B/resolve/main/olethros.png>
11
 
12
- L3-8b-Instruct tuned on roughly 6000 Opus generations in the hopes of adding a bit of sovl.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
 
10
  <img src=https://huggingface.co/lodrick-the-lafted/Olethros-8B/resolve/main/olethros.png>
11
 
12
+ # Olethros-8B-AWQ
13
+
14
+ L3-8b-Instruct tuned on roughly 6000 Opus generations in the hopes of adding a bit of sovl.
15
+
16
+ <br />
17
+ <br />
18
+
19
+ <br />
20
+ <br />
21
+
22
+ # Quants
23
+ Exl2 and AWQ available right now.
24
+
25
+ | Type | Misc | Author |
26
+ | ----- | ----- | ----- |
27
+ [AWQ](https://huggingface.co/lodrick-the-lafted/Olethros-8B-AWQ)| | lodrick |
28
+ [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw2.25-exl2)| 2.25bpw | blockblockblock |
29
+ [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw2.5-exl2)| 2.5bpw | blockblockblock |
30
+ [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw3-exl2)| 3.0bpw | blockblockblock |
31
+ [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw3.5-exl2)| 3.5bpw | blockblockblock |
32
+ [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw3.7-exl2)| 3.7bpw | blockblockblock |
33
+ [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw4-exl2)| 4.0bpw | blockblockblock |
34
+ [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw4.2-exl2)| 4.2bpw | blockblockblock |
35
+ [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw4.4-exl2)| 4.4bpw | blockblockblock |
36
+ [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw4.6-exl2)| 4.6bpw | blockblockblock |
37
+ [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw4.8-exl2)| 4.8bpw | blockblockblock |
38
+ [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw5-exl2)| 5.0bpw | blockblockblock |
39
+ [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw5.5-exl2)| 5.5bpw | blockblockblock |
40
+ [exl2](https://huggingface.co/blockblockblock/Olethros-8B-bpw6-exl2)| 6.0bpw | blockblockblock |
41
+