Upload perplexity.md
Browse files- perplexity.md +30 -0
perplexity.md
ADDED
|
@@ -0,0 +1,30 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
| Quant | Size (MB) | PPL | Size (%) | Accuracy (%) | PPL error rate |
|
| 2 |
+
| ------ | --------- | ------- | -------- | ------------ | -------------- |
|
| 3 |
+
| IQ1_S | 416 | 65.5925 | 14.10 | 18.53 | 1.27 |
|
| 4 |
+
| IQ1_M | 442 | 37.5490 | 14.98 | 32.37 | 0.67 |
|
| 5 |
+
| IQ2_XXS | 487 | 28.2797 | 16.51 | 42.98 | 0.52 |
|
| 6 |
+
| IQ2_XS | 524 | 19.7773 | 17.76 | 61.45 | 0.34 |
|
| 7 |
+
| IQ2_S | 537 | 18.3488 | 18.20 | 66.24 | 0.31 |
|
| 8 |
+
| IQ2_M | 573 | 16.4023 | 19.42 | 74.10 | 0.28 |
|
| 9 |
+
| Q2_K_S | 610 | 16.9464 | 20.68 | 71.72 | 0.28 |
|
| 10 |
+
| IQ3_XXS | 637 | 14.0319 | 21.59 | 86.61 | 0.23 |
|
| 11 |
+
| Q2_K | 644 | 15.4455 | 21.83 | 78.69 | 0.25 |
|
| 12 |
+
| IQ3_XS | 697 | 13.2295 | 23.63 | 91.87 | 0.21 |
|
| 13 |
+
| Q3_K_S | 725 | 13.6908 | 24.58 | 88.77 | 0.22 |
|
| 14 |
+
| IQ3_S | 727 | 13.0527 | 24.64 | 93.11 | 0.21 |
|
| 15 |
+
| IQ3_M | 740 | 12.9347 | 25.08 | 93.96 | 0.21 |
|
| 16 |
+
| Q3_K_M | 785 | 13.1079 | 26.61 | 92.72 | 0.21 |
|
| 17 |
+
| Q3_K_L | 839 | 12.9958 | 28.44 | 93.52 | 0.21 |
|
| 18 |
+
| IQ4_XS | 854 | 12.5238 | 28.95 | 97.04 | 0.20 |
|
| 19 |
+
| IQ4_NL | 892 | 12.5165 | 30.24 | 97.10 | 0.20 |
|
| 20 |
+
| Q4_0 | 894 | 12.6002 | 30.31 | 96.46 | 0.20 |
|
| 21 |
+
| Q4_K_S | 896 | 12.4550 | 30.37 | 97.58 | 0.20 |
|
| 22 |
+
| Q4_K_M | 940 | 12.4048 | 31.86 | 97.97 | 0.20 |
|
| 23 |
+
| Q4_1 | 969 | 12.4660 | 32.85 | 97.49 | 0.20 |
|
| 24 |
+
| Q5_K_S | 1047 | 12.2279 | 35.49 | 99.39 | 0.20 |
|
| 25 |
+
| Q5_0 | 1050 | 12.2580 | 35.59 | 99.15 | 0.20 |
|
| 26 |
+
| Q5_K_M | 1072 | 12.2216 | 36.34 | 99.44 | 0.20 |
|
| 27 |
+
| Q5_1 | 1125 | 12.2391 | 38.13 | 99.30 | 0.20 |
|
| 28 |
+
| Q6_K | 1213 | 12.1951 | 41.12 | 99.66 | 0.20 |
|
| 29 |
+
| Q8_0 | 1570 | 12.1583 | 53.22 | 99.96 | 0.20 |
|
| 30 |
+
| F16 | 2950 | 12.1537 | 100 | 100 | 0.20 |
|