Update README.md
Browse files
README.md
CHANGED
@@ -60,3 +60,29 @@ Output on the text above ^. The inference API is set to sample with low temp so
|
|
60 |
|
61 |
|
62 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/60bccec062080d33f875cd0c/0nFP2jsBkritnryKmI8NV.png)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
60 |
|
61 |
|
62 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/60bccec062080d33f875cd0c/0nFP2jsBkritnryKmI8NV.png)
|
63 |
+
|
64 |
+
Note that the inference API parameters used here are an initial educated guess, and may be updated over time:
|
65 |
+
|
66 |
+
```yml
|
67 |
+
inference:
|
68 |
+
parameters:
|
69 |
+
do_sample: true
|
70 |
+
renormalize_logits: true
|
71 |
+
temperature: 0.25
|
72 |
+
top_p: 0.95
|
73 |
+
top_k: 50
|
74 |
+
min_new_tokens: 2
|
75 |
+
max_new_tokens: 96
|
76 |
+
repetition_penalty: 1.04
|
77 |
+
no_repeat_ngram_size: 6
|
78 |
+
epsilon_cutoff: 0.0006
|
79 |
+
```
|
80 |
+
|
81 |
+
Feel free to experiment with the parameters using the model in Python and let us know if you have improved results with other params!
|
82 |
+
|
83 |
+
## Data
|
84 |
+
|
85 |
+
Note that **this checkpoint** was fine-tuned on `teknium/openhermes`, which is generated/synthetic data by an OpenAI model. This means usage of this checkpoint should follow their terms of use: https://openai.com/policies/terms-of-use
|
86 |
+
|
87 |
+
|
88 |
+
---
|