Context Template & Instruct Template
What to use in SillyTavern?
Chatml, or Mistral V7, or something else?
I'm not sure where I got them from but I had already MistralSmall presets in ST. Maybe I took these: ToastyPigeon/ST-Presets-Mistral-Small but I'm not sure anymore because I usually customize them because most of the presets on hf are unnecessarily bloated and you end up at 5000+ tokens when your card is less than 2000. It just takes attention away from what the model should really focus on. Most of the newer models seem to have no big problem when you use a different preset as long as the system prompt is well written. If you want to use Chatml or Mistral V7 you can use them I've used both already on different MS3-Instruct-24b finetunes and had no problem but I copied the system and only changed it slightly if at all when changing between presets.
ok, thanks.