Dose not the sample code use the system prompt?

#1
by terracottahaniwa - opened
system_prompt = "あなたはプロの小説家です。\n小説を書いてください\n-------- "

prompt = input("Enter a prompt: ")
system_prompt += prompt + "\n-------- "
- model_inputs = tokenizer([prompt], return_tensors="pt").to("cuda")
+ model_inputs = tokenizer([system_prompt], return_tensors="pt").to("cuda")
LocalNovelLLM-project org

It looks like there was a mistake in the code, thanks for reporting it.

Sign up or log in to comment