Skip to content

Commit

Permalink
Update stop sequences for chat
Browse files Browse the repository at this point in the history
  • Loading branch information
abetlen committed Apr 15, 2023
1 parent 83b2be6 commit a6372a7
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion llama_cpp/llama.py
Original file line number Diff line number Diff line change
Expand Up @@ -701,7 +701,7 @@ def create_chat_completion(
for message in messages
)
PROMPT = chat_history + "### Assistant:"
PROMPT_STOP = ["### Assistant:", "### Human:", "\n"]
PROMPT_STOP = ["### Assistant:", "### Human:"]
completion_or_chunks = self(
prompt=PROMPT,
stop=PROMPT_STOP + stop,
Expand Down

0 comments on commit a6372a7

Please sign in to comment.