Is llama.cpp's -p equal to llama-cpp-python's {'role': 'system'}? #510

Unanswered

Freed-Wu asked this question in Q&A

Freed-Wu
Jul 20, 2023

I cannot find any arguments in Llama.__init__ is equal to llama.cpp's -p.
Is llama.cpp's

llama -i -ins -p 'Translate the following text to Chinese'
> XXXX

is equal to llama-cpp-python's

llm.create_chat_completion([{'role': 'system',  'content': 'Translate the following text to Chinese'},  {'role': 'user',  'content': 'XXXX'}])

?

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment