Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clarification on chat API behaviour #3267

Open
hrflr opened this issue Dec 12, 2024 · 1 comment · May be fixed by #3256
Open

Clarification on chat API behaviour #3267

hrflr opened this issue Dec 12, 2024 · 1 comment · May be fixed by #3256

Comments

@hrflr
Copy link

hrflr commented Dec 12, 2024

I am a novice user, so I apologize if this is a trivial question:

My understanding is that the official OpenAI API is stateless: each request starts from scratch, and the caller needs to add history in the request. This is in contrast with the /v1/chat/completions API provided by GPT4all, in which chat history is preserved in the "Server Chat" and subsequent requests are influenced by previous ones.

a) is my understanding correct?
b) is there a way to reset/clear the server chat via the http API?

Thank you!

@cebtenzzre
Copy link
Member

The model actually seeing the previous messages (as opposed to them just appearing in the chat log) is a regression in v3.5, see #3256.
Sorry about that.

@cebtenzzre cebtenzzre linked a pull request Dec 12, 2024 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants