-
Notifications
You must be signed in to change notification settings - Fork 9.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
llama : save and restore kv cache for single seq id #6341
Merged
Merged
Commits on Mar 27, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 662aaea - Browse repository at this point
Copy the full SHA 662aaeaView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5462817 - Browse repository at this point
Copy the full SHA 5462817View commit details -
Configuration menu - View commit details
-
Copy full SHA for ab1c46a - Browse repository at this point
Copy the full SHA ab1c46aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 02a1840 - Browse repository at this point
Copy the full SHA 02a1840View commit details -
Configuration menu - View commit details
-
Copy full SHA for b8e8fac - Browse repository at this point
Copy the full SHA b8e8facView commit details -
Configuration menu - View commit details
-
Copy full SHA for b182f8f - Browse repository at this point
Copy the full SHA b182f8fView commit details -
Configuration menu - View commit details
-
Copy full SHA for a2b48b9 - Browse repository at this point
Copy the full SHA a2b48b9View commit details
Commits on Mar 28, 2024
-
Configuration menu - View commit details
-
Copy full SHA for c4443d7 - Browse repository at this point
Copy the full SHA c4443d7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4d5356b - Browse repository at this point
Copy the full SHA 4d5356bView commit details
Commits on Mar 29, 2024
-
Configuration menu - View commit details
-
Copy full SHA for bbcbf47 - Browse repository at this point
Copy the full SHA bbcbf47View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8b5ae29 - Browse repository at this point
Copy the full SHA 8b5ae29View commit details -
Configuration menu - View commit details
-
Copy full SHA for a71ec3d - Browse repository at this point
Copy the full SHA a71ec3dView commit details -
Configuration menu - View commit details
-
Copy full SHA for bf1d493 - Browse repository at this point
Copy the full SHA bf1d493View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8ab1a17 - Browse repository at this point
Copy the full SHA 8ab1a17View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0d22136 - Browse repository at this point
Copy the full SHA 0d22136View commit details -
Configuration menu - View commit details
-
Copy full SHA for 29f18c2 - Browse repository at this point
Copy the full SHA 29f18c2View commit details -
Configuration menu - View commit details
-
Copy full SHA for f2e41b3 - Browse repository at this point
Copy the full SHA f2e41b3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 92c4681 - Browse repository at this point
Copy the full SHA 92c4681View commit details -
Configuration menu - View commit details
-
Copy full SHA for 60f685f - Browse repository at this point
Copy the full SHA 60f685fView commit details
Commits on Mar 30, 2024
-
Configuration menu - View commit details
-
Copy full SHA for d38eef4 - Browse repository at this point
Copy the full SHA d38eef4View commit details -
Configuration menu - View commit details
-
Copy full SHA for ea717f7 - Browse repository at this point
Copy the full SHA ea717f7View commit details -
Configuration menu - View commit details
-
Copy full SHA for b509b8b - Browse repository at this point
Copy the full SHA b509b8bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 129b6ff - Browse repository at this point
Copy the full SHA 129b6ffView commit details -
move sequence state file functionality from server to llama to match …
…session api and add version tags
Configuration menu - View commit details
-
Copy full SHA for 8af7211 - Browse repository at this point
Copy the full SHA 8af7211View commit details
Commits on Apr 1, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 3d6fa5b - Browse repository at this point
Copy the full SHA 3d6fa5bView commit details -
Configuration menu - View commit details
-
Copy full SHA for b3f6da3 - Browse repository at this point
Copy the full SHA b3f6da3View commit details -
Configuration menu - View commit details
-
Copy full SHA for be714a0 - Browse repository at this point
Copy the full SHA be714a0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0ccfbf2 - Browse repository at this point
Copy the full SHA 0ccfbf2View commit details
Commits on Apr 4, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 205c44c - Browse repository at this point
Copy the full SHA 205c44cView commit details -
Configuration menu - View commit details
-
Copy full SHA for d9fd0d7 - Browse repository at this point
Copy the full SHA d9fd0d7View commit details
Commits on Apr 5, 2024
-
Configuration menu - View commit details
-
Copy full SHA for f2a4777 - Browse repository at this point
Copy the full SHA f2a4777View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4a4f399 - Browse repository at this point
Copy the full SHA 4a4f399View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2fbf0c3 - Browse repository at this point
Copy the full SHA 2fbf0c3View commit details -
Configuration menu - View commit details
-
Copy full SHA for bf94e9f - Browse repository at this point
Copy the full SHA bf94e9fView commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.