Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[JS] Add Context Caching Support in Google AI/Vertex AI #1014

Closed
cabljac opened this issue Oct 7, 2024 · 4 comments
Closed

[JS] Add Context Caching Support in Google AI/Vertex AI #1014

cabljac opened this issue Oct 7, 2024 · 4 comments
Assignees
@cabljac
Labels
feature New feature or request

Comments

@cabljac
Copy link
Contributor

cabljac commented Oct 7, 2024

Is your feature request related to a problem? Please describe.

We should support Context Caching:

https://ai.google.dev/gemini-api/docs/caching?lang=node
https://cloud.google.com/vertex-ai/generative-ai/docs/context-cache/context-cache-overview

in the plugins.
@cabljac cabljac added the feature New feature or request label Oct 7, 2024
@cabljac cabljac self-assigned this Oct 7, 2024
@cabljac cabljac changed the title Add context caching Support in Google AI/Vertex AI Add Context Caching Support in Google AI/Vertex AI Oct 7, 2024
@cabljac
Copy link
Contributor Author

cabljac commented Oct 15, 2024

Draft PR:

#1043

@cabljac cabljac changed the title Add Context Caching Support in Google AI/Vertex AI [JS] Add Context Caching Support in Google AI/Vertex AI Oct 21, 2024
@cabljac
Copy link
Contributor Author

cabljac commented Nov 18, 2024

The Vertex AI plugin feature is almost complete, it's just blocked by this fix being merged and released:

googleapis/nodejs-vertexai#469

@cabljac
Copy link
Contributor Author

cabljac commented Nov 18, 2024

Working PR:

#1297

@pavelgj pavelgj moved this to Blocked in Genkit Backlog Nov 25, 2024
@cabljac
Copy link
Contributor Author

cabljac commented Dec 2, 2024

waiting on googleapis/nodejs-vertexai#472

@cabljac cabljac closed this as completed Dec 9, 2024
@github-project-automation github-project-automation bot moved this from Blocked to Done in Genkit Backlog Dec 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@cabljac cabljac

Labels
feature New feature or request
Projects
Genkit Backlog
Status: Done
Milestone
No milestone
Development

No branches or pull requests
1 participant
@cabljac