You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Instead of returning the response to the user, upload the response quickly to a fast S3 bucket (like GCS or R2), and return a presigned URL to the client. This would only work for non-streaming responses.
This has been supported in OpenAI's python client since: openai/openai-python#1100. Following redirects with fetch in JavaScript is a default thing.
The Feature
Instead of returning the response to the user, upload the response quickly to a fast S3 bucket (like GCS or R2), and return a presigned URL to the client. This would only work for non-streaming responses.
This has been supported in OpenAI's python client since: openai/openai-python#1100. Following redirects with
fetch
in JavaScript is a default thing.PoC:
Then when using:
Then this results in a GET request with these headers:
Note to self, do not presigned the GET URL with the
authorization
header.Motivation, pitch
For large responses:
Twitter / LinkedIn details
https://www.linkedin.com/in/davidmanouchehri/
The text was updated successfully, but these errors were encountered: