Streaming over rest doesn't actually stream. #2076
Labels
priority: p2
Moderately-important priority. Fix may not be included in next release.
type: bug
Error or flaw in code with unintended results or allowing sub-optimal usage patterns.
Environment details
Steps to reproduce
Look at the output times, it's not streaming, It waits 10s, and then outputs all the chunks at once.
This problem goes away (the times are evenly spaced because the output is actually streaming) if:
transport=GRPC
, orgoogle.ai.generativelanguage
you set "stream=True" in the generated code here.The text was updated successfully, but these errors were encountered: