[Bug] The circuit is now open and is not allowing calls error

[roberAlb]

Context / Scenario

We are importing some documents from an Azure Function.

What happened?

We are getting this error sometimes for some of them

The circuit is now open and is not allowing calls

Reviewing code it looks like it's from this piece of code from KM

IList<ReadOnlyMemory>? embeddings = await generator
.GenerateEmbeddingsAsync([text], null, cancellationToken)
.ConfigureAwait(false);

Importance

edge case

Platform, Language, Versions

Windows, C#, last version of KM

Relevant log output

Polly.CircuitBreaker.BrokenCircuitException:
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw (System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e)
   at Microsoft.Extensions.Http.Resilience.Internal.ResilienceHandler+<SendAsync>d__2.MoveNext (Microsoft.Extensions.Http.Resilience, Version=8.0.0.0, Culture=neutral,

[dluc]

I can't say we've tested KM on functions. It's a complex environment in terms of resources and timing.
There might be a limit on the number of tcp/http requests affecting the internal retry logic used by Polly/KM.