Demo of Mistral plugged into Retell, see the demo.
- First install dependencies
poetry install
-
Fill out the API keys in
env.sh
-
In another bash, use
ngrok
orcloudflared
to expose the port8080
to public network.
make host-url
- Update the host name and export the environment variables.
source env.sh
- Start the websocket server
make app-start
The custom LLM URL (to enter in Retell) would look like
wss://henry-corrected-julia-drive.trycloudflare.com/llm-websocket