Skip to content

Commit

Permalink
docs: connecting to ollama on linux (#52)
Browse files Browse the repository at this point in the history
Signed-off-by: Paul S. Schweigert <paul@paulschweigert.com>
  • Loading branch information
psschwei authored Dec 2, 2024
1 parent 88ebb9f commit 2e5bb98
Showing 1 changed file with 19 additions and 2 deletions.
21 changes: 19 additions & 2 deletions docs/troubleshooting.md
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,7 @@ with your distribution to at least 8GB. If you use podman, you can do this using

```shell
podman machine stop
podman machine set --memory 8192 --rootful
podman machine set --memory 8192 --rootful
podman machine start
```

Expand All @@ -60,6 +60,23 @@ podman machine set --rootful
podman machine start
```

### Connecting to Ollama on Linux

On Linux, using Ollama with the bee-stack requires some extra configuration:

1. In your `.env` file, set `OLLAMA_URL=http://host.docker.internal:11434`.

2. After starting the bee-stack, you will need to resolve `OLLAMA_URL` to the bee-stack bridge network.

```
# exec into bee-api container
docker exec -it bee-stack-bee-api-1 sh
# in container, add ip of bridge network to /etc/hosts
echo "$(ip route | awk '/default/ { print $3 }' | head -n 1) host.docker.internal" | tee -a /etc/hosts > /dev/null
```


## I'm lost

If you encounter any of the issue above, and you're not sure what to do, we recommend using rancher-desktop:
Expand Down Expand Up @@ -103,4 +120,4 @@ You can refer to the following podman issues:
- https://github.com/containers/podman/issues/11319

Or go to the official podman troubleshooting guide:
https://podman-desktop.io/docs/troubleshooting
https://podman-desktop.io/docs/troubleshooting

0 comments on commit 2e5bb98

Please sign in to comment.