Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🚅 docs(ai_endpoints): Reflect correct LiteLLM baseURL when using docker-compose #2324

Merged
merged 1 commit into from
Apr 5, 2024

Conversation

dlaporte
Copy link
Contributor

@dlaporte dlaporte commented Apr 5, 2024

Added note to LiteLLM baseURL to reflect docker-compose usage. Using localhost won't work as those ports aren't exposed through the docker example (and, in my case, would conflict if they were).

Pull Request Template

⚠️ Before Submitting a PR, read the Contributing Docs in full!

Summary

If using the LiteLLM configuration provided in docker-compose.override.yml.example, the corresponding librechat.yaml example provided in the documentation will not work. This is a simple documentation update to provide the correct baseURL using the docker container name vs localhost. As mentioned above, localhost will fail as port 8000 is not exposed.

Change Type

Please delete any irrelevant options.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update
  • Translation update
  • Documentation update

Testing

Please describe your test process and include instructions so that we can reproduce your test. If there are any important variables for your testing configuration, list them here.

Test Configuration:

Checklist

Please delete any irrelevant options.

  • I have made pertinent documentation changes

Added note to LiteLLM baseURL to reflect docker-compose usage
@danny-avila danny-avila changed the title docs: Update ai_endpoints.md to reflect correct LiteLLM baseURL when using docker-compose 🚅 docs(ai_endpoints): Reflect correct LiteLLM baseURL when using docker-compose Apr 5, 2024
@danny-avila danny-avila merged commit 4767673 into danny-avila:main Apr 5, 2024
kenshinsamue pushed a commit to intelequia/LibreChat that referenced this pull request Sep 17, 2024
…er-compose (danny-avila#2324)

Added note to LiteLLM baseURL to reflect docker-compose usage
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants