Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LiteLLM Integration #144

Merged
merged 16 commits into from
Apr 23, 2024
Merged

LiteLLM Integration #144

merged 16 commits into from
Apr 23, 2024

Conversation

Ryan-Rishi
Copy link
Contributor

Added the ability to use other LLMs besides OpenAI using LiteLLM.
This required a change to use llm_service instead of openai_service in many places. This acts a union between the 2.
Also added tests that use Gemini API

@Ryan-Rishi Ryan-Rishi changed the title F/litellm service LiteLLM Integration Apr 16, 2024
README.md Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
tonic_validate/validate_scorer.py Outdated Show resolved Hide resolved
tonic_validate/tests/test_scorer_litellm.py Outdated Show resolved Hide resolved
tonic_validate/utils/llm_cache.py Show resolved Hide resolved
tonic_validate/services/litellm_service.py Outdated Show resolved Hide resolved
tonic_validate/services/litellm_service.py Show resolved Hide resolved
@ethan-tonic ethan-tonic marked this pull request as ready for review April 23, 2024 18:44
pyproject.toml Outdated Show resolved Hide resolved
@ethan-tonic
Copy link
Collaborator

Btw I added in some commits which should fix all these issues

@ethan-tonic ethan-tonic merged commit fecb99d into main Apr 23, 2024
4 of 5 checks passed
@ethan-tonic ethan-tonic deleted the f/litellm-service branch April 23, 2024 20:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants