Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🐋 feat: Known Endpoints: DeepSeek #3776

Merged
merged 1 commit into from
Aug 25, 2024
Merged

🐋 feat: Known Endpoints: DeepSeek #3776

merged 1 commit into from
Aug 25, 2024

Conversation

fuegovic
Copy link
Collaborator

@fuegovic fuegovic commented Aug 25, 2024

Summary

Add DeepSeek to known endpoints

    # deepseek
    # https://platform.deepseek.com/api_keys
    # Model list: https://platform.deepseek.com/api-docs/pricing
    - name: "deepseek"
      apiKey: "${DEEPSEEK_API_KEY}"
      baseURL: "https://api.deepseek.com"
      models:
        default: [
          "deepseek-chat",
          "deepseek-coder"
          ]
        fetch: false
      titleConvo: true
      titleModel: "deepseek-chat"
      summarize: false
      summaryModel: "deepseek-chat"
      forcePrompt: false
      modelDisplayLabel: "DeepSeek"

The 8K output tokens limit of the Chat Completion API is in Beta and requires user to set base_url="https://api.deepseek.com/beta". If the base_url is not set to the Beta url, or max_tokens parameter is not set, the limit is 4K tokens.​

image

Note: I will update the docs with an example soon

Change Type

  • New feature (non-breaking change which adds functionality)

Checklist

Please delete any irrelevant options.

  • My code adheres to this project's style guidelines
  • I have performed a self-review of my own code
  • My changes do not introduce new warnings
  • A pull request for updating the documentation has been submitted.

Signed-off-by: Fuegovic <fueg@live.ca>
@danny-avila danny-avila changed the title 🐋 feat - Known Endpoints: DeepSeek 🐋 feat: Known Endpoints: DeepSeek Aug 25, 2024
@danny-avila danny-avila merged commit 07f5201 into main Aug 25, 2024
2 checks passed
@danny-avila danny-avila deleted the deepseek branch August 25, 2024 19:33
kenshinsamue pushed a commit to intelequia/LibreChat that referenced this pull request Sep 17, 2024
Signed-off-by: Fuegovic <fueg@live.ca>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants