Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

.Net: Bug: Error 405 Method Not Allowed with Mistral Chat Completion #6865

Closed
ElieTaillard opened this issue Jun 20, 2024 · 2 comments
Closed
Assignees
Labels
bug Something isn't working .NET Issue or Pull requests regarding .NET code

Comments

@ElieTaillard
Copy link

Description:
I encountered an issue while deploying the Mistral Large model on Azure through an AI hub. When using the method builder.AddMistralChatCompletion(mistralModelName, mistralApiKey, mistralUri), "Mistral") in my kernel builder, everything seems fine. However, when I call the method GetStreamingChatMessageContentsAsync, I receive a 405 Method Not Allowed error.

Reproduction Steps:

  1. Deploy Mistral Large model on Azure AI hub.
  2. Retrieve Mistral API key and URI from the deployment section.
    image
  3. Use the method builder.AddMistralChatCompletion(mistralModelName, mistralApiKey, mistralUri, "Mistral") with the retrieved API key and URI in the kernel builder.
  4. Call GetStreamingChatMessageContentsAsync in the application.
  5. Execute the application.

Expected Behavior:
The GetStreamingChatMessageContentsAsync method should call the correct endpoint and function without any errors.

Actual Behavior:
The application calls the endpoint https://Mistral-large-****-serverless.*****.inference.ai.azure.com/chat/completions and receives a 405 Method Not Allowed error.

Workaround:
I noticed that only the endpoint with /v1/chat/completions works. To circumvent this issue, I added /v1 to the URI parameter.

Possible Cause:
It appears there is an issue with the Mistral connector in the Semantic Kernel. The connector might be missing the /v1 segment in the endpoint path. Additionally, the deployed Mistral model might not accept requests without the /v1 in the URL.

Environment:

  • .NET 8.0
  • Win10
  • Semantic Kernel version: 1.13.0
  • MistralAI Connector version: 1.13.0-alpha
  • Deployment environment: Azure AI hub
  • Mistral model: Mistral Large
@ElieTaillard ElieTaillard added the bug Something isn't working label Jun 20, 2024
@markwallace-microsoft markwallace-microsoft added .NET Issue or Pull requests regarding .NET code triage labels Jun 20, 2024
@github-actions github-actions bot changed the title Bug: Error 405 Method Not Allowed with Mistral Chat Completion .Net: Bug: Error 405 Method Not Allowed with Mistral Chat Completion Jun 20, 2024
@markwallace-microsoft
Copy link
Member

@ElieTaillard Our MistralAI connector is intended to be used with the MistralAI platform see: https://docs.mistral.ai/api/.

For Mistral models deployed to Azure we are working on a new connector. This is the tracking task #3992. This is one of our top priorities but we don't have an ETA yet.

@ElieTaillard
Copy link
Author

Thank you for the information

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working .NET Issue or Pull requests regarding .NET code
Projects
Archived in project
Development

No branches or pull requests

2 participants