Skip to content

Latest commit

 

History

History
173 lines (109 loc) · 10.3 KB

providers.md

File metadata and controls

173 lines (109 loc) · 10.3 KB
Raw

☁️ Providers

🤖 Agents are powered by a provider. The provider could be a local service or a cloud service.

The list of supported providers is below.

Table of contents

How to choose a provider

If you're not sure which provider to start with, we recommend OpenAI as it's the most popular and has the widest range of capabilities: 💬 text-generation, 🖌️ image-generation, 🦻 speech-to-text, 🗣️ text-to-speech.

You don't need to choose just one though. The bot supports mixing & matching models, so you can use multiple providers at the same time.

How to use a provider

  1. 📝 Sign up for it

  2. 🔑 Obtain an API key

  3. 🤖 Create one or more agents in a given room or globally. Next to each provider in the list below you'll see 🗲 Quick start commands, but you may also refer to the agent creation guide.

  4. 🤝 Set the new agent as a handler for a given use-purpose like text-generation, image-generation, etc. The agent creation wizard will tell you how, but you may also refer to the 🤝 Handlers guide.

Supported providers

Anthropic

Anthropic is an American AI company founded by former OpenAI engineers and providing powerful language models.

💡 When creating an agent, the bot will show you an up-to-date sample configuration for this provider which looks like this.

Groq

Groq is an American company developing optimized Language Processing Units (LPU) and offering cloud service which runs various models (built by others) with very high performance.

💡 When creating an agent, the bot will show you an up-to-date sample configuration for this provider which looks like this.

LocalAI

LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that’s compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families and architectures.

💡 When creating an agent, the bot will show you an up-to-date sample configuration for this provider which looks like this.

Mistral

Mistral AI is a research lab based in Europe (France) which produces their own language models.

💡 When creating an agent, the bot will show you an up-to-date sample configuration for this provider which looks like this.

Ollama

Ollama lets you run various models in a self-hosted way. This is more advanced and requires powerful hardware for running some of the better models, but ensures your data stays with you.

  • 🆔 Identifier: ollama
  • 🔗 Links: 🏠 Home page, 📋 Models list
  • 🌟 Capabilities: 💬 text-generation
  • 🗲 Quick start:
    • create a room-local agent: !bai agent create-room-local ollama my-ollama-agent
    • create a global agent: !bai agent create-global ollama my-ollama-agent

💡 When creating an agent, the bot will show you an up-to-date sample configuration for this provider which looks like this.

OpenAI

OpenAI is an American AI company providing powerful language models.

Use this provider either with the OpenAI API or with other OpenAI-compatible API services which fully adhere to the OpenAI API spec. For services which are not fully compatible with the OpenAI API, consider using the OpenAI Compatible provider.

💡 When creating an agent, the bot will show you an up-to-date sample configuration for this provider which looks like this.

OpenAI Compatible

This provider allows you to use OpenAI-compatible API services like OpenRouter, Together AI, etc.

Some of these popular services already have shortcut providers (leading to this one behind the scenes) - this make it easier to get started.

This provider is just as featureful as the OpenAI provider, but is more compatible with services which do not fully adhere to the OpenAI API spec.

💡 When creating an agent, the bot will show you an up-to-date sample configuration for this provider which looks like this.

OpenRouter

OpenRouter is a unified interface for LLMs. The platform scouts for the lowest prices and best latencies/throughputs across dozens of providers, and lets you choose how to prioritize them.

  • 🆔 Identifier: openrouter
  • 🔗 Links: 🏠 Home page, 👤 Sign up, 📋 Models list
  • 🌟 Capabilities: 💬 text-generation
  • 🗲 Quick start:
    • create a room-local agent: !bai agent create-room-local openrouter my-openrouter-agent
    • create a global agent: !bai agent create-global openrouter my-openrouter-agent

💡 When creating an agent, the bot will show you an up-to-date sample configuration for this provider which looks like this.

Together AI

Together AI makes it easy to run or fine-tune leading open source models with only a few lines of code.

  • 🆔 Identifier: together-ai
  • 🔗 Links: 🏠 Home page, 👤 Sign up, 📋 Models list
  • 🌟 Capabilities: 💬 text-generation
  • 🗲 Quick start:
    • create a room-local agent: !bai agent create-room-local together-ai my-together-ai-agent
    • create a global agent: !bai agent create-global together-ai my-together-ai-agent

💡 When creating an agent, the bot will show you an up-to-date sample configuration for this provider which looks like this.