Repositories list

• openllm-models

  Public
  Python

  •8•14•1•0•Updated Nov 15, 2024Nov 15, 2024

• BentoML

  Public
  The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

  pythonmachine-learningdeep-learning+ 12model-servingmultimodalmlopsml-engineeringai-inferencellmgenerative-ai+ 5

  Python

  •

  Apache License 2.0

  •792•7.2k•156•12•Updated Nov 15, 2024Nov 15, 2024

• BentoVLLM

  Public
  Self-host LLMs with vLLM and BentoML

  Python

  •12•73•4•2•Updated Nov 15, 2024Nov 15, 2024

• ComfyUI-IDL

  Public
  ComfyUI Interface Definition Language

  Python

  •

  Apache License 2.0

  •0•1•0•0•Updated Nov 15, 2024Nov 15, 2024

• yatai-image-builder

  Public
  🐳 Build OCI images for Bentos in k8s

  dockerdocker-imagecontainer+ 3container-imagekubernetesk8s

  Go

  •9•14•4•13•Updated Nov 14, 2024Nov 14, 2024

• BentoVoiceAgent

  Public
  Build Phone Calling Voice Agent fully powered by open source models.

  voice-agentai-phone-calling-guideai-voice-assistant+ 1ai-phone

  Python

  •1•4•0•0•Updated Nov 14, 2024Nov 14, 2024

• BentoMoshi

  Public
  Python

  •

  Apache License 2.0

  •1•1•0•0•Updated Nov 13, 2024Nov 13, 2024

• BentoSGLang

  Public
  Python

  •0•1•0•0•Updated Nov 12, 2024Nov 12, 2024

• helm-charts

  Public
  0•0•0•0•Updated Nov 12, 2024Nov 12, 2024

• bentoml-comfyui

  Public
  BentoML extension for ComfyUI

  Python

  •

  MIT License

  •0•2•0•0•Updated Nov 12, 2024Nov 12, 2024

• .github

  Public
  ✨🍱🦄️

  4•1•0•0•Updated Nov 11, 2024Nov 11, 2024

• OpenLLM

  Public
  Run any open-source LLMs, such as Llama, Gemma, as OpenAI compatible API endpoint in the cloud.

  llamamistralfine-tuning+ 15mlopsbentomlvicunallmmodel-inferencellmopsllm-serving+ 8

  Python

  •

  Apache License 2.0

  •638•10k•18•3•Updated Nov 11, 2024Nov 11, 2024

• quickstart

  Public
  BentoML Quickstart Example

  Python

  •

  Apache License 2.0

  •5•6•0•0•Updated Nov 11, 2024Nov 11, 2024

• yatai-common

  Public
  Go

  •5•1•0•2•Updated Nov 7, 2024Nov 7, 2024

• BentoComfyUI

  Public
  Python

  •0•0•0•0•Updated Nov 6, 2024Nov 6, 2024

• bentocloud-homepage-news

  Public
  1•1•0•0•Updated Nov 1, 2024Nov 1, 2024

• BentoDiffusion

  Public
  BentoDiffusion: A collection of diffusion models served with BentoML

  kubernetesailora+ 4model-servingfine-tuningdiffusion-modelsstable-diffusion

  Python

  •

  Apache License 2.0

  •25•337•9•1•Updated Nov 1, 2024Nov 1, 2024

• BentoColPali

  Public
  Python

  •0•0•0•0•Updated Oct 24, 2024Oct 24, 2024

• BentoSpacy

  Public
  Python

  •0•0•0•0•Updated Oct 21, 2024Oct 21, 2024

• byoc

  Public
  Shell

  •1•0•0•1•Updated Oct 18, 2024Oct 18, 2024

• BentoDeepSpeedMII

  Public
  Python

  •0•0•0•1•Updated Oct 17, 2024Oct 17, 2024

• circus

  Public
  A Process & Socket Manager built with zmq

  Python

  •

  Other

  •258•0•0•1•Updated Oct 16, 2024Oct 16, 2024

• BentoCrewAI

  Public
  Serving CrewAI Agent as REST API with BentoML, optionally with self-host open-source LLMs

  Python

  •1•3•0•1•Updated Oct 15, 2024Oct 15, 2024

• BentoXTTSStreaming

  Public
  xtts with streaming endpoint

  Python

  •0•0•0•0•Updated Oct 15, 2024Oct 15, 2024

• BentoCLIP

  Public
  building a CLIP application using BentoML

  Python

  •2•8•0•3•Updated Oct 11, 2024Oct 11, 2024

• BentoSentenceTransformers

  Public
  how to build a sentence embedding application using BentoML

  Python

  •2•6•0•2•Updated Oct 11, 2024Oct 11, 2024

• BentoXTTS

  Public
  how to build an text-to-speech application using BentoML

  Python

  •2•5•1•3•Updated Oct 11, 2024Oct 11, 2024

• BentoFunctionCalling

  Public
  Python

  •1•4•0•1•Updated Oct 11, 2024Oct 11, 2024

• BentoWhisperX

  Public
  Python

  •5•10•0•8•Updated Oct 11, 2024Oct 11, 2024

• BentoBLIP

  Public
  how to build an image captioning application on top of a BLIP model with BentoML

  Python

  •2•3•0•3•Updated Oct 11, 2024Oct 11, 2024