This repo will be a full stack application which uses RAG for an AI agent to have domain specific knowledge. It currently uses the OpenAI API, but the goal is to have the functionality to swap it for open source models which can be self hosted.
backend
-
Python 🐍 3.11.7
-
FastAPI ⚡
-
Llama Index 🦙
-
tooling
frontend
Infrastructure
- AWS is currently the cloud provider
- GitHub Actions is currently being used for building the CI/CD pipeline.
- Docker is currently being used for containarizing the application
- Auth0 is currently being used for authentication (in the frontend atm)
- Kubernetes will be used to orchestrate the containers
- Terraform will be used for infrastructure provisioning