| title | emoji | colorFrom | colorTo | sdk | pinned | license |
|---|---|---|---|---|---|---|
Mistral 7b API |
🐢 |
purple |
pink |
docker |
false |
mit |
This project consists on an API hosted on HuggingFace Spaces that generates text using the amazing Mistral 7B model.
- LangChain: LLM orchestration, document loader, splitter, RAG
- FastAPI: API end-points
- HuggingFace: LLM, Embeddings, API hosting
- ChromaDB: Vector DB
- Text splitter: RecursiveCharacterTextSplitter(chunk_size=850, chunk_overlap=200)
- LLM: mistralai/Mistral-7B-Instruct-v0.1("temperature":0.1, "max_new_tokens":300)
- Retriever: similarity search, top k=4, "score_threshold": .95
- chain_type: stuff