llm-test

Here are 10 public repositories matching this topic...

uptrain-ai / uptrain

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

machine-learning monitoring evaluation experimentation jailbreak-detection autoevaluation root-cause-analysis prompt-engineering llmops openai-evals llm-prompting llm-eval llm-test hallucination-detection

Updated Aug 18, 2024
Python

georgian-io / LLM-Finetuning-Toolkit

Star

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

nlp unit-testing falcon classification summarization lora nlp-machine-learning zephyr fine-tuning finetuning ablation-study large-language-models flan-t5 redpajama qlora llm-test llama2 mistral-7b

Updated Oct 25, 2024
Python

JohnSnowLabs / langtest

Star

Deliver safe & effective language models

nlp artificial-intelligence benchmarks benchmark-framework model-assessment ai-safety mlops responsible-ai ml-safety trustworthy-ai ethics-in-ai ml-testing large-language-models llm ai-testing llm-test llm-evaluation-toolkit llm-as-evaluator llm-testing

Updated Nov 8, 2024
Python

athina-ai / athina-sdk

Star

LLM Testing SDK that helps you write and run tests to monitor your LLM app in production

monitoring testing-tools aiops mlops llm llmops llm-test

Updated Jan 22, 2024
Python

levitation-opensource / Manipulative-Expression-Recognition

Star

MER is a software that identifies and highlights manipulative communication in text from human conversations and AI-generated responses. MER benchmarks language models for manipulative expressions, fostering development of transparency and safety in AI. It also supports manipulation victims by detecting manipulative patterns in human communication.