Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
-
Updated
Dec 14, 2024 - TypeScript
#
ai-evaluation
Here are 10 public repositories matching this topic...
Hallucinations (Confabulations) Document-Based Benchmark for RAG
benchmark leaderboard gemini llama language-model claude rag hallucinations ai-evaluation llm llm-benchmarking gpt-4o o1-mini o1-preview confabulations
-
Updated
Nov 5, 2024 - HTML
Benchmark evaluating LLMs on their ability to create and resist disinformation. Includes comprehensive testing across major models (Claude, GPT-4, Gemini, Llama, etc.) with standardized evaluation metrics.
nlp machine-learning gemini llama language-model model-evaluation ai-safety mistral claude disinformation ai-security ai-benchmarks ai-evaluation llm llm-benchmarking gpt4o
-
Updated
Oct 22, 2024
RJafroc quick start for those already familiar with windows jafroc
-
Updated
Dec 28, 2023 - TeX
Adaptive Testing Framework for AI Models (Psychometrics in AI Evaluation)
-
Updated
Oct 1, 2024 - Jupyter Notebook
Repository for the LWDA'24 presentation on 'Psychometric Profiling of GPT Models for Bias Exploration', featuring conference materials including the poster, paper, slides, and references.
ai-safety personality-traits interpretability cognitive-bias explainability ai-evaluation gpt-models machine-psychology ai-bias psychometric-analysis lwda24
-
Updated
Sep 23, 2024 - TeX
Improve this page
Add a description, image, and links to the ai-evaluation topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the ai-evaluation topic, visit your repo's landing page and select "manage topics."