Self-hosted LLM chatbot arena, with yourself as the only judge
-
Updated
Feb 6, 2024 - Python
Self-hosted LLM chatbot arena, with yourself as the only judge
Code and data for paper "Achieving Reliable Human Assessment of Open-Domain Dialogue Systems"
Multidimensional Evaluation for Text Style Transfer Using ChatGPT. Human Judgement as a Compass to Navigate Automatic Metrics for Formality Transfer (HumEval 2022)
Success and Failure Linguistic Simplification Annotation 💃
CS 685 Advanced Natural Language Processing Project: Learning Schematic and Contextual Representations for Text-to-SQL Parsing
A collection of MTurk templates designed to make complex tasks easier for human annotators.
Short tutorial on how to conduct a human study using Amazon Mechanical Turk and Google Drive
ECE1508 applied deep learning group project
Add a description, image, and links to the human-evaluation topic page so that developers can more easily learn about it.
To associate your repository with the human-evaluation topic, visit your repo's landing page and select "manage topics."