Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

updated wino evaluation #859

Merged
merged 2 commits into from
Nov 9, 2023
Merged

updated wino evaluation #859

merged 2 commits into from
Nov 9, 2023

Conversation

RakshitKhajuria
Copy link
Contributor

@RakshitKhajuria RakshitKhajuria commented Oct 25, 2023 •
edited
Loading

Description

This PR aims at Enhancing wino bias evaluation for HuggingFace Models, Previously the evaluation was not to the point for hugging face models

Type of change

Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

Usage

Checklist:

  • I've added Google style docstrings to my code.
  • I've used pydantic for typing when/where necessary.
  • I have linted my code
  • I have added tests to cover my changes.

Screenshots (if appropriate):

@RakshitKhajuria RakshitKhajuria added 💡Enhancements Something can be improved v2.1.0 Issue or request to be done in v2.1.0 release labels Oct 25, 2023
@RakshitKhajuria RakshitKhajuria self-assigned this Oct 25, 2023
@RakshitKhajuria RakshitKhajuria linked an issue Oct 25, 2023 that may be closed by this pull request
Enhance Wino bias Evaluation on LLM #858
Closed
chakravarthik27
chakravarthik27 approved these changes Oct 26, 2023
View reviewed changes
Copy link
Collaborator

@chakravarthik27 chakravarthik27 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add some screenshots

@RakshitKhajuria RakshitKhajuria changed the base branch from refactor/delete-dead-code to release/1.8.0 November 9, 2023 09:56
@ArshaanNazir ArshaanNazir merged commit f281508 into release/1.8.0 Nov 9, 2023
@ArshaanNazir ArshaanNazir deleted the enhance-wino-bias-llm-evaluation branch November 16, 2023 06:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@chakravarthik27 chakravarthik27 chakravarthik27 approved these changes

Assignees

@RakshitKhajuria RakshitKhajuria

Labels
💡Enhancements Something can be improved v2.1.0 Issue or request to be done in v2.1.0 release
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Enhance Wino bias Evaluation on LLM
3 participants
@RakshitKhajuria @chakravarthik27 @ArshaanNazir