Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Expanding benchmark #584

Merged
merged 5 commits into from
Sep 30, 2023
Merged

Expanding benchmark #584

merged 5 commits into from
Sep 30, 2023

Conversation

DhruvaBansal00
Copy link
Contributor

This PR adds the following 4 datasets as examples for using autolabel:

  1. Craigslist bargains: Given a passage consisting of negotiation between a seller and buyer about sale of an item, classify the item into one of 'housing', 'furniture', 'bike', 'phone', 'car', 'electronics'.

  2. Mathdatasets: Given a math question, classify it into algebra, arithmetic, measurement, numbers, and probability. The guidelines for each class are also provided in the instructions.

  3. Lexical relation cogalexv: Given two words, classify the relationship between them into one of ANT, HYPER, PART_OF, SYN, RANDOM

  4. Read-extract: Given a paragraph, extract the exact substring from the context which answers the question in the prompt.

@DhruvaBansal00 DhruvaBansal00 self-assigned this Sep 29, 2023
Copy link
Contributor

@nihit nihit left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚀

@nihit nihit merged commit 23299d5 into main Sep 30, 2023
2 checks passed
@nihit nihit deleted the expanding-benchmark branch September 30, 2023 23:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants