Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Edited test_1 prompt to pass under gpt-3.5-turbo #7

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

busse
Copy link
Contributor

@busse busse commented Apr 9, 2023

test_1 under gpt-3.5-turbo was failing because the model was returning single quotes instead of the proper double quotes in the JSON:

=-=-=- Running test: test_1 - Generate fake people with model gpt-3.5-turbo -=-=-=
GPT RAW:  [{'name': 'John', 'age': 25},
 {'name': 'Jane', 'age': 32},
 {'name': 'Bob', 'age': 19},
 {'name': 'Alice', 'age': 47}]
Output: [{'name': 'John', 'age': 25},
 {'name': 'Jane', 'age': 32},
 {'name': 'Bob', 'age': 19},
 {'name': 'Alice', 'age': 47}]
Testing if result is a a string...
Testing if result can be parsed as a list of dictionaries...
test_1: FAILED - 

Perhaps it was encountering a similar issue to this post -- single/double quotes are interchangeable in Python, but not JSON: https://stackoverflow.com/questions/4162642/single-vs-double-quotes-in-json

I have made a small edit to the description_string for test_1, reminding GPT that JSON should have double quotes; to help disambiguate Python formatting vs. JSON formatting.

I have edited the README as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant