Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(participant): update namespace prompt, add additional accuracy tests VSCODE-583 #807

Merged
merged 3 commits into from
Sep 6, 2024

Conversation

Anemy
Copy link
Member

@Anemy Anemy commented Sep 5, 2024

Part of VSCODE-583

Couple things in this pr:

  • updated the namespace parsing regex to allow for just db or collection to be passed
  • updated the namespace prompt to mention that just one can be supplied, with an example
  • added a few more test datasets for the accuracy tests
  • added 2 query tests (aggregation and a create index)
  • added 4 namespace tests
  • added schema passing for our query tests

I'm thinking this should reduce some of the namespace hallucinations. Will need more tests that get deeper into it to really know.

Screenshot 2024-09-05 at 4 18 37 PM

Copy link
Contributor

@nirinchev nirinchev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

src/participant/prompts/namespace.ts Outdated Show resolved Hide resolved
@Anemy Anemy merged commit 15c3e74 into VSCODE-528-mongodb-copilot Sep 6, 2024
3 checks passed
@Anemy Anemy deleted the VSCODE-583-prompt-improvements branch September 6, 2024 15:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants