Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

More details on the rules for naming the trained prompts in the "task_prompt_emb" folder #22

Open
Zenvi opened this issue Jan 27, 2024 · 0 comments

Comments

@Zenvi
Copy link

Zenvi commented Jan 27, 2024

Hello! Thank you greatly for your extensive work and code!

I'm thinking about using the pretrained prompt embeddings directly, which are just stored in the Prompt-Transferability-2.0-latest/task_prompt_emb folder. Great thanks for that!

It's just the names of each sub-folders that confuse me, as I don't quite understand your naming protocol.

For example, if I'm looking for the prompt embeddings trained on the Deontology dataset using RoBERTa model, then ethicsdeontologyPromptRoberta should probably be the right folder.
However, for some datasets and some models, there could be multiple folders. For example, in the case of RoBERTa on IMDB, there are some confusing folders:

  • IMDB_base_emotionPromptRoberta
  • IMDB_base_nliPromptRoberta
  • IMDB_trainedPromptRoberta
  • IMDBPromptRoberta

Such confusion makes it a little hard for me to quickly get the right prompt embedding.
So, if it's okay, may I ask what are the differences between folders like that?
Or, in another word, may I ask for a short description of your naming protocol when you save the prompts?

Again, thank you for your work and code. All the best wishes!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant