[prompt] update prompt api & add prefix template #3724
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
LemonNoel
changed the title
wawltor
reviewed
Nov 16, 2022
|
|
||
| 4. PaddleNLP 版本：2.3.5 (develop) | ||
| 4. PaddleNLP 版本：2.4.2 (develop) |
There was a problem hiding this comment.
这个要么直接2.4.3版本？ 后面也可以直接2.4.3版本
最好能依赖关系放在requirements.txt里面
There was a problem hiding this comment.
已修改为2.4.3版本。相关依赖放在了 requirements_cpu.txt 和 requirements_gpu.txt 文件。
| @@ -352,9 +353,9 @@ python infer.py --model_path_prefix checkpoints/export/model --data_dir ./data - | |||
| 可配置参数说明： | |||
|
|
|||
| - `model_path_prefix`: 导出的静态图模型路径及文件前缀。 | |||
| - `model_name_or_path`: 内置预训练模型名，或者模型参数配置目录路径，用于加载tokenizer。默认为`ernie-3.0-base-zh`。 | |||
| - `model_name`: 内置预训练模型名，用于加载tokenizer。默认为`ernie-3.0-base-zh`。 | |||
There was a problem hiding this comment.
这里为什么model_name_or_path-> model_name ，不可以直接传入一个path进去？
There was a problem hiding this comment.
这里model_name只是为了加载预训练模型相关的参数，用于数据预处理。上边model_path_prefix才是 Prompt 模型的参数地址，之前两个都带 path 容易混淆。
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR types
New features
PR changes
APIs
Description
PrefixTemplate.Verbalizer.MultiMaskVerbalizer.InputExampleandInputFeaturesand usedictinstead for flexibility, where keywordlabelsdenotes the label id of a data sample.Template new features
Keywords
options: Used list of labels in template by defining label_file_path / option_list_name_in_example_dict.prefix: Add prefix soft tokens to inputs on every layer.Attributes
position: Common. Define the start position id of following blocks.token_type: Common. Define the token type id of following blocks.add_omask: Foroptions. Add[O-MASK]to each option.add_prompt: Foroptions. Add prompt text to each option.encoder: Forsoftandprefix. Define the encoder type.hidden_size: Forsoftandprefix. Define the hidden_size of encoder.length: Formask,softandprefix. Define the length of tokens.