[few-shot] Update README #3104
Merged
[few-shot] Update README #3104
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
ZHUI
approved these changes
Aug 22, 2022
| | model_name | 训练方式 | Micro F1分数 | Macro F1分数 | | ||
| | ---------- | ------- | ----------- | ----------- | | ||
| | ernie-3.0-base-zh | 微调学习 | 0.7172 | 0.3821 | | ||
| | ernie-3.0-base-zh | 提示学习 | 0.8855 | 0.8443 | |
There was a problem hiding this comment.
微调学习 | 0.7172 | 0.3821
Macro F1分数 没错吧？有点低
There was a problem hiding this comment.
这个是 5 次收敛结果取的均值，有一个Macro F1=0.34，拉低了分数，未收敛的 5 次没有计入结果。
ZHUI
reviewed
Aug 22, 2022
| from paddlenlp.utils.log import logger | ||
| from paddlenlp.transformers import AutoTokenizer, AutoModelForMaskedLM | ||
| from paddlenlp.trainer import PdArgumentParser | ||
| from paddlenlp.trainer import PdArgumentParser, EarlyStoppingCallback |
There was a problem hiding this comment.
我没有验证过EarlyStoppingCallback，注意看效果是否符合预期。
There was a problem hiding this comment.
确认了日志，EarlyStoppingCallback是符合预期的。
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR types
Others
PR changes
Others
Description