Add model Prohetnet #1698
Merged
Add model Prohetnet #1698
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
smallv0221
requested changes
Feb 28, 2022
| --epochs=6 \ | ||
| --lr=0.0001 \ | ||
| --warmup_init_lr=1e-07 \ | ||
| --warmup_updates=1000 \ |
| test_data_src = 'data/' + args.dataset + '_data/uncased_tok_data/test.src' | ||
| test_data_tgt = 'data/' + args.dataset + '_data/uncased_tok_data/test.tgt' | ||
|
|
||
| test_dataset = load_dataset( |
There was a problem hiding this comment.
这里可以直接使用paddlenlp内置的cnn_daliymail数据集么
There was a problem hiding this comment.
源码使用的是GLGE baseline的cnn_dailymail，和paddlenlp的cnn_daliymail有点区别，GLGE的文本会多个[S_SEP]标签，不知道会不会产生影响。
There was a problem hiding this comment.
那GLGE baseline的这两个数据集和hugging face的这两个数据集一样么
There was a problem hiding this comment.
cnndm和gigaword都存在一些差别
| from .. import PretrainedTokenizer, BasicTokenizer, WordpieceTokenizer | ||
|
|
||
|
|
||
| class Trie: |
| dev_data_src = 'data/' + args.dataset + '_data/uncased_tok_data/dev.src' | ||
| dev_data_tgt = 'data/' + args.dataset + '_data/uncased_tok_data/dev.tgt' | ||
|
|
||
| train_dataset = load_dataset( |
There was a problem hiding this comment.
这里应该可以直接读内置的cnn_daliymail数据集，gigaword数据集在huggingface上也有，paddlenlp的load_dataset也可以读取HF的数据集
|
如果都能通过传入数据集名称直接加载，应该可以省略一些数据处理代码 |
已修改 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Add new model Prophetnet
The model weight:
链接：https://pan.baidu.com/s/1FOnd01rNvDJoONYegacq1Q
提取码：o28q
The tokenizer vocab file:
链接：https://pan.baidu.com/s/1pUxLy6eGTZFqzf85OlIzUg
提取码：ltp6