[PaddlePaddle Hackathon] 第51题 #1115

iverxin · 2021-10-04T09:10:25Z

PR types

New features

PR changes

Models

Description

#1079

在PaddleNLP的Bert代码中，新增 BertJapaneseTokenizer。
新增 cl-tohoku/bert-base-japanese，cl-tohoku/bert-base-japanese-whole-word-masking，cl-tohoku/bert-base-japanese-char 和 cl-tohoku/bert-base-japanese-char-whole-word-masking 四个模型参数权重。
包含代码+注释+ 项目单测文件+贡献模型权重+权重转换代码

iverxin · 2021-10-04T15:56:13Z

模型权重下载地址：
链接：https://pan.baidu.com/s/1MjlcvK8P4rMdEtrf3gid4Q
提取码：c89w

ZeyuChen · 2021-10-08T14:18:19Z

@iverxin Thanks for your contributons!

yingyibiao · 2021-10-18T12:53:15Z

上传权重请参考下述流程：
https://paddlenlp.readthedocs.io/zh/latest/community/contribute_models/contribute_awesome_pretrained_models.html

paddlenlp/transformers/bert/modeling.py

paddlenlp/transformers/bert/tokenizer.py

yingyibiao · 2021-10-20T09:20:42Z

上传权重请参考下述流程：
https://paddlenlp.readthedocs.io/zh/latest/community/contribute_models/contribute_awesome_pretrained_models.html

按照上述文档，需要在 PaddleNLP/community/ 新增个人目录

iverxin · 2021-10-20T11:24:30Z

上传权重请参考下述流程：
https://paddlenlp.readthedocs.io/zh/latest/community/contribute_models/contribute_awesome_pretrained_models.html

按照上述文档，需要在 PaddleNLP/community/ 新增个人目录

已添加

yingyibiao · 2021-10-20T11:35:10Z

上传权重请参考下述流程：
https://paddlenlp.readthedocs.io/zh/latest/community/contribute_models/contribute_awesome_pretrained_models.html

按照上述文档，需要在 PaddleNLP/community/ 新增个人目录

已添加

一个权重需要一个iverxin下的目录哈

iverxin · 2021-10-20T11:55:51Z

上传权重请参考下述流程：
https://paddlenlp.readthedocs.io/zh/latest/community/contribute_models/contribute_awesome_pretrained_models.html

按照上述文档，需要在 PaddleNLP/community/ 新增个人目录

已添加

一个权重需要一个iverxin下的目录哈

Done

community/iverxin/bert-base-japanese-char-whole-word-masking/files.json

paddlenlp/transformers/bert_japanese/tokenizer.py

community/iverxin/bert-base-japanese-char-whole-word-masking/README.md

paddlenlp/transformers/bert/tokenizer.py

tests/transformers/bert/test_tokenizer.py

yingyibiao · 2021-10-24T12:02:42Z

另外，提交PR时请使用 pre-commit 钩子
https://www.paddlepaddle.org.cn/documentation/docs/zh/guides/10_contribution/local_dev_guide_cn.html#pre-commit

iverxin · 2021-10-26T05:48:22Z

权重和参数已更新，麻烦上传到服务器 3Q~
链接：https://pan.baidu.com/s/1MjlcvK8P4rMdEtrf3gid4Q
提取码：c89w

yingyibiao · 2021-10-26T09:27:29Z

权重和参数已更新，麻烦上传到服务器 3Q~
链接：https://pan.baidu.com/s/1MjlcvK8P4rMdEtrf3gid4Q
提取码：c89w

已上传～

community/iverxin/bert-base-japanese-char-whole-word-masking/files.json

community/iverxin/bert-base-japanese-char/files.json

community/iverxin/bert-base-japanese-whole-word-masking/files.json

community/iverxin/bert-base-japanese/files.json

paddlenlp/transformers/bert/modeling.py

paddlenlp/transformers/bert/tokenizer.py

tests/transformers/bert/test_tokenizer.py

paddlenlp/transformers/bert_japanese/tokenizer.py

iverxin · 2021-10-27T05:37:25Z

已修改~

yingyibiao

LGTM

add bert japanese

5dc08f9

iverxin mentioned this pull request Oct 4, 2021

【PaddlePaddle Hackathon】任务总览 PaddlePaddle/Paddle#35940

Closed

iverxin changed the title ~~add bert japanese~~ [PaddlePaddle Hackathon] 第51题 Oct 4, 2021

ZeyuChen requested a review from yingyibiao October 8, 2021 14:17

ZeyuChen added the Hackathon label Oct 8, 2021

ZeyuChen assigned guoshengCS Oct 8, 2021

yingyibiao reviewed Oct 18, 2021

View reviewed changes

paddlenlp/transformers/bert/modeling.py Outdated Show resolved Hide resolved

paddlenlp/transformers/bert/modeling.py Outdated Show resolved Hide resolved

paddlenlp/transformers/bert/tokenizer.py Outdated Show resolved Hide resolved

yingyibiao and others added 6 commits October 18, 2021 21:07

Merge branch 'develop' into t51

4e43acd

fix model-weight files position

ff5db0c

Merge remote-tracking branch 'origin/t51' into t51

6855b34

add weights files url

5392945

create package: bert_japanese

3e647af

Merge branch 'develop' into t51

f299d94

iverxin added 2 commits October 20, 2021 19:21

update weights readme

2ca28b4

Merge remote-tracking branch 'origin/t51' into t51

0621950

iverxin added 2 commits October 20, 2021 19:47

update weights files

dff2c5c

update config pretrain weights https

22bd7c4

yingyibiao reviewed Oct 20, 2021

View reviewed changes

community/iverxin/bert-base-japanese-char-whole-word-masking/files.json Outdated Show resolved Hide resolved

iverxin added 2 commits October 21, 2021 13:28

修复权重配置文件

de0f7bf

retest CI

c74338a

iverxin requested a review from yingyibiao October 22, 2021 04:23

yingyibiao reviewed Oct 24, 2021

View reviewed changes

Merge branch 'develop' into t51

109db2f

iverxin added 5 commits October 24, 2021 22:01

update

919fcb6

update

c3942ce

fix docstring

6177a03

update

ed9c933

预训练权重更新

b494f71

iverxin and others added 5 commits October 26, 2021 14:11

update weights readme

b096712

remove weights url in codes

f85adb5

update...

1fb1e1e

Merge branch 'develop' into t51

76b9094

update...

bc55f1e

iverxin and others added 3 commits October 27, 2021 09:47

update weights readme

eec73dd

update

2858749

Merge branch 'develop' into t51

7abd183

yingyibiao reviewed Oct 27, 2021

View reviewed changes

iverxin added 3 commits October 27, 2021 13:00

update

00b6b1d

update docstring

c47c473

清理冗余代码

5734afd

iverxin requested a review from yingyibiao October 27, 2021 05:37

Merge branch 'develop' into t51

d943f52

yingyibiao approved these changes Oct 28, 2021

View reviewed changes

yingyibiao merged commit 48e58f0 into PaddlePaddle:develop Oct 28, 2021

iverxin deleted the t51 branch October 28, 2021 05:55

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[PaddlePaddle Hackathon] 第51题 #1115

[PaddlePaddle Hackathon] 第51题 #1115

iverxin commented Oct 4, 2021

iverxin commented Oct 4, 2021

ZeyuChen commented Oct 8, 2021

yingyibiao commented Oct 18, 2021

yingyibiao commented Oct 20, 2021

iverxin commented Oct 20, 2021

yingyibiao commented Oct 20, 2021

iverxin commented Oct 20, 2021

yingyibiao commented Oct 24, 2021

iverxin commented Oct 26, 2021

yingyibiao commented Oct 26, 2021

iverxin commented Oct 27, 2021

yingyibiao left a comment

[PaddlePaddle Hackathon] 第51题 #1115

[PaddlePaddle Hackathon] 第51题 #1115

Conversation

iverxin commented Oct 4, 2021

PR types

PR changes

Description

iverxin commented Oct 4, 2021

ZeyuChen commented Oct 8, 2021

yingyibiao commented Oct 18, 2021

yingyibiao commented Oct 20, 2021

iverxin commented Oct 20, 2021

yingyibiao commented Oct 20, 2021

iverxin commented Oct 20, 2021

yingyibiao commented Oct 24, 2021

iverxin commented Oct 26, 2021

yingyibiao commented Oct 26, 2021

iverxin commented Oct 27, 2021

yingyibiao left a comment

Choose a reason for hiding this comment