Skip to content

Commit

Permalink
add cote-dp & seabsa16_phns dataset docs (PaddlePaddle#436)
Browse files Browse the repository at this point in the history
* add cote-dp & seabsa16_phns dataset docs
  • Loading branch information
Steffy-zxf authored May 24, 2021
1 parent 9feb941 commit c3d1df6
Show file tree
Hide file tree
Showing 2 changed files with 6 additions and 2 deletions.
5 changes: 5 additions & 0 deletions docs/data_prepare/dataset_list.rst
Original file line number Diff line number Diff line change
Expand Up @@ -48,6 +48,11 @@ PaddleNLP提供了以下数据集的快速读取API,实际使用时请根据
+---------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------+
| `ChnSentiCorp <https://github.com/SophonPlus/ChineseNlpCorpus/blob/master/datasets/ChnSentiCorp_htl_all/intro.ipynb>`__ | 中文评论情感分析语料 | ``paddlenlp.datasets.load_dataset('chnsenticorp')`` |
+---------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------+
| `COTE-DP<https://aistudio.baidu.com/aistudio/competition/detail/50/?isFromLuge=1>`__ | 中文观点抽取语料 | ``paddlenlp.datasets.load_dataset('cote', 'dp')`` |
+---------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------+
| `SE-ABSA16_PHNS<https://aistudio.baidu.com/aistudio/competition/detail/50/?isFromLuge=1>`__ | 中文评价对象级情感分析语料 | ``paddlenlp.datasets.load_dataset('seabsa16', 'phns')`` |
+---------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------+


序列标注
--------
Expand Down
3 changes: 1 addition & 2 deletions examples/language_model/bert/run_pretrain.py
Original file line number Diff line number Diff line change
Expand Up @@ -333,8 +333,7 @@ def do_train(args):
for epoch in range(args.num_train_epochs):
files = [
os.path.join(args.input_dir, f) for f in os.listdir(args.input_dir)
if os.path.isfile(os.path.join(args.input_dir, f)) and "training" in
f
if os.path.isfile(os.path.join(args.input_dir, f)) and "train" in f
]
files.sort()
num_files = len(files)
Expand Down

0 comments on commit c3d1df6

Please sign in to comment.