Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add the paddlenlp server #2845

Merged
merged 6 commits into from
Nov 21, 2022
Merged

add the paddlenlp server #2845

merged 6 commits into from
Nov 21, 2022

Conversation

wawltor
Copy link
Collaborator

@wawltor wawltor commented Jul 21, 2022 •
edited
Loading

PR types

New features

PR changes

APIs

Description

New features

for the Transformers models serving

from paddlenlp import SimpleServer
service = SimpleServer()
service.register('seq_cls', model_path='checkpoints/model_100/')

for the Taskflow serving

from paddlenlp import SimpleServer
from paddlenlp import Taskflow 
task = Taskflow('ner')
service = SimpleServer()
service.register_taskflow('ner', task)

start the service

paddlenlp server app:service --port 8182 --host 0.0.0.0

@wawltor wawltor marked this pull request as draft July 21, 2022 07:46
ZeyuChen
ZeyuChen reviewed Aug 7, 2022
View reviewed changes
Copy link
Member

@ZeyuChen ZeyuChen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

对名字做个讨论明晰下利弊。另外文档中的专业术语编写
如server，service，serving，最好有个清晰的界定，什么场合用什么词

model_zoo/uie/deploy/serving/simple_serving/README.md Outdated
@@ -0,0 +1,72 @@
# 基于PaddleNLP SimpleServing的服务化部署
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

一会Serving一会Server，这里的专用术语是否有个明确的界定？

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

一会Serving一会Server，这里的专用术语是否有个明确的界定？

service、serving 服务化，服务化在硬件层面和软件层面分为server、client，server意指提供服务的服务器、服务软件，client接收服务的客户端、客户软件

model_zoo/uie/deploy/serving/simple_serving/README.md Outdated
@@ -0,0 +1,72 @@
# 基于PaddleNLP SimpleServing的服务化部署
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Simple Serving你这里需要有空格吗？关于名字是否再做一个讨论？

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Simple Serving你这里需要有空格吗？关于名字是否再做一个讨论？

SimpleServing这里之前的考虑是一个专有名词，目前这个PR还是一个Draft PR

ZeyuChen
ZeyuChen reviewed Aug 16, 2022
View reviewed changes
Copy link
Member

@ZeyuChen ZeyuChen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

明确一个命令行入口后再做功能扩展

而不把命令行入口局限在一个server功能

model_zoo/ernie-health/cblue/deploy/serving/SimpleServing/README.md Outdated
### 分类任务启动
#### 启动 分类 Server 服务
```bash
ppnlp-server server_classification:app --host 0.0.0.0 --port 8989
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

我在想命令行入口是否同意用paddlenlp
paddlenlp server -xxxx
paddlenlp train -xxxx
将来可以往更高阶的自动化训练扩展的同时保持同一个命令行入口

@linjieccc linjieccc mentioned this pull request Aug 18, 2022
Closed
@linjieccc linjieccc marked this pull request as ready for review November 21, 2022 04:53
linjieccc
linjieccc approved these changes Nov 21, 2022
View reviewed changes
Copy link
Contributor

@linjieccc linjieccc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@wawltor wawltor merged commit 351cb20 into PaddlePaddle:develop Nov 21, 2022
@wawltor wawltor mentioned this pull request Nov 25, 2022
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ZeyuChen ZeyuChen ZeyuChen left review comments

@linjieccc linjieccc linjieccc approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@wawltor @ZeyuChen @linjieccc