Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] one ps (2/4) #29560

Merged
merged 9 commits into from
Dec 14, 2020
Merged

Conversation

seiriosPlus
Copy link
Collaborator

@seiriosPlus seiriosPlus commented Dec 11, 2020

PR types

New features

PR changes

Others

Describe

2/4 for OnePS. Team work with @123malin @MrChengmo

PS整合方案(2/3)
本次合入:

  1. Trainer端梯度聚合及参数收发模块communicator, 支持同步训练、异步训练、Geo异步训练
  2. RPC通信模块,包括brpc server/service/clinet 及相关接口。
  3. 合入异构参数服务器Heter相关的通信端相关server/service/client及相关接口
  4. 合入PS基础接口fleet及相关实现. Fleet.h/cc 是整个PS服务的入口。
  5. 加入service相关C++单测.

Change-Id: I7c7b144e121bbce9e1b1b4c60bf8c64e718d1593
@paddle-bot-old
Copy link

Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

seiriosPlus and others added 8 commits December 11, 2020 13:54
Change-Id: Iaa710ff34a1810123a29409d632890e64d743c58
Change-Id: I424c548b1f6dcdbd52867a888a5ce0c45cad9f36
Change-Id: Ie07daace3f6877e8a0e53db03df07c034999e0bb
Change-Id: I53fc37b1cc0022c75f3ec2deaebde1eb3928e5a0
Change-Id: I7e40479137290802eea212c1e90e41d7fee68a5c
Copy link
Contributor

@MrChengmo MrChengmo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

virtual std::future<int32_t> send_client2client_msg(int msg_type,
int to_client_id,
const std::string &msg) {
LOG(FATAL) << "Did not implement";
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

建议还是用统一的报错格式写比较好,可以在后续PR完善

Copy link
Contributor

@XiaoguangHu01 XiaoguangHu01 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@seiriosPlus seiriosPlus merged commit 0034273 into PaddlePaddle:develop Dec 14, 2020
@seiriosPlus seiriosPlus changed the title add service [Feature] one ps (2/4) Dec 15, 2020
seiriosPlus added a commit to seiriosPlus/Paddle that referenced this pull request Dec 24, 2020
* add service, remove ut on mac

* fix heter_profiler & add heter stop method

* fix code style
seiriosPlus added a commit to seiriosPlus/Paddle that referenced this pull request Dec 24, 2020
* add service, remove ut on mac

* fix heter_profiler & add heter stop method

* fix code style
fuyinno4 pushed a commit that referenced this pull request Dec 24, 2020
* add ps table (#29463)

* add ps table

Change-Id: I468a04bd071d21ff52654926fcf4d5f3da19e178

* add service (#29560)

* add service, remove ut on mac

* fix heter_profiler & add heter stop method

* fix code style
fuyinno4 pushed a commit that referenced this pull request Dec 25, 2020
* add ps table (#29463)

* add ps table

Change-Id: I468a04bd071d21ff52654926fcf4d5f3da19e178

* add service (#29560)

* add service, remove ut on mac

* fix heter_profiler & add heter stop method

* fix code style

* merge pscore

Change-Id: Ie7f60d1cdde6755a0c29db26863c6283e9843d57

* fix cmake

Change-Id: I6773509a7b4ca79139ecc40b7bf3eb318ceff8bb

* fix conflit

Change-Id: I35575be0c96a8520f9d756ea7f1ff0b904a165ba

* fix conflit

Change-Id: Ic926ea0b0d67803226d51241397ba3b510226bfa
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants