Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[oneDNN] elementwise add bf16 grad kernel with broadcasting #31385

Merged
merged 5 commits into from
Mar 9, 2021

Conversation

jczaja
Copy link
Contributor

@jczaja jczaja commented Mar 2, 2021

PR types

New features

PR changes

OPs

Describe

elementwise_add bf16 grad kernel was extended to support broadcasting. This is needed for word2vec bf16 training enablement

@paddle-bot-old
Copy link

paddle-bot-old bot commented Mar 2, 2021

Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

- compilation fix

- compiltion fix

- working reduction

- Added other bradcinding scenarios for elementwise_add grad

- added UT for bf16 elementwise_add_grad broadcasting

- lint

- Enabled some missing tests for grad

- warnings fixed

- pylint fixes

- Lint fixes

- another lint fixes
@jczaja jczaja requested a review from wozna March 5, 2021 16:39
@jczaja
Copy link
Contributor Author

jczaja commented Mar 5, 2021

@arlesniak , @jakpiase Could you please review this PR?

Copy link
Contributor

@jakpiase jakpiase left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jczaja
Copy link
Contributor Author

jczaja commented Mar 8, 2021

@luotao1 Could you please start your review? PR-CI-APPROVAL will not pass without your approval.

@luotao1 luotao1 merged commit 39a5424 into PaddlePaddle:develop Mar 9, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants