update optimizer #26711
Merged
update optimizer #26711
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Thanks for your contribution! |
zhwesky2010
reviewed
Aug 26, 2020
Closed
TCChenlong
reviewed
Aug 31, 2020
chalsliu
approved these changes
Aug 31, 2020
MRXLT
added a commit
to MRXLT/Paddle
that referenced
this pull request
Sep 2, 2020
* update doc * update doc * fix optimizer sample code * add default value for adamw weight_decay * fix adamw * change LearningRateDecay to _LRScheduler * fix adamw;notest * fix load;notest * remove file * bug fix * fix code style * bug fix * add ut * adamw support weight_decay=0 * fix ut * fix set_lr doc * fix doc * change parameters place
MRXLT
added a commit
that referenced
this pull request
Sep 4, 2020
* update optimizer (#26711) * update doc * update doc * fix optimizer sample code * add default value for adamw weight_decay * fix adamw * change LearningRateDecay to _LRScheduler * fix adamw;notest * fix load;notest * remove file * bug fix * fix code style * bug fix * add ut * adamw support weight_decay=0 * fix ut * fix set_lr doc * fix doc * change parameters place * fix sample code
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR types
New features
PR changes
Ops
Describe
修复adamw多次执行step报错的问题
更换learningratedecay为lrscheduler
修复load op在没有params文件时报错的问题
添加参数检查
修复adamw计算错误的问题
修改optimizer相关文档描述，
minimize示例代码改为动态图版本
set_lr添加参数
parameters接收的参数为list[Tensor]而不是list[Tensor.name]
中文文档PR：PaddlePaddle/docs#2424