Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add a show_paremeter_status method to v2 parameter #3699

Closed
lcy-seso opened this issue Aug 27, 2017 · 0 comments
Closed

add a show_paremeter_status method to v2 parameter #3699

lcy-seso opened this issue Aug 27, 2017 · 0 comments
Assignees

Comments

@lcy-seso
Copy link
Contributor

lcy-seso commented Aug 27, 2017

  • After this PR Able to print gradients in event_handler #3085, we can retrieve parameter value and gradient matrices in Python end.

  • Previously, Paddle has a show_parameter_status_period parameter to print some statistical information of value and gradient matrices of every parameter in a model. This is very helpful for debugging the model. But currently, v2 cannot support it.

  • I think besides enabling the original show_parameter_status_period parameter, we can use this PR Able to print gradients in event_handler #3085 to add a show_parameter_status method into the current parameter class to print some statistical information such as the max absolute value of value/gradient matrix, the average absolute value of value/gradient matrix, and so on.

  • Print more information rather than only a cost value is extremely helpful when training a complicated model. I often highly need this feature.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants