Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add compare accuracy api #53430

Merged
merged 15 commits into from
May 9, 2023
Merged

Conversation

zkh2016
Copy link
Contributor

@zkh2016 zkh2016 commented Apr 27, 2023

PR types

New features

PR changes

APIs

Description

新增精度对比接口,解析两个日志或Dump文件里面的数据,并生成excel。

效果:
image

@paddle-bot
Copy link

paddle-bot bot commented Apr 27, 2023

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@paddle-bot
Copy link

paddle-bot bot commented Apr 27, 2023

❌ The PR is not created using PR's template. You can refer to this Demo.
Please use PR's template, it helps save our maintainers' time so that more developers get helped.

Copy link
Contributor

@sunzhongkai588 sunzhongkai588 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

一些优化建议

dump_path(str): The path of the running log, such as the log for execution using the fp32 type.
another_dump_path(str): the path of another running log ,such as the log for execution using the fp16 type.
output_filename(str): the excel file nmae of compare output.
loss_scale(float): the loss_scale during the training phase.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • 这个参数好像也是可选的,请确认下,加上optional。
  • 写清楚该参数的默认值,以及默认值的含义

This is a precision comparison tool that can be used to compare log data of float16 and float32.

Args:
dump_path(str): The path of the running log, such as the log for execution using the fp32 type.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

type建议写成 data type,下同

@zkh2016
Copy link
Contributor Author

zkh2016 commented May 9, 2023

一些优化建议

感谢,我再提一个修复的PR

Copy link
Contributor

@sunzhongkai588 sunzhongkai588 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@zkh2016 LGTM。 该pr先合入,需要在 5月12 日前提供以下优化

  • 本pr提及的文档优化建议
  • 该api对应的中文文档

Copy link
Contributor

@ZzSean ZzSean left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM for skipIf

lanxianghit pushed a commit that referenced this pull request May 9, 2023
@zkh2016 zkh2016 merged commit 4907485 into PaddlePaddle:develop May 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants