Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

单机任务失败,paddle_local: line 109: 20695 Segmentation fault #1073

Closed
pkuyym opened this issue Jan 5, 2017 · 10 comments
Closed

单机任务失败,paddle_local: line 109: 20695 Segmentation fault #1073

pkuyym opened this issue Jan 5, 2017 · 10 comments
Assignees

Comments

@pkuyym
Copy link
Contributor

pkuyym commented Jan 5, 2017

paddle_local: line 109: 20695 Segmentation fault ${DEBUGGER} $MYDIR/../opt/paddle/bin/paddle_trainer ${@:2}
请问调试思路?

@luotao1
Copy link
Contributor

luotao1 commented Jan 5, 2017

请贴出完整错误信息

@pkuyym
Copy link
Contributor Author

pkuyym commented Jan 5, 2017

@luotao1
这个已经是完整的错误信息了,好奇怪,在另外的平台上编译,就可以打印出详细的错误信息,求解释

@luotao1
Copy link
Contributor

luotao1 commented Jan 5, 2017

那你是在集群上跑,还是本地跑,跑什么任务等,都得说一下。paddle_local:是什么?本地么

@luotao1
Copy link
Contributor

luotao1 commented Jan 5, 2017

如果生成了core的话,用gdb调试。

@backyes
Copy link
Contributor

backyes commented Jan 5, 2017

@pkuyym

建议从demo开始, 熟悉了系统,你才能更好的找到定位的方法,另外这种异常也没有固定的定位方法, 尤其你根本没有贴出什么具体异常。

@pkuyym
Copy link
Contributor Author

pkuyym commented Jan 5, 2017

@luotao1 单机跑,GPU任务,paddle_local是本地版本,没有出现详细错误信息,没有core文件,编译工具是一键编译,参数为gpu nonrdma

重新用cpu nonrdma编译了一下,可以打印详细错误信息,奇怪。。。

@backyes
Copy link
Contributor

backyes commented Jan 6, 2017

@pkuyym

请问根据文档,是否能将单机demo跑通? 建议先卸载老旧的paddle,然后根据最新文档安装单机版paddle,熟悉demo,然后再考虑复杂场景下的异常定位技巧, :-)。

@hedaoyuan
Copy link
Contributor

@pkuyym 是自己通过源码编译的paddle程序吗?去掉paddle/cuda/src/hl_dso_loader.cc文件中GetDsoHandleFromDefaultPath函数里面的VLOG(3)相关代码再编译试试。
@gangliao follow一下这个问题看看,看起来也是像是initMain之前就挂了。

@pkuyym
Copy link
Contributor Author

pkuyym commented Jan 10, 2017

@hedaoyuan 是的,我是自己编译的paddle,会按照你的建议重新编译下看看,感谢

@Yancey1989
Copy link
Contributor

Close the inactive issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants