New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

训练时出现segmentation fault #28

Open

GryffindorLi opened this issue Mar 10, 2021 · 1 comment

GryffindorLi commented Mar 10, 2021 •

edited

Loading

您好，我在使用coco17数据集训练yolov5s时，训练出现segmentation fault，如下图所示：

在训练中，出现segmentation fault的时间点是随机的，我曾经尝试了多次，每一次都不一样。

我的环境是pytorch==1.3.0，torchvision==0.4.1，cuda10.2。

补充：使用cuda 10.0也出现了同样的问题

Owner

DataXujing commented Jun 23, 2021

请检查你的数据，是否存在错误数据，其次检查自己的硬件比如内存泄漏问题。我给你的Debug的建议是可以先使用少量的数据，把batch和epoch等调的比较小一点，看一看可否完成训练，如果可以正常训练，很可能是数据问题，请检查自己数据的合规性

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment