Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Keep nvcc for MSDeepSpeed Docker image #1711

Merged
merged 4 commits into from
Mar 1, 2021

Conversation

trsvchn
Copy link
Collaborator

@trsvchn trsvchn commented Feb 27, 2021

Fixes #1710

Description:

Prevents nvcc from being removed by excluding g++ removing step from Docker file

Check list:

  • New tests are added (if a new feature is added)
  • New doc strings: description and/or example code are in RST format
  • Documentation is updated (if required)

@sdesrozis
Copy link
Contributor

@trsvchn thank you. What is the size of the image keeping g++ ?

@trsvchn
Copy link
Collaborator Author

trsvchn commented Feb 27, 2021

@sdesrozis

w/o g++   pytorchignite/msdp-apex          latest     14.4GB

w g++      pytorchignite/msdp-apex          latest     14.6GB

@vfdev-5
Copy link
Collaborator

vfdev-5 commented Feb 27, 2021

I also rebuilt it and have

pytorchignite/msdp-apex         test                              154f299788d9        23 hours ago        14.5GB

taking into account that pytorch devel image is

pytorch/pytorch                 1.7.1-cuda11.0-cudnn8-devel       7554ac65eba5        5 weeks ago         12.9GB

@vfdev-5 vfdev-5 mentioned this pull request Mar 1, 2021
Copy link
Collaborator

@vfdev-5 vfdev-5 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @trsvchn !
I'll merge it like that, but we have to fix our CI pipeline for building docker images

@vfdev-5 vfdev-5 merged commit 007d320 into pytorch:master Mar 1, 2021
vfdev-5 added a commit that referenced this pull request Mar 3, 2021
* Keep nvcc for MSDeepSpeed Docker image

* Update Dockerfile.msdp-apex

* Fix broken links for docker images

Co-authored-by: vfdev <vfdev.5@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[docker] DeepSpeed image should contain nvcc
3 participants