Serverless component nuclio doesn't support nvidia-docker / GPU acceleration.

[mhe-wyze]

I've just created this issue ticket under their repo.
nuclio/nuclio#1781

Meanwhile, is there anyone knows besides asking nuclio's cooperation, do we have another quick solution for this?
Thanks for your help ahead.

[nmanovic]

@mhe-wyze , thanks!

[mhe-wyze]

Hi, @nmanovic thanks for your help on this issue, the problem has been solved by changing the docker config file.
/etc/docker/daemon.json
from

{
    "runtimes": {
        "nvidia": {
            "path": "nvidia-container-runtime",
            "runtimeArgs": []
        }
    }
}

to

{
    "default-runtime": "nvidia",
    "runtimes": {
        "nvidia": {
            "path": "nvidia-container-runtime",
            "runtimeArgs": []
        }
    }
}

[veer5551]

Hello,

Any update on using/configuring the GPU for the deployed models on the CVAT using nuclio?
Currently, it is taking a considerable large amount of time. So assuming its running on CPU!

Thanks a lot!

[charlescho64]

Hello @mhe-wyze @nmanovic

I can't find /etc/docker/daemon.json after installing cvat in ubuntu.
Please let know how to use GPU in models.

[mhe-wyze]

daemon.json is docker file @charlescho64 , did you forget to install the docker or nvidia-docker?

[charlescho64]

Hi @mhe-wyze

I installed following instruction guide " Ubuntu 18.04 (x86_64/amd64)

• https://github.com/openvinotoolkit/cvat/blob/develop/cvat/apps/documentation/installation.md "

If I use GPU in severless model on my desktop which have 2 GPUs, how to set up?

[nmanovic]

@charlescho64 , @mhe-wyze , it was implemented. Please see documentation: https://openvinotoolkit.github.io/cvat/docs/administration/advanced/installation_automatic_annotation/#gpu-support