Strange training behaviour

[Vadim2S]

I am run training and observe strange behaviour.

Last model.pt created at 19.02.2024 16:51. I am have model_0.pt ... model_60000.pt files. train.log says:

Now 20.02.2024 8:30 am. and htop says:

I.e. there a lots of CPU consumptions. Almost none GPU consumptions and last log\models changes was half-day ago. What is it?

[wxzwxzwxz]

Hi @Vadim2S

Could you provide additional information, such as nvidia-smi? The references to PNSR and training time, as indicated in the log file, appear to be normal. During the training process, it takes approximately 30 hours.