Error using parallel-cpu with trainnet function

19 次查看（过去 30 天）

Ramiro 2024-11-21，21:34

1
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2167878-error-using-parallel-cpu-with-trainnet-function

评论： Ramiro 2024-11-22，13:00

Hi, I got this error when trying to train a neural network using the trainnet function. The first time I trained the network everything works fine, but when I tried to use validation data I got an error. Then I tried to retrain the network without validation data but I got this error:

Error using deep.internal.train.Trainer/train (line 74)

Error detected on worker 3.

Error in deep.internal.train.trainnet (line 54)

net = train(trainer, net, mbq);

Error in trainnet (line 42)

[net,info] = deep.internal.train.trainnet(mbq, net, loss, options, ...

Caused by:

Error using deep.internal.train.ParallelTrainer/computeTraining (line 101)

Out of Memory during deserialization

I have deleted the Jobs of the cluster but nothing worked.

Can anybody help me to solve the issue?

2 个评论
显示无隐藏无

Saurabh 2024-11-22，5:04

Hi @Ramiro,

Could you please share the details regarding the neural network and the memory allocation per worker? The minimum required memory is 4GB, with 8GB recommended. To optimize performance, consider increasing the memory available to each worker, which can typically be achieved by running fewer workers per compute node.

Ramiro 2024-11-22，13:00