How to create nnet.layers usable for custom training loops as well as trainNetwork?

Question

Niklas 2019-10-8

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/484138-how-to-create-nnet-layers-usable-for-custom-training-loops-as-well-as-trainnetwork

回答： Sai Bhargav Avula 2019-10-24

Hei all,

I would like to create a layer that can be pretrained in a custom training loop and afterwards finetuned with the trainNetwork function. I created a class with the needed properties and a predict function:

function Z = predict(layer, X)
    Z = sigmoid(fullyconnect(X, layer.weights, layer.biases));
end

Using this function works fine during the pretraining. Using trainNetwork afterwards leads to the error:

   Error using validateDataFormat (line 14)
   Specify 'DataFormat' when first argument is an unlabeled dlarray or numeric array.
   

This is caused by fullyconnect as it needs dlarrays or the correct format string. I try to make it as universal as possible, so i don't want to set the Format property on the fullyconnect command. Is there a way to force trainNetwork to use dlarrays?

Thanks in advance,

Niklas

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Sai Bhargav Avula 2019-10-24

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/484138-how-to-create-nnet-layers-usable-for-custom-training-loops-as-well-as-trainnetwork#answer_398040

Hi,

As you mentioned the fullyconnect applies fully connect operation to dlarray data. For your custom layer to be made compactable to trainNetwork you should convert that using the fullyConnetedLayer by following template.

Or

You should finetune it by converting it into a dlnetwork.