Maximixe output of Neural Network After training

Question

Federico Toso 2023-11-6

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2043752-maximixe-output-of-neural-network-after-training

回答： Harsha Vardhan 2023-11-17

Suppose that I've successfully trained a neural network. Given that the weights are now fixed, is there a way to find the input (x) of the neural network that leads to the maximum output (y)? Such an input-based optimization should be possibile, since neural networks inherently support gradient backpropagation. I wonder if this operation is properly supported in Matlab (with a dedicated function or even a guideline), or of it has to be built from scratch

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Shreeya 2023-11-17

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2043752-maximixe-output-of-neural-network-after-training#answer_1354442

Hello @Federico Toso

According to my understanding, you want to maximize the output of a neural network across all predictions i.e. the output values of the last layer.

If I understand the problem statement correctly, you can apply a linear activation function to the last layer. You can use the "leakyRelu" function if the prediction values are supposed to be positive values. In the other case, define a custom activation function of the form

.

Refer to the documentation for further details:

https://www.mathworks.com/help/deeplearning/ug/list-of-deep-learning-layers.html#mw_f62fbe0d-a138-49cc-a404-19e9bda934fd

This will set the last layer output valuyes as required.

Hope this helps!

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Federico Toso 2023-11-17

Hello @Shreeya thank you for your answer. I understand your suggestion, but I cannot see how it is supposed to help with my maximization goal. After the application of the "leakyRelu" function, I still have to find a way to programmatically find the NN input (x) that leads to maximum NN ouptut (y), assuming the network weights are fixed. I'm editing my question above for better clarity. Please let me know if you have further suggestions

请先登录，再进行评论。

Answer 2

Harsha Vardhan 2023-11-17

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2043752-maximixe-output-of-neural-network-after-training#answer_1354987

在 MATLAB Online 中打开

Hi,

I understand that you want to find the maximum output of a trained neural network in MATLAB by optimizing over the input space.

There are 2 possible ways of achieving this.

Optimization Toolboxes: You can use optimization functions from the MATLAB's Global Optimization Toolbox and Optimization Toolbox. Here, the output of your trained neural network becomes the objective function, and the inputs are treated as the variables to be optimized. The objective function may look like this:

function y = objectiveFunction(x)
    % net is your trained neural network
    % Minimizing -net(x) results in maximizing net(x)
    y = -net(x); 
end

Please find the documentation of those toolbox functions here.

Optimization Toolbox Functions: https://www.mathworks.com/help/optim/referencelist.html?type=function&listtype=cat&category=index&blocktype=all&capability=
Global Optimization Toolbox Functions: https://www.mathworks.com/help/gads/referencelist.html?type=function&listtype=cat&category=index&blocktype=all&capability=

Custom Training Loop: In general neural networks, loss function is minimized and gradients are calculated over the weights. Similarly, in your case, we can minimize the -net(x) (results in maximization of net(x) output) and calculate the gradients over the inputs, where 'net' is the trained network. This can be done using a custom training loop in the Deep Learning Toolbox. Please find the documentation of custom training loop here - https://www.mathworks.com/help/deeplearning/deep-learning-custom-training-loops.html

Hope this helps in resolving your query!