Crossentropy loss function - What is a good performance goal?

Question

Mirko Job 2019-2-8

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/443899-crossentropy-loss-function-what-is-a-good-performance-goal

编辑： Greg Heath 2019-2-8

Good Afternoon,

Looking around ANSWER and exploring GOOGLE GROUPS i found this method by Dr. Greg Heath to define a valid training goal for the MSE performance function:

[I,N]=size(x);
[O,N]=size(t);
MSE00a=mean(var(t,0,2));                
Ntrn=floor(0.7*N);                     
Hub=floor((Ntrn-O)/(I+1+O));
MSEgoal=0.01*(Ndof/Ntrneq)*MSE00a;    

And i was wondering if there is a similar method to set a Crossentropy reference goal for neural net performance, since i want to experiment different type of loss functions in order to get the best results.

King Regards,

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Greg Heath 2019-2-8

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/443899-crossentropy-loss-function-what-is-a-good-performance-goal#answer_360190

编辑：Greg Heath 2019-2-8

These equations are not necessarily precise.

For example:

data = design + test

design = training + validation

In particular:

Test subset data should not be used to estimate design parameters.

However, since we typically let the training function randomly perform the trn/val/tst division, the separate train/val/tst subsets are not available before training.

That is why I typically design 10 nets for every trial value for the number of hidden nodes.

Hope this helps

Thank you for formally accepting my answer

Greg