Hidden Size in autoencoder

4 次查看(过去 30 天)
Jahetbe
Jahetbe 2024-6-22
Hi everyone,
I am looking for a formula to determine the maximum allowable hidden size in an Autoencoder. I came across the following heuristic:
hiddenSize=round(n×numFeatures)
However, I haven't been able to find a specific reference to cite for this formula.
I would appreciate any guidance or references that could help me adjust the hidden size in an Autoencoder effectively.
Thanks in advance for your assistance.

回答(1 个)

Malay Agarwal
Malay Agarwal 2024-6-24
编辑:Malay Agarwal 2024-6-27
There is no rule of thumb for selecting the hidden size in an autoencoder. The best way to determine the hidden size of an autoencoder is via hyperparameter tuning. You can set up a grid search with a cross-validation loop to find the hidden size that yields the best results on your dataset. You can also use Bayesian optimization (https://en.wikipedia.org/wiki/Bayesian_optimization) to find the best value for the hidden size.
Please refer to the following link for an example on tuning hyperparameters using Bayesian optimization: https://www.mathworks.com/help/deeplearning/ug/deep-learning-using-bayesian-optimization.html.
Please note that you'll have to adapt the example according to your requirements. You can refer to the following link to learn more about the Bayesian optimization workflow and how you can adapt it to your requirements: https://www.mathworks.com/help/stats/bayesian-optimization-workflow.html.
Hope this helps!

类别

Help CenterFile Exchange 中查找有关 Language Support 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by