How to use pretrain networks like vgg19,resnet18?

1 次查看（过去 30 天）
Shilpa Sonawane
Shilpa Sonawane 2022-9-13
评论： Shilpa Sonawane 2023-1-24
I would like to use pretrained network like VGG19, RESNET18. The output of this network should be connected to LSTM.
Which layer should be considered to take output from pretrain network?
  3 个评论
显示 1更早的评论
Shilpa Sonawane
Shilpa Sonawane 2022-10-18
i am working on the topic of lipreading. i have done preprocessing & have videos which consists of mouth region of person. I used VGG19 pretrain network. Now its output i would like to connect with LSTM network. I am confused from which layer of VGG19 the output is taken for furter processing. I referred many papers in which first pretrain netwrok is used and then its output is applied to LSTM network. LSTM network is used as input to the system is video which is frame sequence.

请先登录，再进行评论。

请先登录，再回答此问题。

采纳的回答

Nadia Shaik
Nadia Shaik 2022-11-23
Hi Shilpa,
I understand that you wish to connect the output of CNN to LSTM network. MATLAB supports workflows containing both CNN and LSTM layers.
You can convert the videos to sequences of feature vectors using a pretrained convolutional neural network, such as GoogleNet, to extract features from each frame. And then, train an LSTM network on the sequences to predict the video labels.
Please check the link that contains an example showing the CNN+LSTM workflow https://www.mathworks.com/help/deeplearning/examples/classify-videos-using-deep-learning.html
Similarly, you can use the convolutional neural networks like VGG19, RESNET18 to extract features and then train an LSTM network.
I hope this helps

更多回答（0 个）

类别

在 Help Center 和 File Exchange 中查找有关 Recognition, Object Detection, and Semantic Segmentation 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by