Does Matlab provide any tools to understand the contents in an image and describe it using words?

1 次查看（过去 30 天）

Salad Box 2023-3-21

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1932670-does-matlab-provide-any-tools-to-understand-the-contents-in-an-image-and-describe-it-using-words

评论： Salad Box 2023-3-21

Hi,

I am new to neural network and just about to start to build my own.

I am hoping to achieve that with an input of an image, the output would be a few sentences in texts to describe the contents (and even feelings) of this image.

Where should I start? Does Matlab have any developed tools or trained networks that I can just grab and use?

5 个评论
显示 3更早的评论隐藏 3更早的评论

the cyclist 2023-3-21

Building emotional machines: Recognizing image emotions through deep neural networks

Final sentence of that paper: "We also built a database for the emotion estimation with the V-A model and will continue to collect more data. We expect our dataset will be widely used in the field of affective computing."

Salad Box 2023-3-21

Thank you so much @the cyclist for your advices. Will definitely do what you suggested.

Thank you @John D'Errico @Bjorn Gustavsson for being straightforward. I do appreciate that.

请先登录，再进行评论。

请先登录，再回答此问题。

回答（2 个）

Matt J 2023-3-21

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1932670-does-matlab-provide-any-tools-to-understand-the-contents-in-an-image-and-describe-it-using-words#answer_1197875

You could start with this example,

https://www.mathworks.com/help/deeplearning/ug/image-captioning-using-attention.html#ImageCaptioningUsingAttentionExample-20

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Salad Box 2023-3-21

Thank you@Matt J. This is really helpful.

请先登录，再进行评论。

Steven Lord 2023-3-21

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1932670-does-matlab-provide-any-tools-to-understand-the-contents-in-an-image-and-describe-it-using-words#answer_1197890

There are examples in various products (mainly using Deep Learning Toolbox and/or Computer Vision Toolbox) to perform image classification to determine which of a set of items in the training data an image represents. See as one example this page that shows how to use a pretrained network (SqueezeNet) with ten lines of code to perform that classification.

But if you're looking for "Computer, identify the object on the viewscreen" a la Star Trek where the object is something completely new, I don't think you're going to be able to achieve that.

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Salad Box 2023-3-21

Thank you for your advice @Steven Lord. They are really helpful.

I am not looking for anything completely new, not at this stage at least. I am just trying to build a basic model and see what I can achieve with that at moment.

Will definitely try examples you mentioned.

Thank you again for the reply.:)

请先登录，再进行评论。

请先登录，再回答此问题。

类别

AI and Statistics Deep Learning Toolbox Deep Learning Fundamentals

在 Help Center 和 File Exchange 中查找有关 Deep Learning Fundamentals 的更多信息

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by