How to import segment anything model into matlab?

15 次查看（过去 30 天）
Layla Bitar
Layla Bitar 2023-5-10
编辑： cui,xingxing 2024-4-27
Hello,
I have played around with segment anything model by metaAI and it is great! I have been using it in python, however, I am wondering, is there a way to import it into matlab? I would like to use the matlab App desginer to design a GUI that uses the SAM
Thanks

请先登录，再回答此问题。

回答（2 个）

Surya
Surya 2023-5-15
Hi,
If you have knowledge of Python, you have the option to utilize the MATLAB Python Interface. You can find details on calling Python functions from MATLAB on link.
However, to use this feature, you must have a MATLAB-compatible version of Python installed on your computer. check
With the interface, you can import SAM into MATLAB.
Example: (MATLAB code)
sam = py.segment_anything.sam_model_registry["<model_type>"](checkpoint="<path/to/checkpoint>")
Make sure that you've installed "segment_anything" in Python using pip.
cui,xingxing
cui,xingxing 2024-1-6
编辑：cui,xingxing 2024-4-27
Hi,@Layla Bitar
In Matlab R2024a, have introduce Image Processing Toolbox Model for Segment Anything Model,no dependent on Python.
Note: currently this model internal function segmentAnythingModel.m have a bug,you should modify from line 303 like follow.
if image_size(1) > image_size(2)
Iresized = imresize(I,[input_size,nan], "bilinear");
scale = input_size / size(I,1);
% Iresized = padarray(Iresized,0,input_size-size(Iresized,2),'post');
Iresized = padarray(Iresized,[0,input_size-size(Iresized,2)],0,'post'); % modify use this!
else
Iresized = imresize(I,[nan,input_size], "bilinear");
scale = input_size / size(I,2);
Iresized = padarray(Iresized,[input_size-size(Iresized,1),0],0,'post'); % modify use this!
end
Here link I give a Example.
-------------------------Off-topic interlude, 2024-------------------------------
I am currently looking for a job in the field of CV algorithm development, based in Shenzhen, Guangdong, China,or a remote support position. I would be very grateful if anyone is willing to offer me a job or make a recommendation. My preliminary resume can be found at: https://cuixing158.github.io/about/ . Thank you!
Email: cuixingxing150@gmail.com

类别

在 Help Center 和 File Exchange 中查找有关 Call Python from MATLAB 的更多信息

标签

产品

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by