t-sne visualization of Vision transformer

24 次查看(过去 30 天)
How to visualize the features of the vision transfomer after training using t-sne visualizion?
I could not apply the same in vision transformer beacuse there are an error during using actication function as follows:
earlyLayerName = "'encoderblock1_mha1";
pool1Activations = activations(net,...
augimdsTrain,earlyLayerName,"OutputAs","rows");

回答(1 个)

Garmit Pant
Garmit Pant 2024-3-5
From what I gather, you are following the MATLAB examples “Train Vision Transformer Network for Image Classification” and “View Network Behavior Using tsne” to visualise the results of the network activations of a trained vision transformer. You are encountering an error in the process.
The line of code where you are encountering the error is trying to refer to a non-existent layer, assuming you are using the MATLAB default implementation of the “visionTransformer” network. By analysing the network, we can see the layer is named “encoderblock1_mha” and not “encoderblock1_mha1”. Unless you have renamed and replaced the layer, passing the correct layer name shall eliminate the result.
I hope you find the above explanation and suggestions useful!
  5 个评论
adolf hitler
adolf hitler 2024-5-15
Hi Garmit
Have you solved the problem? I had the same problem when I was executing code.
adolf hitler
adolf hitler 2024-5-15
Hi Mahmoud
Have you solved the problem? I had the same problem when I was executing code.

请先登录,再进行评论。

产品


版本

R2023b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by