Does DeepNetworkDesigner support Transformer Layers?
显示 更早的评论
I want to add Transofmrer Layers while designing the network for deep learning using MATLAB DeepNetworkDesigner, but it doesn't show me such option. How can I add Transofmer Layers to the network designed using DeepNetworkDesigner?
回答（2 个）
Matt J
2024-1-14
0 个投票
If the transformer layer is a custom layer that you have created for yourself, you would import it to deepNetworkDesigner from the workspace, as explained here,
David Ho
2024-1-18
0 个投票
Hi Subhadip,
In R2023b, the following layers are supported in Deep Network Designer that are commonly used in transformers:
- selfAttentionLayer
- wordEmbeddingLayer (requires Text Analytics Toolbox)
- sinusoidalPositionEncodingLayer
- positionEmbeddingLayer
- embeddingConcatenationLayer
- indexing1dLayer
- patchEmbeddingLayer (requires Computer Vision Toolbox)
Best regards,
David
类别
在 帮助中心 和 File Exchange 中查找有关 Deep Learning Toolbox 的更多信息
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!
Translated by 
