BERT-Tiny is a pretrained language model based on Deep Learning Transformer architecture that can be used for a wide variety of Natural Language Processing (NLP) tasks. This model has 2 self-attention layers and a hidden size of 128.
To load a BERT-Tiny model, you can run the following code:
[net, tokenizer] = bert(Model="tiny");
MATLAB 版本兼容性
- 兼容 R2023b 到 R2026b 的版本
平台兼容性
- Windows
- macOS (Apple 芯片)
- macOS (Intel)
- Linux
