Will MATLAB provide Bert word embedding support?

3 次查看（过去 30 天）
Saugata Bose
Saugata Bose 2020-2-14
评论： hongjing lu 2021-4-30
Hi
During workingon in a project, I came to know about GLOVE, word2vec and fast textword embedding. Few days back, in a group meeting, another word embedding model has came up which has reportedly shown good perforemance, called Bert.
Will Matlab provide(or plan to provide) Bert embedding support in the system?
Thanks

请先登录，再回答此问题。

回答（2 个）

Jon Cherrie
Jon Cherrie 2021-3-12
编辑：Jon Cherrie 2021-3-12
BERT is available via this GitHub repository
  5 个评论
显示 3更早的评论
Jon Cherrie
Jon Cherrie 2021-4-20
Good to know that you resolved that issue!
For BERT, you will need R2021a as it relies on some functions new in that release, e.g.,
For GPT-2 (which is in the same repository) you should be good with R2020b.

请先登录，再进行评论。

Steven Lord
Steven Lord 2020-2-14
In general we don't discuss future plans. If you believe we should include this word embedding model in our products, please submit that as an enhancement request to Technical Support using the telephone icon in the upper-right corner of this page.
  3 个评论
显示 1更早的评论
Zalán Kocsis
Zalán Kocsis 2021-3-18
In the R2021a updates page
https://www.mathworks.com/products/new_products/latest_features.html
Text Analytics Toolbox
  • BERT Transformer Models: Use BERT models for tasks such as text classification, summarization, and sentiment analysis
However, I did not find any related functions or objects in the documentation nor in the Release notes of Text Analytics or Deep Learning.

请先登录，再进行评论。

类别

在 Help Center 和 File Exchange 中查找有关 Modeling and Prediction 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by