fastBERTtokens: Tokenizing for BERT in parallel

This function simply divides your text into batches, and tokenizes in parallel. Provides significant speed-up.

版本 (1.4 KB)
25.0 次下载
(0)
2023/2/24
下载

  • Install in MATLAB

    Requires R2026b and later. Learn more
下载

  • Install in MATLAB

    Requires R2026b and later. Learn more

您现在正在关注此提交

引用格式

Ralf Elsas (2026). fastBERTtokens: Tokenizing for BERT in parallel (https://ww2.mathworks.cn/matlabcentral/fileexchange/125295-fastberttokens-tokenizing-for-bert-in-parallel), MATLAB Central File Exchange. 检索时间: .

致谢

参考作品: Transformer Models

一般信息

MATLAB 版本兼容性

  • 与 R2021a 及更高版本兼容

平台兼容性

  • Windows
  • macOS
  • Linux
在新标签页中打开
版本 已发布 发行说明
1.0.0

下载

  • Install in MATLAB

    Requires R2026b and later. Learn more