Using bag of words function

Question

Ben Hischar 2021-8-31

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1443714-using-bag-of-words-function

回答： DGM 2021-8-31

在 MATLAB Online 中打开

I am trying to use a bag of words function but i am getting an error.

im trying to lear using this matlab link

https://au.mathworks.com/help/textanalytics/ref/bagofwords.html

clear all 
clc
filename = "SampleText.txt";
str = extractFileText(filename);
textData = split(str,newline);
documents = tokenizedDocument(textData);
bag = bagOfWords(documents);
tbl = topkwords(bag,10);

this is the error i recieve:

'extractFileText' requires Text Analytics Toolbox.

Error in Word_lengths (line 6)

str = extractFileText(filename);

thanks for the help again

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

DGM 2021-8-31

编辑：DGM 2021-8-31

All of these functions (except split()) require that toolbox. If you don't have that toolbox, you can't use those functions because they won't exist. There might be alternative ways to do the same thing, but since it appears that you're discarding a lot of information in the process, one has to ask what exactly is required. If all you need is the topk word list, finding a workaround may be simpler than if you wanted everything else.

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

DGM 2021-8-31

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1443714-using-bag-of-words-function#answer_777504

在 MATLAB Online 中打开

SampleText.txt

If you just want the word frequency table:

filename = 'SampleText.txt';
str = fileread(filename);
words = regexp(lower(str),'[a-zA-Z0-9]*','match');
uwords = unique(words).';
counts = cellfun(@(x) sum(strcmp(words,x)),uwords);
[counts idx] = sort(counts,'descend');
uwords = uwords(idx);
wordfreqtable = table(uwords(1:10),counts(1:10))
wordfreqtable = 10×2 table
        Var1         Var2
    _____________    ____

    {'of'       }     4  
    {'the'      }     4  
    {'an'       }     2  
    {'and'      }     2  
    {'is'       }     2  
    {'society'  }     2  
    {'1928'     }     1  
    {'another'  }     1  
    {'bernays'  }     1  
    {'conscious'}     1  

This differs somewhat from the behavior of topkwords() in that it does not consider punctuation marks to be words, and it sorts equal-frequency elements alphabetically instead of by order of occurrence.