how to create a function that counts all words in a document?

Question

Noah Swiston 2015-3-25

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/189846-how-to-create-a-function-that-counts-all-words-in-a-document

回答： Christopher Creutzig 2018-11-26

I am attempting to make a function that takes in a speech as an input argument in a text file. I would then like to read the speech and have matlab count and return the number of occurrences for every word in the speech. Any ideas?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

John D'Errico 2015-3-25

2
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/189846-how-to-create-a-function-that-counts-all-words-in-a-document#answer_172776

编辑：John D'Errico 2015-3-25

Easy, peasy.

I'd...

1. Using lower, make all words lower case, so you need not worry about capitalization.

2. Apply my allwords code to the string. Use spaces and any appropriate punctuation as separator characters.

3. Use unique to get the distinct words in that list. The third argument from unique will be important.

4. Apply accumarray to that third argument from unique to count the words.

Essentially 4 quick lines of code.

2 个评论
显示无隐藏无

Noah Swiston 2015-3-25

The allwords function only takes in a string as an input. How would i take the text file, open it, and convert it into a string so the allwords function could be used?

John D'Errico 2015-3-26

textread is the simple answer. Or use fopen, then fread, or fgets or fgetl.

No need to convert anything to a string if it is a string already as read in.

请先登录，再进行评论。

Answer 2

Sarah Palfreyman 2018-4-30

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/189846-how-to-create-a-function-that-counts-all-words-in-a-document#answer_317992

Get the size of the string returned by extractFileText in Text Analytics Toolbox

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

Answer 3

Christopher Creutzig 2018-11-26

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/189846-how-to-create-a-function-that-counts-all-words-in-a-document#answer_348911

Check out the bagOfWords class in Text Analytics Toolbox. It solves exactly this problem.

(You may want to have some preprocessing to match exactly what you consider to be the same word. E.g., lowercasing, so “House” and “house” are the same. Unless you want Dr. House not to be counted as a house, of course …)