PROBLEM WHIT FIT LDA TO WORD COUNT MATRIX

Question

Floor 97 2021-9-16

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1454719-problem-whit-fit-lda-to-word-count-matrix

回答： Aneela 2024-2-21

Hi,

I have written this code:

data = readtable('project','TextType','string','PreserveVariableNames',true);

textData = data.speech;

labels = data.the_news_desk;

documents = tokenizedDocument(textData);

documents = erasePunctuation(documents);

documents = removeStopWords(documents);

numTopics = 3;

mdl = fitlda(documents,numTopics,'Verbose',0);

But Matlab say that the first parameter isn't a correct variable for the methods. This is the error message:

Expected input to be one of these types:

bagOfWords, bagOfNgrams, double, single, uint8, uint16, uint32, uint64, int8, int16, int32, int64

Instead its type was tokenizedDocument.

How can I modify it?

Thanks,

Sara

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Aneela 2024-2-21

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1454719-problem-whit-fit-lda-to-word-count-matrix#answer_1413528

在 MATLAB Online 中打开

Hi Sara,

The error you are encountering states that the datatype of first argument must be any one of “bagOfWords, bagOfNgrams, double, single, uint8, uint16, uint32, uint64, int8, int16, int32, int64”, but currently its type is tokenizedDocument.

To resolve the error, you can try changing the datatype of the training data before fitting it into the model. I have added a code snippet for implementing this below.

bagW = bagOfWords(documents);
numTopics = 3;
mdl = fitlda(bagW, numTopics, 'Verbose',0);

“bagOfWords” is recommended to be used in this case because Latent Dirichlet Allocation (LDA) is a generative statistical model that is commonly used for discovering abstract topics within a collection of documents, where a topic is characterized by a distribution over words.

In the context of topic modelling with “Latent Dirichlet Allocation” (LDA), the “bagOfWords” model captures the word frequencies within documents.
“bagOfNgrams” is useful if the relationship between consecutive words is important for your analysis.
Numeric types are typically used when you have pre-computed numerical features that you want to use for topic modelling.