Question on running fitlda

Question

Stephen Bruestle 2018-12-6

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/434240-question-on-running-fitlda

评论： Stephen Bruestle 2020-6-11

采纳的回答： Christopher Creutzig

I want to run fitlda, with the following specification:

* use Griffiths and Steyvers (2004) Gibbs Sampling algorithm for LDA as they ran it,

* 12 topics (i.e. K=12),

* a symmetric alpha of 50/K (no updating),

* a symmetric beta of .01 (no updating), and

* exactly 2000 iterations (without early termination).

Would that be:

numTopics = 12;
mdl = fitlda(bag,numTopics,'Verbose',1,'InitialTopicConcentration',50,'FitTopicConcentration',false,'WordConcentration',.01,'LogLikelihoodTolerance',0,'IterationLimit',2000);

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Christopher Creutzig 2018-12-10

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/434240-question-on-running-fitlda#answer_351452

Gibbs sampling involves stochastic elements (i.e., a pseudorandom number generator), meaning reproducing exactly the results of the 2004 paper will require using their code and their rng settings. (Which is also why in degenerate cases, you do get substantially different answers for multiple fitlda calls.)

Without looking up the definition of β in the original paper, I'm not sure if you want to set 'WordConcentration',.01 or 'WordConcentration',.01*bag.NumWords.

Other than that, the call looks like it should do what you ask, yes.

3 个评论
显示 1更早的评论隐藏 1更早的评论

Kai Friedrich 2020-6-11

Hey Stephen,

I am trying to do the same thing.

Great answer for the beta parameter.

What about alpha?

Is sufficient to just insert 50, when I want my alpha parameter in MATLAB to be 50/K?

Thanks!

Stephen Bruestle 2020-6-11

I think that you just insert 50.

That said, I never was able to get results similar to the GibbsLDA++ program. There seems to be some sort of optimization still going on. In the end, I ended up using on Gibbs++, as I had more confidence in it.

If you are writing an academic paper, I would recommend Gibbs++, as it is better documented and is used in many academic works. If you really want to use MatLab, the original code by Griffiths and Steyvers is MatLab code.

It is a shame that fitlda is not properly documented. Without precise empirical definitions of each function, fitlda seems to be worthless for academic purposes.

请先登录，再进行评论。