How to check irreducible Markov chain?

8 次查看（过去 30 天）
Clarisha Nijman
Clarisha Nijman 2018-10-23
评论： Clarisha Nijman 2018-10-23
Hello,
Now I want to check in matlab if a Markov Chain is irreducible or not. I found some instructions in mathworks saying:
tf1 = isreducible(mc1) %returns true if the discrete-time Markov chain mc is reducible and false otherwise.
but it seems not to be enough. Then came accros a part saying that the object should be defined first as a Markov chain. dtmc mc1
But it still gives errors. Where can I find simple information/instructions about this topic? I am relatively new in matlab, so I do not know the right keywords. Does somebody have some advice for me?
Thank you in advance
  2 个评论
Clarisha Nijman
Clarisha Nijman 2018-10-23
That is the same document in Mathwords I referred to. This document wants me to define mc as a dtmc object, the link on the page says a transition matrix is needed to do that. But is this the only way? Is it possible to give a series a input, and then to check if the series is irreducible or a proper Markov Chain?
Torsten
Torsten 2018-10-23
编辑：Torsten 2018-10-23
A Markov chain is defined by its transition matrix. If you know how you must transform your "series" (I don't exactly know what this series actually is) into the transition matrix, you are done.
Best wishes
Torsten.

请先登录，再进行评论。

请先登录，再回答此问题。

采纳的回答

Torsten
Torsten 2018-10-23
https://de.mathworks.com/help/econ/dtmc.isreducible.html
  1 个评论
Clarisha Nijman
Clarisha Nijman 2018-10-23
Thanks a lot Torsten,
so with the series (sequence of numbers or states the Markov chain visited after n transitions), the transition probability matrix is composed and then it can be checked if the Markov chain is irreducible or not. Thanks a lot!

请先登录，再进行评论。

更多回答（0 个）

类别

在 Help Center 和 File Exchange 中查找有关 Markov Chain Models 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by