Need help in making a Markov Probability Matrix

Question

Ashwin Chettiar 2020-8-28

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/585602-need-help-in-making-a-markov-probability-matrix

编辑： Ashwin Chettiar 2020-9-6

Consider a new particle, located on an 8 × 8 grid. The particle begins in the bottom left-hand corner, which is given the label square 1. The particle can move horizontally or vertically randomly. This system has 64 different states, corresponding to the particle being in each of the 64 squares. Use for loops in Matlab to efficiently create the Markov transition matrix (you are not expected to create a 64 × 64 matrix by hand!).

So far, I have been able to create the state vector and a blank probability matrix. The problem that I am having is that I do not understand how to use for loops to generate a Markov matrix with the constraints that I have been given.

My code so far:

%Create a state vector s with 64 different states
s = zeros(1,64);
s(1,1) = 1;
%Create a blank 64x64 probability matrix P
P = zeros(64,64);
%Use for loops to create the Markov Probability Matrix

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Pratyush Roy 2020-8-31

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/585602-need-help-in-making-a-markov-probability-matrix#answer_487409

在 MATLAB Online 中打开

Assuming random values for the Markov probability matrix, the following snippet might be helpful for defining a Markov Probability Matrix using for loops:

%Create a state vector s with 64 different states 
s = zeros(1,64); 
s(1,1) = 1; 
%Create a blank 64x64 probability matrix P 
P = zeros(64,64); 
%Use for loops to create the Markov probability Matrix. 
for i=1:64
    for j=1:64 
        P(i,j)=rand; %Generates a random number from a uniform distribution in range(0,1)  
    end
    P(i,:) = P(i,:)/sum(P(i,:)); % This forces the sum across columns to be unity
end