I am trying to consider a particle located on an 8x8 grid that start at the bottom left (at 1) with 64 being at the top right. It moves upwards or sideways (cannot move diagonally).
So the system has 64 states it can be in but i'm not sure how to construct a 64 by 64 matrix with probabilities for this specific grid.
Script Window:
%Creating a state vector s with 64 different states
s = zeros(1,64);
s(1,1) = 1;
%Creating a blank 64x64 probability matrix P
P = zeros(64,64);
%Use for loops to create a Markov probability Matrix.
for i=1:64
for j=1:64
P(i,j)=rand;
%I can only think of putting rand which generates numbers from a uniform distrubuion. I am not sure how to alter it to generate a matix specific to my 8x8 grid.
end
% making the sum for rows = to 1
P(i,:) = P(i,:)/sum(P(i,:));
