I recommend reading papers on the use and estimation of Markov models for multipath propagation. When you have absorbed the information from these papers, start to develop a model. Return to this site if you have quesitons about how to use Matlb to implement a specific model.
For example:
A Markov model for the mobile propagation channel, Babich et al 2000. https://ieeexplore.ieee.org/document/820699
On the accuracy of a first-order Markov model for data transmission on fading channels, Zorzi et al 1995. https://ieeexplore.ieee.org/document/496890
Testing the Markov property of the multipath fading process, Csurgai-Horvath & Bito 2008. https://ieeexplore.ieee.org/document/4656758
On Markov modeling of fading channels, Tan 1997. Master's thesis. See section 2.3. https://central.bac-lac.gc.ca/.item?id=MQ28259
Good luck with your research.
