Bellman equation with recursive function

Question

0 个投票

Hello,

I have a Bellman equation for which I have constructed a code with the help of loops, that calculates for me the optimal expected value:

function [V] = Bellmanneu(C,R1,R2,T,P1,P2,P0)
r = [R1 R2]
    for t=(T+1):-1:1  
        for c=1:1:C+1          
            if c<=1
                V(c,t) = 0
            elseif t==T+1       
                V(c,t) = 0
            else
                V(c,t) = P1 * (r(1) + V(c-1,t+1)) + P2 * (r(2) + V(c-1,t+1)) + P0 * V(c,t+1)
            end
        end
    end    
end

Basically, I want to delete the first two for-loops and instead compute a recursive function that calls itself until t equals 1.

Can anyone help me out, at least with the first few steps that need to be taken?

Any help is much appreciated!

2 个评论
显示无隐藏无

Star Strider 2019-1-19

What are typical inputs to your function?

Amit Kumar 2019-1-19

Hi, i`d like to keep it simple, so C=2, T=2 (important inputs),

P1=0.2, P2=0.6, P3=0.2, R1=50, R2=100.

请先登录，再进行评论。

请先登录，再回答此问题。

Follow Question

Answer 1

Amit Kumar 2019-1-23

在 MATLAB Online 中打开

1 个投票

With some help I could break down the whole function to the following:

function V = belmantest(C,R1,R2,T,P1,P2,P0) 
   V = zeros(C+1, T+1)  % Pre-allocation!!! 
    for t = T:-1:1   
        V(2:C+1, t) = P1 * (R1 + V(1:C, t+1)) + P2 * (R2 + V(1:C,t+1)) + P0 * V(2:C+1, t+1)
    end 
end

Now, it is the last for-loop that I somehow need to get rid of.

Any suggestions?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

Bellman equation with recursive function

2 个评论
显示无隐藏无

回答（1 个）

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

类别

标签

Community Treasure Hunt

Bellman equation with recursive function

2 个评论 显示 无 隐藏 无

回答（1 个）

0 个评论 显示 -2更早的评论 隐藏 -2更早的评论

类别

标签

另请参阅

Community Treasure Hunt

2 个评论
显示无隐藏无

0 个评论
显示 -2更早的评论隐藏 -2更早的评论