Precision/Rounding in Matlab

Question

0 个投票

Perhaps I should read over the famous article, "What Every Computer Scientist Should Know About Floating-Point Arithmetic."

I'm trying to do a simple comparison of two numbers:

>> isequal(52.8/10, 5.28)

ans =

0

>> isequal(5.28,5.28)

ans =

1

Obviously, this is the "wrong" answer. 52.8/10 should be equal to 5.28. It's not.

How do you handle cases like this in matlab? How are you CERTAIN that you are checking for equality correctly?

Thanks.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

Answer 1

the cyclist 2011-8-4

0 个投票

I suggest you look at the Accepted answer to this question, and follow the link in it. http://www.mathworks.com/matlabcentral/answers/69-why-does-1-2-3-1-3-not-equal-zero

Russell 2011-8-4

Thank you. That answered it nicely.

the cyclist 2011-8-4

Glad to hear it. You might want to "Accept" the answer, to help future users.