How is the division of two numbers carried out in Matlab?
132 次查看(过去 30 天)
显示 更早的评论
The behavior is as expected when both the denominator and the numerator are in 'double' precision. If either of the two are integer, as in the example below, the rounding error yields unexpected division results.
double(475904) / double(512) = 929.5
int32(475904) / int32(512) = 930
int32(475904) / double(512) = 930
double(475904) / int32(512) = 930
回答(1 个)
John D'Errico
2018-3-23
编辑:John D'Errico
2018-3-23
Think about what the class of the result is. If you don't know how to use the class function to check that, then learn to read the output of the whos command. (In fact, in newer MATLAB releases, just displaying a variable at the command line tells you the class, if it is not a double.)
Then consider if the result is stored in an integer variable, then why would you expect a non-integer result? That is, an int32 cannot represent non-integers. So MATLAB stores only the integer part, essentially rounding to the nearest integer.
double(4) / int32(3)
ans =
int32
1
double(5) / int32(3)
ans =
int32
2
另请参阅
类别
在 Help Center 和 File Exchange 中查找有关 Logical 的更多信息
产品
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!