calculation error or double precision limit?

1 次查看（过去 30 天）
Andreas
Andreas 2015-9-17
编辑： Stephen23 2015-9-17
Hello,
I was wondering about the result when calculating following simple formula:
K>> 0.067 * 1e9
ans =
6.7000e+07
Following gives the correct result (integer):
K>> 0.067 * 1e8 * 1e1
ans =
67000000
Where is the difference in the calcualation?
Is it an error or a double precision limit?

请先登录，再回答此问题。

回答（1 个）

Stephen23
Stephen23 2015-9-17
编辑：Stephen23 2015-9-17
You should download this and give it a try with the same examples as above:
http://www.mathworks.com/matlabcentral/fileexchange/22239-num2strexact--exact-version-of-num2str-
Also have a look at the intermediate values, such as 0.067 * 1e8. This shows that there are a few digits that creep in after the end of the double precision limit (fifteen digits).

类别

在 Help Center 和 File Exchange 中查找有关 Logical 的更多信息

标签

产品

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by