清空筛选条件
清空筛选条件

Double Precision is rounding at the 5th digit?

4 次查看（过去 30 天）
Brian Rose
Brian Rose 2019-4-24
编辑： Stephen23 2019-4-24
(Newbie question)
I am trying to do some basic math and I am running into what appears to be a rounding or precision problem. MATLAB uses doubles, which should be good out to 15 digits. It appears that MATLAB is rounding at less than 4. What am I missing? Note: I do not have access to the Symbolic toolkit, and frankly can't understand why any additional code would be needed for this basic equaiton.
value1 = double(0.999969482421875)
eps(value1)
value2 = double(32767) ./ double(32768)
Output is
value1 =
1.0000
ans =
1.1102e-16
value2 =
1.0000

请先登录，再回答此问题。

采纳的回答

Stephen23
Stephen23 2019-4-24
编辑：Stephen23 2019-4-24
Change the display format., e.g.
format long g
Although beginners often confuse the two, how data is stored in memory and how data is displayed are really two totally different things.

更多回答（0 个）

类别

在 Help Center 和 File Exchange 中查找有关 Numeric Types 的更多信息

标签

产品

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by