3.2*2 is 9.6 ... or maybe it isn't?

M

Michael Torrie

Robert said:
In the former case, you can claim that decimal floating point is more accurate
*for those problems*. But as soon as you have a division operation, decimal
floating point has the same accuracy problems as binary floating point.

True. Poor choice of words on my part. No matter what representation
one chooses for numbers, we can remember that digits != precision.
That's why significant digits were drilled into our heads in physics!
That's the reason IEEE actually works out for most things that we need
floating point for.
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Members online

Forum statistics

Threads
474,289
Messages
2,571,441
Members
48,125
Latest member
jeremysheoran

Latest Threads

Top