Is inexact subtraction expected?
5 views (last 30 days)
Show older comments
In Matlab R2018a, I just typed "32885.6-32760" and got back 125.599999999999. Is this type of inexact subtraction expected? If I then type "ans - 125" I get 0.599999999998545, so it's not just a bunch of 9's. Removing the leading 3 or the leading 32 does not give this incorrect answer (i.e. it gives the exact decimal value .6)
0 Comments
Answers (1)
See Also
Categories
Find more on Introduction to Installation and Licensing in Help Center and File Exchange
Products
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!