1.1 - int32(1) = 0 ?
2 views (last 30 days)
Show older comments
The calculation: 1.1 - int32(1) results in 0. Some experimentation tells me that: 1.1 - double(int32(1)) results in the expected 0.1
I would have expected the combination of a double and an int32 to result in a double. Instead it appears to be an int32. Is this the defined behavior? Can anyone point me to a document showing data type precedence in Matlab.
Thanks
0 Comments
Accepted Answer
James Tursa
on 30 Jul 2013
Edited: James Tursa
on 30 Jul 2013
E.g., see here:
"Arithmetic operations that involve both integers and floating-point always result in an integer data type. MATLAB rounds the result, when necessary, according to the default rounding algorithm."
And, yes, this is not the way many other languages (e.g., Fortran, C/C++, etc) do this.
0 Comments
More Answers (1)
Azzi Abdelmalek
on 30 Jul 2013
http://www.mathworks.com/help/matlab/numeric-types.html when the operation is possible between two classes, I think the priority is for the class the less precise.
0 Comments
See Also
Categories
Find more on Logical in Help Center and File Exchange
Products
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!