How to represent decimal number
3 views (last 30 days)
Show older comments
a=180/255; in a matlab program and type 'a' in Command window, it shows the result as '0.7058823529411765' but when b=180; c=255; a=b/c; (which is doing the same function as above) and type 'a' in Command window, it shows the result as '1'
2 Comments
James Tursa
on 10 Sep 2016
I don't think you are giving us the complete picture. E.g., on my computer:
>> b=180; c=255; a=b/c;
>> a
a =
0.705882352941177
Please start over with a clean workspace, then type in the above and see what happens. I think you will get the expected results.
If you can reproduce your '1' with other code, please show us that code.
Answers (1)
Steven Lord
on 10 Sep 2016
One or both of the variables b and c are of type uint8. See this documentation page for information about how integer arithmetic is performed.
0 Comments
See Also
Categories
Find more on Image Processing Toolbox in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!