Search found 2 matches

by boris
Mon Nov 15, 2010 11:10 pm
Forum: General
Topic: Rounding and Float to Integer Errors (Solved)
Replies: 2
Views: 14774

Re: Rounding and Float to Integer Errors

Ok Thanks
by boris
Mon Nov 15, 2010 9:17 pm
Forum: General
Topic: Rounding and Float to Integer Errors (Solved)
Replies: 2
Views: 14774

Rounding and Float to Integer Errors (Solved)

There appears to be a rounding error were a conversion from a float calculation that results is a whole number is then connected to an integer data element. The result of the float multiply is display as a whole number - which I believe is rounded up - but results in a different integer value ...