[Bug 118007] Rounding error in subtraction calculation

[bu...@apache.org]

https://issues.apache.org/ooo/show_bug.cgi?id=118007

Rob Weir <ro...@apache.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           Keywords|                            |needmoreinfo

--- Comment #2 from Rob Weir <ro...@apache.org> ---
This doesn't sound like a defect, but a basic limitation of floating point
calculations.  Always keep in mind that calculations are done to full
precision, but the displayed value is rounded according to the display format. 
If you want the calculation to match the display then you need to use the
ROUND() function on partial results, e.g., after multiplying by a rate factor. 

If you want to attach a spreadsheet to this issue that shows your concern more
fully, I'll take a further look.  Otherwise I'll close this report.

-- 
You are receiving this mail because:
You are on the CC list for the bug.