You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@commons.apache.org by "Thomas Neidhart (JIRA)" <ji...@apache.org> on 2014/01/09 14:18:54 UTC

[jira] [Resolved] (MATH-1070) Incorrect rounding of float

     [ https://issues.apache.org/jira/browse/MATH-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Neidhart resolved MATH-1070.
-----------------------------------

    Resolution: Fixed

Could you please create a different issue for this problem.

Calling Precision.round(x, y) will use the rounding mode ROUND_HALF_UP thus is it different to the problem reported before.

> Incorrect rounding of float
> ---------------------------
>
>                 Key: MATH-1070
>                 URL: https://issues.apache.org/jira/browse/MATH-1070
>             Project: Commons Math
>          Issue Type: Bug
>    Affects Versions: 3.2
>         Environment: Windows 7, IntelliJ IDEA 10.5.4.
>            Reporter: Oleksandr Muliarevych
>            Priority: Critical
>             Fix For: 3.3
>
>
> package org.apache.commons.math3.util 
> example of usage of round functions of Precision class:
> Precision.round(0.0f, 2, BigDecimal.ROUND_UP) = 0.01
> Precision.round((float)0.0, 2, BigDecimal.ROUND_UP) = 0.01
> Precision.round((float) 0.0, 2) = 0.0
> Precision.round(0.0, 2, BigDecimal.ROUND_UP) = 0.0
> Seems the reason is usage of extending float to double inside round functions and getting influence of memory trash as value.
> I think, same problem will be found at usage of other round modes.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)