You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@commons.apache.org by "Oleksandr Muliarevych (JIRA)" <ji...@apache.org> on 2014/01/09 12:54:52 UTC

[jira] [Commented] (MATH-1070) Incorrect rounding of float

    [ https://issues.apache.org/jira/browse/MATH-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866575#comment-13866575 ] 

Oleksandr Muliarevych commented on MATH-1070:
---------------------------------------------

Still left problem with round of zero value for float usage:
Precision.round(-0.0d, 0) = 0.0
Precision.round(-0.0f, 0) = -0.0


> Incorrect rounding of float
> ---------------------------
>
>                 Key: MATH-1070
>                 URL: https://issues.apache.org/jira/browse/MATH-1070
>             Project: Commons Math
>          Issue Type: Bug
>    Affects Versions: 3.2
>         Environment: Windows 7, IntelliJ IDEA 10.5.4.
>            Reporter: Oleksandr Muliarevych
>            Priority: Critical
>             Fix For: 3.3
>
>
> package org.apache.commons.math3.util 
> example of usage of round functions of Precision class:
> Precision.round(0.0f, 2, BigDecimal.ROUND_UP) = 0.01
> Precision.round((float)0.0, 2, BigDecimal.ROUND_UP) = 0.01
> Precision.round((float) 0.0, 2) = 0.0
> Precision.round(0.0, 2, BigDecimal.ROUND_UP) = 0.0
> Seems the reason is usage of extending float to double inside round functions and getting influence of memory trash as value.
> I think, same problem will be found at usage of other round modes.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)