[jira] [Created] (TAJO-1019) Rounding Errors in Floating Point Arithmetic

["Jihun Kang (JIRA)" <ji...@apache.org>]

Jihun Kang created TAJO-1019:
--------------------------------

             Summary: Rounding Errors in Floating Point Arithmetic
                 Key: TAJO-1019
                 URL: https://issues.apache.org/jira/browse/TAJO-1019
             Project: Tajo
          Issue Type: Improvement
         Environment: Ubuntu 14.04
Hadoop 2.4.1
            Reporter: Jihun Kang
            Priority: Minor


Floating point rounding errors are found when executing some statement on cli. When running math functions with this floating point number, results will be varied based on which JVM "Math" implementation used.

default> select 0.8-0.1;
?minus
-------------------------------
0.7000000000000001
(1 rows, 0.067 sec, 0 B selected)

With a modified Float8Dotum class, SQL result will be shown like this.

default> select 0.8-0.1;
?minus
-------------------------------
0.7
(1 rows, 0.004 sec, 0 B selected)



--
This message was sent by Atlassian JIRA
(v6.2#6252)