[jira] [Created] (DRILL-5374) Parquet filter pushdown does not prune partition with nulls when predicate uses float column

["Robert Hou (JIRA)" <ji...@apache.org>]

Robert Hou created DRILL-5374:
---------------------------------

             Summary: Parquet filter pushdown does not prune partition with nulls when predicate uses float column
                 Key: DRILL-5374
                 URL: https://issues.apache.org/jira/browse/DRILL-5374
             Project: Apache Drill
          Issue Type: Bug
          Components: Query Planning & Optimization
    Affects Versions: 1.9.0
            Reporter: Robert Hou
            Assignee: Jinfeng Ni


Drill does not prune enough partitions for this query when filter pushdown is used with metadata caching. The float column is being compared with a double value.

{code}
0: jdbc:drill:zk=10.10.100.186:5181/drill/rho> select count(*) from orders_parts_metadata where float_id < 1100.0;
{code}

To reproduce the problem, put the attached files into a directory. Then 

{code}
create the metadata:
refresh table metadata dfs.`path_to_directory`;
{code}

For example, if you put the files in /drill/testdata/filter/orders_parts_metadata, then run this sql command

{code}
refresh table metadata dfs.`/drill/testdata/filter/orders_parts_metadata`;
{code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)