[jira] [Created] (DRILL-4247) Parquet statistics are ignored for tables created with partitioning

["Deneche A. Hakim (JIRA)" <ji...@apache.org>]

Deneche A. Hakim created DRILL-4247:
---------------------------------------

             Summary: Parquet statistics are ignored for tables created with partitioning
                 Key: DRILL-4247
                 URL: https://issues.apache.org/jira/browse/DRILL-4247
             Project: Apache Drill
          Issue Type: Bug
            Reporter: Deneche A. Hakim
            Assignee: Jason Altekruse


I am running all queries in embedded mode, using the latest master:
{noformat}
* e4372f2 2015-12-17 | DRILL-4242: Updates to storage-mongo (HEAD -> master, origin/master, origin/HEAD, origin/DRILL-3478) [Ross Lawley]
{noformat}

First run the following query:
{noformat}
create table dfs.tmp.test partition by (l_moddate) as select l.*, l_shipdate - extract(day from l_shipdate) + 1 l_moddate from cp.`tpch/lineitem.parquet` l;
{noformat}

then query the table just created:
{noformat}
select * from dfs.tmp.test order by l_orderkey;
{noformat}

after you close sqlline you should see the following warning
{noformat}
Jan 5, 2016 11:25:55 AM WARNING: org.apache.parquet.CorruptStatistics: Ignoring statistics because created_by is null or empty! See PARQUET-251 and PARQUET-297
{noformat}

To make sure the warning was not generated by the ctas, I closed sqlline between the queries.

I tried some variations of the query and I don't see the warning when there is no partitioning or if I partition on a column other than date (didn't try all types though).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)