You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Rahul Challapalli (JIRA)" <ji...@apache.org> on 2016/11/04 05:01:05 UTC
[jira] [Updated] (DRILL-4999) Metadata Cache Pruning not taking
place when we have both directory partitioning and auto partitioned parquet
files
[ https://issues.apache.org/jira/browse/DRILL-4999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rahul Challapalli updated DRILL-4999:
-------------------------------------
Attachment: error.log
item.tgz
> Metadata Cache Pruning not taking place when we have both directory partitioning and auto partitioned parquet files
> -------------------------------------------------------------------------------------------------------------------
>
> Key: DRILL-4999
> URL: https://issues.apache.org/jira/browse/DRILL-4999
> Project: Apache Drill
> Issue Type: Bug
> Components: Metadata, Query Planning & Optimization
> Reporter: Rahul Challapalli
> Attachments: error.log, item.tgz
>
>
> git.commit.id.abbrev=17b9648
> Metadata cache pruning is not taking place in the below scenario
> {code}
> 0: jdbc:drill:zk=10.10.100.190:5181> explain plan for select distinct i_rec_end_date from dfs.`/drill/testdata/parquet_date/auto_partition/item_single` where dir0='1.9' and i_rec_start_date = date '1997-10-27';
> +------+------+
> | text | json |
> +------+------+
> | 00-00 Screen
> 00-01 Project(i_rec_end_date=[$0])
> 00-02 HashAgg(group=[{0}])
> 00-03 Project(i_rec_end_date=[$2])
> 00-04 SelectionVectorRemover
> 00-05 Filter(condition=[AND(=($0, '1.9'), =($1, 1997-10-27))])
> 00-06 Scan(groupscan=[ParquetGroupScan [entries=[ReadEntryWithPath [path=/drill/testdata/parquet_date/auto_partition/item_single/1.9/0_0_1.parquet]], selectionRoot=/drill/testdata/parquet_date/auto_partition/item_single, numFiles=1, usedMetadataFile=true, cacheFileRoot=/drill/testdata/parquet_date/auto_partition/item_single, columns=[`dir0`, `i_rec_start_date`, `i_rec_end_date`]]])
> {code}
> I attached the data set and the log file
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)