You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Steven Phillips (JIRA)" <ji...@apache.org> on 2015/06/22 19:33:00 UTC
[jira] [Created] (DRILL-3333) Add support for auto-partitioning in
parquet writer
Steven Phillips created DRILL-3333:
--------------------------------------
Summary: Add support for auto-partitioning in parquet writer
Key: DRILL-3333
URL: https://issues.apache.org/jira/browse/DRILL-3333
Project: Apache Drill
Issue Type: Bug
Reporter: Steven Phillips
When a table is created with a partition by clause, the parquet writer will create separate files for the different partition values. The data will first be sorted by the partition keys, and the parquet writer will create new file when it encounters a new value for the partition columns.
When data is queried against the data that was created this way, partition pruning will work if the filter contains a partition column. And unlike directory based partitioning, no view is required, nor is it necessary to reference the dir* column names.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)