You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by "Geercken, Uwe" <Uw...@swissport.com> on 2015/07/29 16:20:14 UTC
Parquet File Partitioning
Hi Drill Friends,
I have used the CTAS statement on a CSV file to create parquet files with partitioning on one of the columns.
Unfortunately I have forgotten on which column I have done the partitioning. Is there a way in Drill to find out, how the data was partitioned?
If not, is there another way to analyze the parquet files and find it out? (Linux)
Greetings,
Uwe
Re: Parquet File Partitioning
Posted by Kristine Hahn <kh...@maprtech.com>.
Also, if you configured the ZooKeeper PStore
<http://drill.apache.org/docs/persistent-configuration-storage/#configuring-zookeeper-pstore>,
offloaded query profile data will be stored in the Drill log directory on
Drill nodes.
Kristine Hahn
Sr. Technical Writer
415-497-8107 @krishahn
On Wed, Jul 29, 2015 at 12:14 PM, Kristine Hahn <kh...@maprtech.com> wrote:
> You can display the command history:
> http://drill.apache.org/docs/configuring-the-drill-shell/
>
> It persists between sessions.
>
> Kristine Hahn
> Sr. Technical Writer
> 415-497-8107 @krishahn
>
>
> On Wed, Jul 29, 2015 at 7:20 AM, Geercken, Uwe <Uwe.Geercken@swissport.com
> > wrote:
>
>> Hi Drill Friends,
>>
>> I have used the CTAS statement on a CSV file to create parquet files with
>> partitioning on one of the columns.
>>
>> Unfortunately I have forgotten on which column I have done the
>> partitioning. Is there a way in Drill to find out, how the data was
>> partitioned?
>>
>> If not, is there another way to analyze the parquet files and find it
>> out? (Linux)
>>
>> Greetings,
>>
>> Uwe
>>
>>
>
Re: Parquet File Partitioning
Posted by Kristine Hahn <kh...@maprtech.com>.
You can display the command history:
http://drill.apache.org/docs/configuring-the-drill-shell/
It persists between sessions.
Kristine Hahn
Sr. Technical Writer
415-497-8107 @krishahn
On Wed, Jul 29, 2015 at 7:20 AM, Geercken, Uwe <Uw...@swissport.com>
wrote:
> Hi Drill Friends,
>
> I have used the CTAS statement on a CSV file to create parquet files with
> partitioning on one of the columns.
>
> Unfortunately I have forgotten on which column I have done the
> partitioning. Is there a way in Drill to find out, how the data was
> partitioned?
>
> If not, is there another way to analyze the parquet files and find it out?
> (Linux)
>
> Greetings,
>
> Uwe
>
>