You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by Leon Clayton <lc...@maprtech.com> on 2016/01/14 15:12:06 UTC

directory create CTAS behaviour

Hello All

Is it possible to change this behaviour. By default, a directory is created, using the exact table name specified in the CTAS statement. I don’t want a directory. 

http://drill.apache.org/docs/create-table-as-ctas-command/

Regards
 
Leon Clayton

Re: directory create CTAS behaviour

Posted by Leon Clayton <lc...@maprtech.com>.
I don’t require the output to go to a single file i just want to remove the sub folder creation on the output location.. 

Regards
 
Leon Clayton
Solutions Architect  | +44 (0)7530 980566
MapR Technologies UK Ltd.

Now Available - Free Hadoop On-Demand Training <http://www.mapr.com/training>
> On 14 Jan 2016, at 15:25, Jason Altekruse <al...@gmail.com> wrote:
> 
> The reason for creating a directory is that it allows us to write the data
> in parallel, writing different fragments of the query out to their own
> files. It would cost write performance if we enabled this as an option. As
> Drill consumes directories just like individual files we didn't bother
> giving the option/
> 
> Is there some external tool you want to process the data with that
> necessitates you have a single file?
> 
> On Thu, Jan 14, 2016 at 6:25 AM, Leon Clayton <lc...@maprtech.com> wrote:
> 
>> no folder, just the file in the location specified.
>> 
>> Now Available - Free Hadoop On-Demand Training <
>> http://www.mapr.com/training>
>>> On 14 Jan 2016, at 14:20, Neeraja Rentachintala <
>> nrentachintala@maprtech.com> wrote:
>>> 
>>> What would you like to see instead of directory.
>>> 
>>> On Thursday, January 14, 2016, Leon Clayton <lc...@maprtech.com>
>> wrote:
>>> 
>>>> Hello All
>>>> 
>>>> Is it possible to change this behaviour. By default, a directory is
>>>> created, using the exact table name specified in the CTAS statement. I
>>>> don’t want a directory.
>>>> 
>>>> http://drill.apache.org/docs/create-table-as-ctas-command/
>>>> 
>>>> Regards
>>>> 
>>>> Leon Clayton
>>>> 
>>>> 
>>>> 
>> 
>>

Re: directory create CTAS behaviour

Posted by Jason Altekruse <al...@gmail.com>.
The reason for creating a directory is that it allows us to write the data
in parallel, writing different fragments of the query out to their own
files. It would cost write performance if we enabled this as an option. As
Drill consumes directories just like individual files we didn't bother
giving the option/

Is there some external tool you want to process the data with that
necessitates you have a single file?

On Thu, Jan 14, 2016 at 6:25 AM, Leon Clayton <lc...@maprtech.com> wrote:

> no folder, just the file in the location specified.
>
> Now Available - Free Hadoop On-Demand Training <
> http://www.mapr.com/training>
> > On 14 Jan 2016, at 14:20, Neeraja Rentachintala <
> nrentachintala@maprtech.com> wrote:
> >
> > What would you like to see instead of directory.
> >
> > On Thursday, January 14, 2016, Leon Clayton <lc...@maprtech.com>
> wrote:
> >
> >> Hello All
> >>
> >> Is it possible to change this behaviour. By default, a directory is
> >> created, using the exact table name specified in the CTAS statement. I
> >> don’t want a directory.
> >>
> >> http://drill.apache.org/docs/create-table-as-ctas-command/
> >>
> >> Regards
> >>
> >> Leon Clayton
> >>
> >>
> >>
>
>

Re: directory create CTAS behaviour

Posted by Leon Clayton <lc...@maprtech.com>.
no folder, just the file in the location specified. 

Now Available - Free Hadoop On-Demand Training <http://www.mapr.com/training>
> On 14 Jan 2016, at 14:20, Neeraja Rentachintala <nr...@maprtech.com> wrote:
> 
> What would you like to see instead of directory.
> 
> On Thursday, January 14, 2016, Leon Clayton <lc...@maprtech.com> wrote:
> 
>> Hello All
>> 
>> Is it possible to change this behaviour. By default, a directory is
>> created, using the exact table name specified in the CTAS statement. I
>> don’t want a directory.
>> 
>> http://drill.apache.org/docs/create-table-as-ctas-command/
>> 
>> Regards
>> 
>> Leon Clayton
>> 
>> 
>>

Re: directory create CTAS behaviour

Posted by Neeraja Rentachintala <nr...@maprtech.com>.
What would you like to see instead of directory.

On Thursday, January 14, 2016, Leon Clayton <lc...@maprtech.com> wrote:

> Hello All
>
> Is it possible to change this behaviour. By default, a directory is
> created, using the exact table name specified in the CTAS statement. I
> don’t want a directory.
>
> http://drill.apache.org/docs/create-table-as-ctas-command/
>
> Regards
>
> Leon Clayton
>
>
>