[jira] [Commented] (DRILL-4659) Specify, as part of the query, table information: data format (CSV, parquet, JSON. etc.), field delimiter, etc.

["Jason Altekruse (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/DRILL-4659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276627#comment-15276627 ] 

Jason Altekruse commented on DRILL-4659:
----------------------------------------

This feature was added last fall, I think we may want to duplicate this information in the section about "Querying Data" to make it easier to find, but the feature is documented here.

https://drill.apache.org/docs/plugin-configuration-basics/#using-the-formats-attributes-as-table-function-parameters

If you would like to see more examples of usage or information about the features development this was the JIRA for the feature: https://issues.apache.org/jira/browse/DRILL-4047

> Specify, as part of the query, table information: data format (CSV, parquet, JSON. etc.), field delimiter, etc.
> ---------------------------------------------------------------------------------------------------------------
>
>                 Key: DRILL-4659
>                 URL: https://issues.apache.org/jira/browse/DRILL-4659
>             Project: Apache Drill
>          Issue Type: Improvement
>          Components: Query Planning & Optimization, SQL Parser
>            Reporter: Roger Dielrton
>            Priority: Minor
>
> I have a file, that I would like to use in a query, and it can have one or more of the following properties:
> * Has not extension ==> Drill is unable to handle it.
> * I know it contains data in CSV format, but the field separator is a non standard character ==> Drill is unable to parse it (without modify the storage plugin configuration).
> * Is located in an Amazon S3 bucket ==> I can't rename it.
> * Has a big size ==> It would be expensive to make a copy of it. 
> It would be nice if you can specify, as part of the "select" query, as metadata, relevant table information as:
> * Data format (CSV, parquet, JSON. etc.)
> * Field delimiter.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)