[jira] [Created] (DRILL-7709) CTAS as CSV creates files which the "csv" plugin can't read

["Paul Rogers (Jira)" <ji...@apache.org>]

Paul Rogers created DRILL-7709:
----------------------------------

             Summary: CTAS as CSV creates files which the "csv" plugin can't read
                 Key: DRILL-7709
                 URL: https://issues.apache.org/jira/browse/DRILL-7709
             Project: Apache Drill
          Issue Type: Bug
    Affects Versions: 1.17.0
            Reporter: Paul Rogers


Change the output format to JSON and create a CSV file:
{noformat}
ALTER SESSION SET `store.format` = 'csv';
CREATE TABLE foo AS ...
 {noformat}

You will end up with a directory "foo" that contains a CSV file: "0_0_0.csv". Now, try to query that file:

{noformat}
SELECT * FROM foo
{noformat}

The query will fail, or return incorrect results, because in Drill, the "csv" read format is CSV *without* headers. But, on write, "csv" is CSV *with* headers.

The (very messy) workaround is to manually rename all the files to use the ".csvh" suffix, or to create a separate storage plugin config for that target with a new "csv" format plugin that does not have headers.

Expected that if I create a file in Drill I should be able to immediately read that file without extra hokey-pokey.
 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)