You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Paul Rogers (JIRA)" <ji...@apache.org> on 2017/07/17 21:34:00 UTC
[jira] [Created] (DRILL-5674) Reading CSV file though table()
function does not handle compression
Paul Rogers created DRILL-5674:
----------------------------------
Summary: Reading CSV file though table() function does not handle compression
Key: DRILL-5674
URL: https://issues.apache.org/jira/browse/DRILL-5674
Project: Apache Drill
Issue Type: Bug
Affects Versions: 1.10.0
Reporter: Paul Rogers
Create a compressed CSV file with column headers: data.csv.zip.
Define a storage plugin config for the file, call it "dfs.myws", set delimiter = ",", extract header = true, skip header = false.
Run a simple query:
SELECT * FROM dfs.myws.`data.csv.zip`
This works fine.
Now, do the same thing, but using a table function:
{code}
SELECT * FROM table(dfs.myws.`data.csv.zip` (type => 'text', fieldDelimiter => ',' , extractHeader => true))
{code}
This does not work. Apparently, the reader tries to read the zip file as if it were an uncompressed file:
{code}
DATA_READ ERROR: Drill failed to read your text file. Drill supports up to 65536 columns in a text file. Your file appears to have more than that.
Failure while reading file file:/Users/fred/data/data.csv.zip. Happened at or shortly before byte position 121177.
{code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)