You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by chandan prakash <ch...@gmail.com> on 2015/10/27 10:40:48 UTC
Exception with CSV storage format : Repeated types are not supported
Hi everyone,
Can anyone help how to write CTAS query with storage format as CSV without
giving the "Repeated types are not supported" Exception.
If i am using any other storage format like JSON or PARQUET,its working
fine but i have to use CSV format.
*Saw similar JIRA bug : https://issues.apache.org/jira/browse/DRILL-1954
<https://issues.apache.org/jira/browse/DRILL-1954>*
but its still in open state.
I have a query like :
alter session set `store.format`='csv';
CREATE TABLE dfs.csvlogs.`jobId` AS SELECT * FROM
dfs.parquetlogs.`parquetlogs` ;
*Getting exception :*
0: jdbc:drill:zk=local> CREATE TABLE dfs.csvlogs.`jobId` AS SELECT * FROM
dfs.parquetlogs.`parquetlogs` where dir0>'20150928';
Error: SYSTEM ERROR: UnsupportedOperationException: Repeated types are not
supported.
Fragment 1:1
[Error Id: 8da5886d-72f5-4801-891b-fcb5d0f1bbf0 on chandans-mbp:31010]
(java.lang.UnsupportedOperationException) Repeated types are not
supported.
org.apache.drill.exec.store.StringOutputRecordWriter$RepeatedVarCharStringFieldConverter.writeField():1560
org.apache.drill.exec.store.EventBasedRecordWriter.write():61
org.apache.drill.exec.physical.impl.WriterRecordBatch.innerNext():106
org.apache.drill.exec.record.AbstractRecordBatch.next():147
org.apache.drill.exec.physical.impl.BaseRootExec.next():83
org.apache.drill.exec.physical.impl.SingleSenderCreator$SingleSenderRootExec.innerNext():93
org.apache.drill.exec.physical.impl.BaseRootExec.next():73
--
Chandan Prakash
Re: Exception with CSV storage format : Repeated types are not supported
Posted by Abdel Hakim Deneche <ad...@maprtech.com>.
Hey Chandan,
I assume 'parquetlogs' contain parquet files, right ?
what is the schema of 'parquetlogs' ? does it contain repeated fields ?
thanks
On Tue, Oct 27, 2015 at 2:40 AM, chandan prakash <ch...@gmail.com>
wrote:
> Hi everyone,
> Can anyone help how to write CTAS query with storage format as CSV without
> giving the "Repeated types are not supported" Exception.
> If i am using any other storage format like JSON or PARQUET,its working
> fine but i have to use CSV format.
> *Saw similar JIRA bug : https://issues.apache.org/jira/browse/DRILL-1954
> <https://issues.apache.org/jira/browse/DRILL-1954>*
> but its still in open state.
>
> I have a query like :
> alter session set `store.format`='csv';
> CREATE TABLE dfs.csvlogs.`jobId` AS SELECT * FROM
> dfs.parquetlogs.`parquetlogs` ;
>
> *Getting exception :*
> 0: jdbc:drill:zk=local> CREATE TABLE dfs.csvlogs.`jobId` AS SELECT * FROM
> dfs.parquetlogs.`parquetlogs` where dir0>'20150928';
> Error: SYSTEM ERROR: UnsupportedOperationException: Repeated types are not
> supported.
>
> Fragment 1:1
>
> [Error Id: 8da5886d-72f5-4801-891b-fcb5d0f1bbf0 on chandans-mbp:31010]
>
> (java.lang.UnsupportedOperationException) Repeated types are not
> supported.
>
>
> org.apache.drill.exec.store.StringOutputRecordWriter$RepeatedVarCharStringFieldConverter.writeField():1560
> org.apache.drill.exec.store.EventBasedRecordWriter.write():61
> org.apache.drill.exec.physical.impl.WriterRecordBatch.innerNext():106
> org.apache.drill.exec.record.AbstractRecordBatch.next():147
> org.apache.drill.exec.physical.impl.BaseRootExec.next():83
>
>
> org.apache.drill.exec.physical.impl.SingleSenderCreator$SingleSenderRootExec.innerNext():93
> org.apache.drill.exec.physical.impl.BaseRootExec.next():73
>
>
> --
> Chandan Prakash
>
--
Abdelhakim Deneche
Software Engineer
<http://www.mapr.com/>
Now Available - Free Hadoop On-Demand Training
<http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available>