You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by chandan prakash <ch...@gmail.com> on 2015/10/27 10:40:48 UTC

Exception with CSV storage format : Repeated types are not supported

Hi everyone,
Can anyone help how to write CTAS query with storage format as CSV without
giving the "Repeated types are not supported" Exception.
If i am using any other storage format like JSON or PARQUET,its working
fine but i have to use CSV format.
*Saw similar JIRA bug :  https://issues.apache.org/jira/browse/DRILL-1954
<https://issues.apache.org/jira/browse/DRILL-1954>*
but its still in open state.

I have a query like :
alter session set `store.format`='csv';
CREATE TABLE dfs.csvlogs.`jobId` AS SELECT * FROM
dfs.parquetlogs.`parquetlogs` ;

*Getting exception :*
0: jdbc:drill:zk=local> CREATE TABLE dfs.csvlogs.`jobId` AS   SELECT * FROM
dfs.parquetlogs.`parquetlogs` where dir0>'20150928';
Error: SYSTEM ERROR: UnsupportedOperationException: Repeated types are not
supported.

Fragment 1:1

[Error Id: 8da5886d-72f5-4801-891b-fcb5d0f1bbf0 on chandans-mbp:31010]

  (java.lang.UnsupportedOperationException) Repeated types are not
supported.

org.apache.drill.exec.store.StringOutputRecordWriter$RepeatedVarCharStringFieldConverter.writeField():1560
    org.apache.drill.exec.store.EventBasedRecordWriter.write():61
    org.apache.drill.exec.physical.impl.WriterRecordBatch.innerNext():106
    org.apache.drill.exec.record.AbstractRecordBatch.next():147
    org.apache.drill.exec.physical.impl.BaseRootExec.next():83

org.apache.drill.exec.physical.impl.SingleSenderCreator$SingleSenderRootExec.innerNext():93
    org.apache.drill.exec.physical.impl.BaseRootExec.next():73


-- 
Chandan Prakash

Re: Exception with CSV storage format : Repeated types are not supported

Posted by Abdel Hakim Deneche <ad...@maprtech.com>.
Hey Chandan,

I assume 'parquetlogs' contain parquet files, right ?
what is the schema of 'parquetlogs' ? does it contain repeated fields ?

thanks

On Tue, Oct 27, 2015 at 2:40 AM, chandan prakash <ch...@gmail.com>
wrote:

> Hi everyone,
> Can anyone help how to write CTAS query with storage format as CSV without
> giving the "Repeated types are not supported" Exception.
> If i am using any other storage format like JSON or PARQUET,its working
> fine but i have to use CSV format.
> *Saw similar JIRA bug :  https://issues.apache.org/jira/browse/DRILL-1954
> <https://issues.apache.org/jira/browse/DRILL-1954>*
> but its still in open state.
>
> I have a query like :
> alter session set `store.format`='csv';
> CREATE TABLE dfs.csvlogs.`jobId` AS SELECT * FROM
> dfs.parquetlogs.`parquetlogs` ;
>
> *Getting exception :*
> 0: jdbc:drill:zk=local> CREATE TABLE dfs.csvlogs.`jobId` AS   SELECT * FROM
> dfs.parquetlogs.`parquetlogs` where dir0>'20150928';
> Error: SYSTEM ERROR: UnsupportedOperationException: Repeated types are not
> supported.
>
> Fragment 1:1
>
> [Error Id: 8da5886d-72f5-4801-891b-fcb5d0f1bbf0 on chandans-mbp:31010]
>
>   (java.lang.UnsupportedOperationException) Repeated types are not
> supported.
>
>
> org.apache.drill.exec.store.StringOutputRecordWriter$RepeatedVarCharStringFieldConverter.writeField():1560
>     org.apache.drill.exec.store.EventBasedRecordWriter.write():61
>     org.apache.drill.exec.physical.impl.WriterRecordBatch.innerNext():106
>     org.apache.drill.exec.record.AbstractRecordBatch.next():147
>     org.apache.drill.exec.physical.impl.BaseRootExec.next():83
>
>
> org.apache.drill.exec.physical.impl.SingleSenderCreator$SingleSenderRootExec.innerNext():93
>     org.apache.drill.exec.physical.impl.BaseRootExec.next():73
>
>
> --
> Chandan Prakash
>



-- 

Abdelhakim Deneche

Software Engineer

  <http://www.mapr.com/>


Now Available - Free Hadoop On-Demand Training
<http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available>