You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Jacques Nadeau (JIRA)" <ji...@apache.org> on 2015/01/04 22:28:40 UTC
[jira] [Updated] (DRILL-1146) JSON schema change cause query
fail/sqline hang
[ https://issues.apache.org/jira/browse/DRILL-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jacques Nadeau updated DRILL-1146:
----------------------------------
Issue Type: New Feature (was: Bug)
> JSON schema change cause query fail/sqline hang
> -----------------------------------------------
>
> Key: DRILL-1146
> URL: https://issues.apache.org/jira/browse/DRILL-1146
> Project: Apache Drill
> Issue Type: New Feature
> Reporter: Cliff Buchanan
> Assignee: Neeraja
> Fix For: Future
>
>
> Running a simple {{select *}} against this file
> {code}
> {"a" : 0, "b" : 1}
> {"a" : 1, "b" : "1"}
> {code}
> yields these results:
> add_producer_consumer = true (default)
> {code}
> 0: jdbc:drill:zk=local> explain plan for select * from dfs.home.`test.json`;
> +------------+------------+
> | text | json |
> +------------+------------+
> | 00-00 Screen
> 00-01 ProducerConsumer
> 00-02 Scan(groupscan=[EasyGroupScan [selectionRoot=/Users/rbuchanan/test.json, columns = null]])
> | {
> "head" : {
> "version" : 1,
> "generator" : {
> |
> +------------+------------+
> 1 row selected (0.992 seconds)
> 0: jdbc:drill:zk=local> select * from dfs.home.`test.json`;
> Exception in thread "c7f12d21-4def-461f-9d1b-ae7af669ae81:frag:0:0 - Producer Thread" java.lang.IllegalArgumentException: You tried to write a VarChar type when you are using a ValueWriter of type NullableBigIntWriterImpl.
> at org.apache.drill.exec.vector.complex.impl.AbstractFieldWriter.fail(AbstractFieldWriter.java:509)
> at org.apache.drill.exec.vector.complex.impl.AbstractFieldWriter.write(AbstractFieldWriter.java:197)
> at org.apache.drill.exec.vector.complex.impl.NullableBigIntWriterImpl.write(NullableBigIntWriterImpl.java:83)
> at org.apache.drill.exec.vector.complex.fn.JsonReader.writeData(JsonReader.java:140)
> at org.apache.drill.exec.vector.complex.fn.JsonReader.write(JsonReader.java:65)
> at org.apache.drill.exec.vector.complex.fn.JsonReaderWithState.write(JsonReaderWithState.java:52)
> at org.apache.drill.exec.store.easy.json.JSONRecordReader2.next(JSONRecordReader2.java:82)
> at org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:138)
> at org.apache.drill.exec.physical.impl.producer.ProducerConsumerBatch$Producer.run(ProducerConsumerBatch.java:122)
> at java.lang.Thread.run(Thread.java:745)
> {code}
> add_producer_consumer = false
> {code}
> 0: jdbc:drill:zk=local> alter session set `planner.add_producer_consumer` = false;
> +------------+------------+
> | ok | summary |
> +------------+------------+
> | true | planner.add_producer_consumer updated. |
> +------------+------------+
> 1 row selected (0.7 seconds)
> 0: jdbc:drill:zk=local> explain plan for select * from dfs.home.`test.json`;
> +------------+------------+
> | text | json |
> +------------+------------+
> | 00-00 Screen
> 00-01 Scan(groupscan=[EasyGroupScan [selectionRoot=/Users/rbuchanan/test.json, columns = null]])
> | {
> "head" : {
> "version" : 1,
> "generator" : {
> "type" : "ExplainHandler |
> +------------+------------+
> 1 row selected (0.287 seconds)
> 0: jdbc:drill:zk=local> select * from dfs.home.`test.json`;
> Query failed: org.apache.drill.exec.rpc.RpcException: Remote failure while running query.[error_id: "65c1d03a-3641-482e-871b-4c52ea951b4d"
> endpoint {
> address: "10.250.0.18"
> user_port: 31010
> control_port: 31011
> data_port: 31012
> }
> error_type: 0
> message: "Failure while running fragment. < IllegalArgumentException:[ You tried to write a VarChar type when you are using a ValueWriter of type NullableBigIntWriterImpl. ]"
> ]
> Error: exception while executing query (state=,code=0)
> 0: jdbc:drill:zk=local>
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)