You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Khurram Faraaz (JIRA)" <ji...@apache.org> on 2017/05/02 02:53:04 UTC
[jira] [Updated] (DRILL-5456) convert JSON array to UTF-8 results
in StringIndexOutOfBoundsException
[ https://issues.apache.org/jira/browse/DRILL-5456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Khurram Faraaz updated DRILL-5456:
----------------------------------
Summary: convert JSON array to UTF-8 results in StringIndexOutOfBoundsException (was: StringIndexOutOfBoundsException when converting a JSON array to UTF-8)
> convert JSON array to UTF-8 results in StringIndexOutOfBoundsException
> ----------------------------------------------------------------------
>
> Key: DRILL-5456
> URL: https://issues.apache.org/jira/browse/DRILL-5456
> Project: Apache Drill
> Issue Type: Bug
> Components: Execution - Flow
> Affects Versions: 1.11.0
> Reporter: Khurram Faraaz
>
> Convert a JSON array to UTF-8 using CONVERT_TO function results in StringIndexOutOfBoundsException
> Apache Drill 1.11.0 commit ID: 3e8b01d
> Data used in test
> {noformat}
> [root@centos-01 ~]# cat rptd_count.json
> {"arr":[0,1,2,3,4,5,6,7,8,9,10],"id":1}
> {"arr":[0,1,2,3,4,5,6,7,8,9,10],"id":2}
> {"arr":[0,1,2,3,4,5,6,7,8,9,10],"id":3}
> {"arr":[0,1,2,3,4,5,6,7,8,9,10],"id":4}
> {"arr":[0,1,2,3,4,5,6,7,8,9,10],"id":5}
> {"arr":[0,1,2,3,4,5,6,7,8,9,10],"id":6}
> {"arr":[0,1,2,3,4,5,6,7,8,9,10],"id":7}
> {"arr":[0,1,2,3,4,5,6,7,8,9,10],"id":8}
> {"arr":[0,1,2,3,4,5,6,7,8,9,10],"id":9}
> {"arr":[0,1,2,3,4,5,6,7,8,9,10],"id":10}
> [root@centos-01 ~]#
> {noformat}
> {noformat}
> 0: jdbc:drill:schema=dfs.tmp> select convert_to(t.arr,'UTF-8') c, id from `rptd_count.json` t;
> Error: SYSTEM ERROR: StringIndexOutOfBoundsException: String index out of range: -3
> [Error Id: 056a13c0-6c9f-403e-877e-040e907d6581 on centos-01.qa.lab:31010] (state=,code=0)
> 0: jdbc:drill:schema=dfs.tmp>
> {noformat}
> Data from the JSON file
> {noformat}
> 0: jdbc:drill:schema=dfs.tmp> select * from `rptd_count.json`;
> +---------------------------+-----+
> | arr | id |
> +---------------------------+-----+
> | [0,1,2,3,4,5,6,7,8,9,10] | 1 |
> | [0,1,2,3,4,5,6,7,8,9,10] | 2 |
> | [0,1,2,3,4,5,6,7,8,9,10] | 3 |
> | [0,1,2,3,4,5,6,7,8,9,10] | 4 |
> | [0,1,2,3,4,5,6,7,8,9,10] | 5 |
> | [0,1,2,3,4,5,6,7,8,9,10] | 6 |
> | [0,1,2,3,4,5,6,7,8,9,10] | 7 |
> | [0,1,2,3,4,5,6,7,8,9,10] | 8 |
> | [0,1,2,3,4,5,6,7,8,9,10] | 9 |
> | [0,1,2,3,4,5,6,7,8,9,10] | 10 |
> +---------------------------+-----+
> 10 rows selected (0.224 seconds)
> {noformat}
> Stack trace from drillbit.log
> {noformat}
> 2017-05-01 19:32:34,209 [26f872ad-62a3-d7a7-aec1-9c7d937a2416:foreman] INFO o.a.drill.exec.work.foreman.Foreman - Query text for query id 26f872ad-62a3-d7a7-aec1-9c7d937a2416: select convert_to(t.arr,'UTF-8') c, id from `rptd_count.json` t
> ...
> 2017-05-01 19:32:34,328 [26f872ad-62a3-d7a7-aec1-9c7d937a2416:foreman] ERROR o.a.drill.exec.work.foreman.Foreman - SYSTEM ERROR: StringIndexOutOfBoundsException: String index out of range: -3
> [Error Id: 056a13c0-6c9f-403e-877e-040e907d6581 on centos-01.qa.lab:31010]
> org.apache.drill.common.exceptions.UserException: SYSTEM ERROR: StringIndexOutOfBoundsException: String index out of range: -3
> [Error Id: 056a13c0-6c9f-403e-877e-040e907d6581 on centos-01.qa.lab:31010]
> at org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:544) ~[drill-common-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at org.apache.drill.exec.work.foreman.Foreman$ForemanResult.close(Foreman.java:847) [drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at org.apache.drill.exec.work.foreman.Foreman.moveToState(Foreman.java:977) [drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:297) [drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_91]
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_91]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91]
> Caused by: org.apache.drill.exec.work.foreman.ForemanException: Unexpected exception during fragment initialization: String index out of range: -3
> ... 4 common frames omitted
> Caused by: java.lang.StringIndexOutOfBoundsException: String index out of range: -3
> at java.lang.String.substring(String.java:1931) ~[na:1.8.0_91]
> at org.apache.drill.exec.planner.logical.PreProcessLogicalRel.getConvertFunctionException(PreProcessLogicalRel.java:244) ~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at org.apache.drill.exec.planner.logical.PreProcessLogicalRel.visit(PreProcessLogicalRel.java:148) ~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at org.apache.calcite.rel.logical.LogicalProject.accept(LogicalProject.java:129) ~[calcite-core-1.4.0-drill-r21.jar:1.4.0-drill-r21]
> at org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.preprocessNode(DefaultSqlHandler.java:641) ~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateAndConvert(DefaultSqlHandler.java:196) ~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.getPlan(DefaultSqlHandler.java:164) ~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at org.apache.drill.exec.planner.sql.DrillSqlWorker.getQueryPlan(DrillSqlWorker.java:131) ~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan(DrillSqlWorker.java:79) ~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at org.apache.drill.exec.work.foreman.Foreman.runSQL(Foreman.java:1050) [drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:280) [drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> ... 3 common frames omitted
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)