You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Parth Chandra (JIRA)" <ji...@apache.org> on 2015/04/06 22:36:13 UTC
[jira] [Updated] (DRILL-2259) Projecting a nested repeated map
results in IOOBE when the data has schema changes
[ https://issues.apache.org/jira/browse/DRILL-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Parth Chandra updated DRILL-2259:
---------------------------------
Fix Version/s: (was: 1.0.0)
1.1.0
> Projecting a nested repeated map results in IOOBE when the data has schema changes
> ----------------------------------------------------------------------------------
>
> Key: DRILL-2259
> URL: https://issues.apache.org/jira/browse/DRILL-2259
> Project: Apache Drill
> Issue Type: Bug
> Components: Execution - Data Types
> Reporter: Rahul Challapalli
> Assignee: Hanifi Gunes
> Fix For: 1.1.0
>
> Attachments: error.log, file1.json, file2.json, file3.json
>
>
> git.commit.id.abbrev=6676f2d
> The data set contains 3 files with schema changes among them. By schema changes I refer to adding/removing fields among records/files
> The below query which does a simple project on a field which does not have a schema change and is present in all the records
> {code}
> select d.type type, d.map.rm[1].rptd from `schema_changes` d;
> +------------+------------+
> | type | EXPR$1 |
> +------------+------------+
> | web | [{"a":"bar"},{"c":1},{"d":4.5}] |
> | store | [{"a":"bar"},{"c":-1},{"d":4.5}] |
> Query failed: RemoteRpcException: Failure while running fragment., index: -4, length: 4 (expected: range(0, 16384)) [ 289ca604-0ece-45ff-94ec-35c11264d7a8 on qa-node190.qa.lab:31010 ]
> [ 289ca604-0ece-45ff-94ec-35c11264d7a8 on qa-node190.qa.lab:31010 ]
> java.lang.RuntimeException: java.sql.SQLException: Failure while executing query.
> at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2514)
> at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148)
> at sqlline.SqlLine.print(SqlLine.java:1809)
> at sqlline.SqlLine$Commands.execute(SqlLine.java:3766)
> at sqlline.SqlLine$Commands.sql(SqlLine.java:3663)
> at sqlline.SqlLine.dispatch(SqlLine.java:889)
> at sqlline.SqlLine.begin(SqlLine.java:763)
> at sqlline.SqlLine.start(SqlLine.java:498)
> at sqlline.SqlLine.main(SqlLine.java:460)
> {code}
> The below query succeeds when we explicitly read from any one file
> {code}
> select d.type type, d.map.rm[1].rptd from `schema_changes/file3.json` d;
> +------------+------------+
> | type | EXPR$1 |
> +------------+------------+
> | web | [{"a":"bar"},{"c":1},{"d":4.5}] |
> | store | [{"a":"bar"},{"c":-1},{"d":4.5}] |
> +------------+------------+
> 2 rows selected (0.064 seconds)
> {code}
> I attached the data set and the error from the logs
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)