[jira] [Created] (DRILL-2259) Projecting a nested repeated map results in IOOBE when the data has schema changes

["Rahul Challapalli (JIRA)" <ji...@apache.org>]

Rahul Challapalli created DRILL-2259:
----------------------------------------

             Summary: Projecting a nested repeated map results in IOOBE when the data has schema changes
                 Key: DRILL-2259
                 URL: https://issues.apache.org/jira/browse/DRILL-2259
             Project: Apache Drill
          Issue Type: Bug
          Components: Execution - Data Types
            Reporter: Rahul Challapalli
            Assignee: Daniel Barclay (Drill/MapR)


git.commit.id.abbrev=6676f2d

The data set contains 3 files with schema changes among them. By schema changes I refer to adding/removing fields among records/files

The below query which does a simple project on a field which does not have a schema change and is present in all the records
{code}
select d.type type, d.map.rm[1].rptd  from `schema_changes` d;
+------------+------------+
|    type    |   EXPR$1   |
+------------+------------+
| web        | [{"a":"bar"},{"c":1},{"d":4.5}] |
| store      | [{"a":"bar"},{"c":-1},{"d":4.5}] |
Query failed: RemoteRpcException: Failure while running fragment., index: -4, length: 4 (expected: range(0, 16384)) [ 289ca604-0ece-45ff-94ec-35c11264d7a8 on qa-node190.qa.lab:31010 ]
[ 289ca604-0ece-45ff-94ec-35c11264d7a8 on qa-node190.qa.lab:31010 ]


java.lang.RuntimeException: java.sql.SQLException: Failure while executing query.
	at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2514)
	at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148)
	at sqlline.SqlLine.print(SqlLine.java:1809)
	at sqlline.SqlLine$Commands.execute(SqlLine.java:3766)
	at sqlline.SqlLine$Commands.sql(SqlLine.java:3663)
	at sqlline.SqlLine.dispatch(SqlLine.java:889)
	at sqlline.SqlLine.begin(SqlLine.java:763)
	at sqlline.SqlLine.start(SqlLine.java:498)
	at sqlline.SqlLine.main(SqlLine.java:460)
{code}

The below query succeeds when we explicitly read from any one file
{code}
select d.type type, d.map.rm[1].rptd  from `schema_changes/file3.json` d;
+------------+------------+
|    type    |   EXPR$1   |
+------------+------------+
| web        | [{"a":"bar"},{"c":1},{"d":4.5}] |
| store      | [{"a":"bar"},{"c":-1},{"d":4.5}] |
+------------+------------+
2 rows selected (0.064 seconds)
{code}

I attached the data set and the error from the logs



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)