You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Daniel Barclay (Drill) (JIRA)" <ji...@apache.org> on 2015/04/30 22:01:07 UTC
[jira] [Comment Edited] (DRILL-2924) IOBException when querying a
table which has 1 file and a subfolder with 1 file
[ https://issues.apache.org/jira/browse/DRILL-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522148#comment-14522148 ]
Daniel Barclay (Drill) edited comment on DRILL-2924 at 4/30/15 8:00 PM:
------------------------------------------------------------------------
Investigation notes:
- Most of the content of {{toplevel_file.json}} (corresponding to {{a.json}} in description) and {{b.json}} is not relevant: Stripping {{toplevel_file.json}} down to just "{{\{\}}]" and {{b.json}} down to just "{{{"x":\[{}]\}}}" didn't change the error result.
- The nesting of {{b.json}} in {{folder1}} is not relevant. (Moving {{b.json}} up one level (with above change) didn't change the error result.)
- *File names are significant*:
-- Renaming "{{toplevel_file.json}}" to "{{a.json}}" (with above changes) resulted in one column, named "{{*}}" (is that right?), with two rows, both {{null}} (that's wrong, right?).
-- Renaming the "{{a.json}}" to "{{c.json}}" (lexicographically after "{{b.json}}") yielded the error again.
was (Author: dsbos):
Investigation notes:
- Most of the content of {{toplevel_file.json}} (corresponding to {{a.json}} in description) and {{b.json}} is not relevant: Stripping {{toplevel_file.json}} down to just "{{{\}}]" and {{b.json}} down to just "{{{"x":\[{}]\}}}" didn't change the error result.
- The nesting of {{b.json}} in {{folder1}} is not relevant. (Moving {{b.json}} up one level (with above change) didn't change the error result.)
- *File names are significant*:
-- Renaming "{{toplevel_file.json}}" to "{{a.json}}" (with above changes) resulted in one column, named "{{*}}" (is that right?), with two rows, both {{null}} (that's wrong, right?).
-- Renaming the "{{a.json}}" to "{{c.json}}" (lexicographically after "{{b.json}}") yielded the error again.
> IOBException when querying a table which has 1 file and a subfolder with 1 file
> -------------------------------------------------------------------------------
>
> Key: DRILL-2924
> URL: https://issues.apache.org/jira/browse/DRILL-2924
> Project: Apache Drill
> Issue Type: Bug
> Components: Client - JDBC, Storage - JSON, Storage - Parquet
> Reporter: Rahul Challapalli
> Assignee: Daniel Barclay (Drill)
> Priority: Critical
> Fix For: 1.0.0
>
> Attachments: data1.tar, error.log
>
>
> git.commit.id.abbrev=5fbd274
> Below is the folder structure
> Data Structure :
> {code}
> data1
> -- a.json
> -- folder1
> -- b.json
> {code}
> Query :
> {code}
> 0: jdbc:drill:schema=dfs_eea> select * from `data1`;
> +------------+---------------+-----------------+
> | dir0 | executionTime | stationBeanList |
> +------------+---------------+-----------------+
> | folder1 | 2014-11-04 11:54:01 AM | [{"id":72,"stationName":"W 52 St & 11 Ave", ..........
> java.lang.IndexOutOfBoundsException: index: -4, length: 4 (expected: range(0, 4))
> at io.netty.buffer.DrillBuf.checkIndexD(DrillBuf.java:200)
> at io.netty.buffer.DrillBuf.chk(DrillBuf.java:222)
> at io.netty.buffer.DrillBuf.getInt(DrillBuf.java:500)
> at org.apache.drill.exec.vector.UInt4Vector$Accessor.get(UInt4Vector.java:299)
> at org.apache.drill.exec.vector.complex.RepeatedMapVector$RepeatedMapAccessor.getValueCount(RepeatedMapVector.java:470)
> at org.apache.drill.exec.vector.accessor.BoundCheckingAccessor.getObject(BoundCheckingAccessor.java:142)
> at org.apache.drill.jdbc.impl.TypeConvertingSqlAccessor.getObject(TypeConvertingSqlAccessor.java:790)
> at org.apache.drill.jdbc.AvaticaDrillSqlAccessor.getObject(AvaticaDrillSqlAccessor.java:165)
> at net.hydromatic.avatica.AvaticaResultSet.getObject(AvaticaResultSet.java:351)
> at sqlline.SqlLine$Rows$Row.<init>(SqlLine.java:2388)
> at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2504)
> at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148)
> at sqlline.SqlLine.print(SqlLine.java:1809)
> at sqlline.SqlLine$Commands.execute(SqlLine.java:3766)
> at sqlline.SqlLine$Commands.sql(SqlLine.java:3663)
> at sqlline.SqlLine.dispatch(SqlLine.java:889)
> at sqlline.SqlLine.begin(SqlLine.java:763)
> at sqlline.SqlLine.start(SqlLine.java:498)
> at sqlline.SqlLine.main(SqlLine.java:460)
> {code}
> I attached the error log and the data file. Let me know if you need anything
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)