You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@drill.apache.org by Sharath Akinapally <sh...@innovaccer.com> on 2015/05/15 15:44:45 UTC

Java Exception when querying on parquet file

Hi,

I recently cloned the apache drill master project and built it on
amazon r3.xlarge
instance(4 CPUs, 30.5GB RAM).

When I query on a 45MB parquet file, I got the following error after
fetching few rows
"java.lang.RuntimeException: java.sql.SQLException: SYSTEM ERROR:
java.lang.IllegalArgumentException: initialCapacity: -2147483648 (expectd:
0+)

Fragment 0:0

[Error Id: 69a541ac-5124-4c5a-8e15-0bd8ce06be89 on
ip-172-31-35-55.ec2.internal:31010]
at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2514)
at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148)
at sqlline.SqlLine.print(SqlLine.java:1809)
at sqlline.SqlLine$Commands.execute(SqlLine.java:3766)
at sqlline.SqlLine$Commands.sql(SqlLine.java:3663)
at sqlline.SqlLine.dispatch(SqlLine.java:889)
at sqlline.SqlLine.begin(SqlLine.java:763)
at sqlline.SqlLine.start(SqlLine.java:498)
at sqlline.SqlLine.main(SqlLine.java:460)"


When the same query was run on local machine(4GB RAM) I got following error

"java.lang.RuntimeException: java.sql.SQLException: RESOURCE ERROR: One or
more nodes ran out of memory while executing the query.

Fragment 0:0

[Error Id: 90322cac-4f27-4a47-8479-31445421a16a on localhost:31010]
at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2514)
at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148)
at sqlline.SqlLine.print(SqlLine.java:1809)
at sqlline.SqlLine$Commands.execute(SqlLine.java:3766)
at sqlline.SqlLine$Commands.sql(SqlLine.java:3663)
at sqlline.SqlLine.dispatch(SqlLine.java:889)
at sqlline.SqlLine.begin(SqlLine.java:763)
at sqlline.SqlLine.start(SqlLine.java:498)
at sqlline.SqlLine.main(SqlLine.java:460)"


So I tried increasing DRILL_HEAP and DRILL_MAX_DIRECT_MEMORY in
drill-env.sh, but no change in result.

Between the query was something like this "select q.funder['user_id'] from
(select flatten(campaign['funders']) funder from `crowdfunding`) q;"

It would be great if someone could help me with this issue.




-- 
Regards,
Sharath Akinapally,
Innovaccer.