You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Kunal Khatua (JIRA)" <ji...@apache.org> on 2017/07/26 21:45:00 UTC
[jira] [Commented] (DRILL-5569) NullPointerException in Async
Parquet reader
[ https://issues.apache.org/jira/browse/DRILL-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102331#comment-16102331 ]
Kunal Khatua commented on DRILL-5569:
-------------------------------------
[~khfaraaz] can you verify whether this issue is resolved?
A PR (https://github.com/apache/drill/pull/862) for DRILL-5420 might have addressed this.
> NullPointerException in Async Parquet reader
> --------------------------------------------
>
> Key: DRILL-5569
> URL: https://issues.apache.org/jira/browse/DRILL-5569
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - Parquet
> Affects Versions: 1.11.0
> Reporter: Khurram Faraaz
>
> The below Exception was seen when TPC-DS Query 4 was executed against Drill 1.11.0
> Drill 1.11.0 git commit ID: d11aba2
> [root@centos-01 mapr]# cat MapRBuildVersion
> 5.2.1.42646.GA
> Stack trace from drillbit.log
> {noformat}
> 2017-06-06 07:46:43,160 [Drillbit-ShutdownHook#0] WARN o.apache.drill.exec.work.WorkManager - Closing WorkManager but there are 80 running fragments.
> 2017-06-06 07:46:43,207 [Drillbit-ShutdownHook#0] INFO o.a.drill.exec.compile.CodeCompiler - Stats: code gen count: 959, cache miss count: 12, hit rate: 99%
> 2017-06-06 07:46:43,504 [scan-3] ERROR o.a.d.e.u.f.BufferedDirectBufInputStream - Error reading from stream 1_1_0.parquet. Error was : Error reading out of an FSDataInputStream using the Hadoop 2 ByteBuffer based read method.
> 2017-06-06 07:46:43,510 [scan-8] ERROR o.a.d.e.u.f.BufferedDirectBufInputStream - Error reading from stream 1_1_0.parquet. Error was : Error reading out of an FSDataInputStream using the Hadoop 2 ByteBuffer based read method.
> 2017-06-06 07:46:43,514 [scan-8] INFO o.a.d.e.s.p.c.AsyncPageReader - User Error Occurred: Exception occurred while reading from disk. (java.io.IOException: Error reading out of an FSDataInputStream using the Hadoop 2 ByteBuffer based read method.)
> org.apache.drill.common.exceptions.UserException: DATA_READ ERROR: Exception occurred while reading from disk.
> File: /drill/testdata/tpcds_sf1/parquet/store_sales/1_1_0.parquet
> Column: ss_ext_list_price
> Row Group Start: 75660513
> [Error Id: 3a758095-fcc4-4364-a50b-33a027c1beb6 ]
> at org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:544) ~[drill-common-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at org.apache.drill.exec.store.parquet.columnreaders.AsyncPageReader.handleAndThrowException(AsyncPageReader.java:199) [drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at org.apache.drill.exec.store.parquet.columnreaders.AsyncPageReader.access$600(AsyncPageReader.java:81) [drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at org.apache.drill.exec.store.parquet.columnreaders.AsyncPageReader$AsyncPageReaderTask.call(AsyncPageReader.java:483) [drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at org.apache.drill.exec.store.parquet.columnreaders.AsyncPageReader$AsyncPageReaderTask.call(AsyncPageReader.java:392) [drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_65]
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_65]
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_65]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_65]
> Caused by: java.io.IOException: java.io.IOException: Error reading out of an FSDataInputStream using the Hadoop 2 ByteBuffer based read method.
> at org.apache.drill.exec.util.filereader.BufferedDirectBufInputStream.getNextBlock(BufferedDirectBufInputStream.java:185) ~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at org.apache.drill.exec.util.filereader.BufferedDirectBufInputStream.readInternal(BufferedDirectBufInputStream.java:212) ~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at org.apache.drill.exec.util.filereader.BufferedDirectBufInputStream.read(BufferedDirectBufInputStream.java:277) ~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at org.apache.drill.exec.util.filereader.DirectBufInputStream.getNext(DirectBufInputStream.java:111) ~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> at org.apache.drill.exec.store.parquet.columnreaders.AsyncPageReader$AsyncPageReaderTask.call(AsyncPageReader.java:437) [drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> ... 5 common frames omitted
> Caused by: java.io.IOException: Error reading out of an FSDataInputStream using the Hadoop 2 ByteBuffer based read method.
> at org.apache.parquet.hadoop.util.CompatibilityUtil.getBuf(CompatibilityUtil.java:99) ~[parquet-hadoop-1.8.1-drill-r0.jar:1.8.1-drill-r0]
> at org.apache.drill.exec.util.filereader.BufferedDirectBufInputStream.getNextBlock(BufferedDirectBufInputStream.java:182) ~[drill-java-exec-1.11.0-SNAPSHOT.jar:1.11.0-SNAPSHOT]
> ... 9 common frames omitted
> Caused by: java.lang.NullPointerException: null
> at com.mapr.fs.MapRFsInStream.readIntoDirectByteBuffer(MapRFsInStream.java:219) ~[maprfs-5.2.1-mapr.jar:5.2.1-mapr]
> at com.mapr.fs.MapRFsInStream.read(MapRFsInStream.java:333) ~[maprfs-5.2.1-mapr.jar:5.2.1-mapr]
> at org.apache.hadoop.fs.FSDataInputStream.read(FSDataInputStream.java:156) ~[hadoop-common-2.7.0-mapr-1607.jar:na]
> at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source) ~[na:na]
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_65]
> at java.lang.reflect.Method.invoke(Method.java:497) ~[na:1.8.0_65]
> at org.apache.parquet.hadoop.util.CompatibilityUtil.getBuf(CompatibilityUtil.java:83) ~[parquet-hadoop-1.8.1-drill-r0.jar:1.8.1-drill-r0]
> ... 10 common frames omitted
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)