You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Ramana Inukonda Nagaraj (JIRA)" <ji...@apache.org> on 2015/04/14 06:24:13 UTC
[jira] [Commented] (DRILL-2780) java.lang.IllegalStateException
files open exceptions in drillbit.out
[ https://issues.apache.org/jira/browse/DRILL-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14493541#comment-14493541 ]
Ramana Inukonda Nagaraj commented on DRILL-2780:
------------------------------------------------
And followed by:
{code}
File '/drill/testdata/tpch100/parquet/lineitem/part-m-00005.parquet' opened at callstack:
org.apache.drill.exec.store.parquet.columnreaders.PageReader.<init>(PageReader.java:105)
org.apache.drill.exec.store.parquet.columnreaders.ColumnReader.<init>(ColumnReader.java:87)
org.apache.drill.exec.store.parquet.columnreaders.NullableColumnReader.<init>(NullableColumnReader.java:45)
org.apache.drill.exec.store.parquet.columnreaders.NullableFixedByteAlignedReaders$NullableFixedByteAlignedReader.<init>(NullableFixedByteAlignedReaders.java:55)
org.apache.drill.exec.store.parquet.columnreaders.ColumnReaderFactory.getNullableColumnReader(ColumnReaderFactory.java:203)
org.apache.drill.exec.store.parquet.columnreaders.ColumnReaderFactory.createFixedColumnReader(ColumnReaderFactory.java:145)
org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.setup(ParquetRecordReader.java:297)
org.apache.drill.exec.physical.impl.ScanBatch.<init>(ScanBatch.java:100)
org.apache.drill.exec.store.parquet.ParquetScanBatchCreator.getBatch(ParquetScanBatchCreator.java:157)
org.apache.drill.exec.store.parquet.ParquetScanBatchCreator.getBatch(ParquetScanBatchCreator.java:56)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSubScan(AbstractPhysicalVisitor.java:125)
org.apache.drill.exec.store.parquet.ParquetRowGroupScan.accept(ParquetRowGroupScan.java:107)
org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:208)
org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34)
org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitProject(AbstractPhysicalVisitor.java:75)
org.apache.drill.exec.physical.config.Project.accept(Project.java:51)
org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:208)
org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34)
org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitProject(AbstractPhysicalVisitor.java:75)
org.apache.drill.exec.physical.config.Project.accept(Project.java:51)
org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:208)
org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34)
org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:59)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSender(AbstractPhysicalVisitor.java:105)
org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSingleSender(AbstractPhysicalVisitor.java:193)
org.apache.drill.exec.physical.config.SingleSender.accept(SingleSender.java:87)
org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:87)
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:124)
org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
java.lang.Thread.run(Thread.java:744)
{code}
> java.lang.IllegalStateException files open exceptions in drillbit.out
> ---------------------------------------------------------------------
>
> Key: DRILL-2780
> URL: https://issues.apache.org/jira/browse/DRILL-2780
> Project: Apache Drill
> Issue Type: Bug
> Components: Execution - Flow
> Reporter: Ramana Inukonda Nagaraj
> Assignee: Chris Westin
>
> There are many stacktraces like this in drillbit.out
> {code}
> Exception in thread "Thread-2" java.lang.IllegalStateException: Not all files opened using this FileSystem are closed. There are still [84] files open.
> File '/drill/testdata/tpch100/parquet/lineitem/part-m-00045.parquet' opened at callstack:
> org.apache.drill.exec.store.parquet.columnreaders.PageReader.<init>(PageReader.java:105)
> org.apache.drill.exec.store.parquet.columnreaders.ColumnReader.<init>(ColumnReader.java:88)
> org.apache.drill.exec.store.parquet.columnreaders.VarLengthColumn.<init>(VarLengthColumn.java:39)
> org.apache.drill.exec.store.parquet.columnreaders.VarLengthValuesColumn.<init>(VarLengthValuesColumn.java:43)
> org.apache.drill.exec.store.parquet.columnreaders.NullableVarLengthValuesColumn.<init>(NullableVarLengthValuesColumn.java:39)
> org.apache.drill.exec.store.parquet.columnreaders.VarLengthColumnReaders$NullableVarBinaryColumn.<init>(VarLengthColumnReaders.java:303)
> org.apache.drill.exec.store.parquet.columnreaders.ColumnReaderFactory.getReader(ColumnReaderFactory.java:176)
> org.apache.drill.exec.store.parquet.columnreaders.ParquetRecordReader.setup(ParquetRecordReader.java:303)
> org.apache.drill.exec.physical.impl.ScanBatch.<init>(ScanBatch.java:100)
> org.apache.drill.exec.store.parquet.ParquetScanBatchCreator.getBatch(ParquetScanBatchCreator.java:157)
> org.apache.drill.exec.store.parquet.ParquetScanBatchCreator.getBatch(ParquetScanBatchCreator.java:56)
> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
> org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSubScan(AbstractPhysicalVisitor.java:126)
> org.apache.drill.exec.store.parquet.ParquetRowGroupScan.accept(ParquetRowGroupScan.java:107)
> org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
> org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:214)
> org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34)
> org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
> {code}
> We should not be getting any exceptions in drillbit.out.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)