You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Krystal (JIRA)" <ji...@apache.org> on 2016/06/01 19:19:59 UTC

[jira] [Commented] (DRILL-4041) Parquet library update causing random "Buffer has negative reference count"

    [ https://issues.apache.org/jira/browse/DRILL-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15310942#comment-15310942 ] 

Krystal commented on DRILL-4041:
--------------------------------

git.commit.id.abbrev=6ddd5fa

Ran into this error while running the tpcds advanced test with concurrency of 20 and 2 drillbits running.

bin/run_tests -s Advanced/tpcds/tpcds_sf100/original -g smoke -n 20

Have not been able to reproduce the error again. 

{code}
Exiting due to uncaught exception
java.util.concurrent.ExecutionException: java.lang.IllegalStateException: DrillBuf[1937] refCnt has gone negative. Buffer Info: ledger[1128] allocator: ROOT), isOwning: false, size: 4, references: -1, life: 2852193038058198..2852195352841417, allocatorManager: [1128, life: 2852193036883482..2852195352867362]

	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:188)
	at org.apache.drill.test.framework.CancelingExecutor$1.run(CancelingExecutor.java:81)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalStateException: DrillBuf[1937] refCnt has gone negative. Buffer Info: ledger[1128] allocator: ROOT), isOwning: false, size: 4, references: -1, life: 2852193038058198..2852195352841417, allocatorManager: [1128, life: 2852193036883482..2852195352867362]

	at oadd.io.netty.buffer.DrillBuf.release(DrillBuf.java:269)
	at oadd.io.netty.buffer.DrillBuf.release(DrillBuf.java:244)
	at oadd.org.apache.drill.exec.vector.BaseDataValueVector.clear(BaseDataValueVector.java:39)
	at oadd.org.apache.drill.exec.vector.VarCharVector.clear(VarCharVector.java:197)
	at oadd.org.apache.drill.exec.vector.NullableVarCharVector.clear(NullableVarCharVector.java:142)
	at oadd.org.apache.drill.exec.record.SimpleVectorWrapper.clear(SimpleVectorWrapper.java:73)
	at oadd.org.apache.drill.exec.record.VectorContainer.zeroVectors(VectorContainer.java:365)
	at oadd.org.apache.drill.exec.record.VectorContainer.clear(VectorContainer.java:336)
	at oadd.org.apache.drill.exec.record.RecordBatchLoader.clear(RecordBatchLoader.java:215)
	at org.apache.drill.jdbc.impl.DrillResultSetImpl.cleanup(DrillResultSetImpl.java:148)
	at org.apache.drill.jdbc.impl.DrillResultSetImpl.cancel(DrillResultSetImpl.java:139)
	at oadd.net.hydromatic.avatica.AvaticaStatement.cancel(AvaticaStatement.java:177)
	at org.apache.drill.jdbc.impl.DrillStatementImpl.cancel(DrillStatementImpl.java:259)
	at org.apache.drill.test.framework.DrillTestJdbc.cancel(DrillTestJdbc.java:311)
	at org.apache.drill.test.framework.CancelingExecutor$1$1.run(CancelingExecutor.java:74)
	... 5 more
{code}

> Parquet library update causing random "Buffer has negative reference count"
> ---------------------------------------------------------------------------
>
>                 Key: DRILL-4041
>                 URL: https://issues.apache.org/jira/browse/DRILL-4041
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - Parquet
>    Affects Versions: 1.3.0
>            Reporter: Rahul Challapalli
>            Assignee: Steven Phillips
>            Priority: Critical
>
> git commit # 39582bd60c9eaaaa9b16aba4f099d434e927e7e5
> After the parquet library update commit, we started seeing the below error randomly causing failures in the  Extended Functional Suite.
> {code}
> Failed with exception
> java.lang.IllegalArgumentException: Buffer has negative reference count.
> 	at oadd.com.google.common.base.Preconditions.checkArgument(Preconditions.java:92)
> 	at oadd.io.netty.buffer.DrillBuf.release(DrillBuf.java:250)
> 	at oadd.io.netty.buffer.DrillBuf.release(DrillBuf.java:259)
> 	at oadd.io.netty.buffer.DrillBuf.release(DrillBuf.java:259)
> 	at oadd.io.netty.buffer.DrillBuf.release(DrillBuf.java:259)
> 	at oadd.io.netty.buffer.DrillBuf.release(DrillBuf.java:239)
> 	at oadd.org.apache.drill.exec.vector.BaseDataValueVector.clear(BaseDataValueVector.java:39)
> 	at oadd.org.apache.drill.exec.vector.NullableIntVector.clear(NullableIntVector.java:150)
> 	at oadd.org.apache.drill.exec.record.SimpleVectorWrapper.clear(SimpleVectorWrapper.java:84)
> 	at oadd.org.apache.drill.exec.record.VectorContainer.zeroVectors(VectorContainer.java:312)
> 	at oadd.org.apache.drill.exec.record.VectorContainer.clear(VectorContainer.java:296)
> 	at oadd.org.apache.drill.exec.record.RecordBatchLoader.clear(RecordBatchLoader.java:183)
> 	at org.apache.drill.jdbc.impl.DrillResultSetImpl.cleanup(DrillResultSetImpl.java:139)
> 	at org.apache.drill.jdbc.impl.DrillCursor.close(DrillCursor.java:333)
> 	at oadd.net.hydromatic.avatica.AvaticaResultSet.close(AvaticaResultSet.java:110)
> 	at org.apache.drill.jdbc.impl.DrillResultSetImpl.close(DrillResultSetImpl.java:169)
> 	at org.apache.drill.test.framework.DrillTestJdbc.executeQuery(DrillTestJdbc.java:233)
> 	at org.apache.drill.test.framework.DrillTestJdbc.run(DrillTestJdbc.java:89)
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at java.lang.Thread.run(Thread.java:744)
> {code} 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)