You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Sudheesh Katkam (JIRA)" <ji...@apache.org> on 2014/07/02 01:17:24 UTC
[jira] [Updated] (DRILL-1093) Resource leak: ByteBuf.release() not
called
[ https://issues.apache.org/jira/browse/DRILL-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sudheesh Katkam updated DRILL-1093:
-----------------------------------
Description:
0: jdbc:drill:zk=local> SELECT * FROM cp.`employee.json` LIMIT 20;
16:10:39.711 [10a4550e-24cc-44dc-96dc-fe38ad9abb0a:frag:0:0 - Producer Thread] ERROR io.netty.util.ResourceLeakDetector - LEAK: ByteBuf.release() was not called before it's garbage-collected. Enable advanced leak reporting to find out where the leak occurred. To enable advanced leak reporting, specify the JVM option '-Dio.netty.leakDetectionLevel=advanced' or call ResourceLeakDetector.setLevel()
*Here's what I get when I set the level to advanced:*
16:02:34.268 [c52b9de5-8043-4ba4-a6bc-57df791b9885:frag:0:0 - Producer Thread] ERROR io.netty.util.ResourceLeakDetector - LEAK: ByteBuf.release() was not called before it's garbage-collected.
Recent access records: 2
#2:
io.netty.buffer.AdvancedLeakAwareByteBuf.getBytes(AdvancedLeakAwareByteBuf.java:211)
org.apache.drill.exec.vector.VarCharVector$Mutator.setSafe(VarCharVector.java:494)
org.apache.drill.exec.vector.NullableVarCharVector$Mutator.setSafe(NullableVarCharVector.java:442)
org.apache.drill.exec.vector.complex.impl.NullableVarCharWriterImpl.write(NullableVarCharWriterImpl.java:115)
org.apache.drill.exec.vector.complex.fn.JsonReader.writeData(JsonReader.java:140)
org.apache.drill.exec.vector.complex.fn.JsonReader.write(JsonReader.java:65)
org.apache.drill.exec.vector.complex.fn.JsonReaderWithState.write(JsonReaderWithState.java:52)
org.apache.drill.exec.store.easy.json.JSONRecordReader2.next(JSONRecordReader2.java:90)
org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:138)
org.apache.drill.exec.physical.impl.producer.ProducerConsumerBatch$Producer.run(ProducerConsumerBatch.java:122)
java.lang.Thread.run(Thread.java:745)
#1:
io.netty.buffer.AdvancedLeakAwareByteBuf.setBytes(AdvancedLeakAwareByteBuf.java:319)
org.apache.drill.exec.vector.complex.fn.JsonReader.writeData(JsonReader.java:136)
org.apache.drill.exec.vector.complex.fn.JsonReader.write(JsonReader.java:65)
org.apache.drill.exec.vector.complex.fn.JsonReaderWithState.write(JsonReaderWithState.java:52)
org.apache.drill.exec.store.easy.json.JSONRecordReader2.next(JSONRecordReader2.java:90)
org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:138)
org.apache.drill.exec.physical.impl.producer.ProducerConsumerBatch$Producer.run(ProducerConsumerBatch.java:122)
java.lang.Thread.run(Thread.java:745)
Created at:
io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:55)
io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:155)
io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:146)
io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:83)
org.apache.drill.exec.vector.complex.fn.JsonReader.writeData(JsonReader.java:135)
org.apache.drill.exec.vector.complex.fn.JsonReader.write(JsonReader.java:65)
org.apache.drill.exec.vector.complex.fn.JsonReaderWithState.write(JsonReaderWithState.java:52)
org.apache.drill.exec.store.easy.json.JSONRecordReader2.next(JSONRecordReader2.java:90)
org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:138)
org.apache.drill.exec.physical.impl.producer.ProducerConsumerBatch$Producer.run(ProducerConsumerBatch.java:122)
java.lang.Thread.run(Thread.java:745)
*This happens only on the first query on any json file.*
was:
0: jdbc:drill:zk=local> SELECT * FROM cp.`employee.json` LIMIT 20;
16:10:39.711 [10a4550e-24cc-44dc-96dc-fe38ad9abb0a:frag:0:0 - Producer Thread] ERROR io.netty.util.ResourceLeakDetector - LEAK: ByteBuf.release() was not called before it's garbage-collected. Enable advanced leak reporting to find out where the leak occurred. To enable advanced leak reporting, specify the JVM option '-Dio.netty.leakDetectionLevel=advanced' or call ResourceLeakDetector.setLevel()
Here's what I get when I set the level to advanced:
16:02:34.268 [c52b9de5-8043-4ba4-a6bc-57df791b9885:frag:0:0 - Producer Thread] ERROR io.netty.util.ResourceLeakDetector - LEAK: ByteBuf.release() was not called before it's garbage-collected.
Recent access records: 2
#2:
io.netty.buffer.AdvancedLeakAwareByteBuf.getBytes(AdvancedLeakAwareByteBuf.java:211)
org.apache.drill.exec.vector.VarCharVector$Mutator.setSafe(VarCharVector.java:494)
org.apache.drill.exec.vector.NullableVarCharVector$Mutator.setSafe(NullableVarCharVector.java:442)
org.apache.drill.exec.vector.complex.impl.NullableVarCharWriterImpl.write(NullableVarCharWriterImpl.java:115)
org.apache.drill.exec.vector.complex.fn.JsonReader.writeData(JsonReader.java:140)
org.apache.drill.exec.vector.complex.fn.JsonReader.write(JsonReader.java:65)
org.apache.drill.exec.vector.complex.fn.JsonReaderWithState.write(JsonReaderWithState.java:52)
org.apache.drill.exec.store.easy.json.JSONRecordReader2.next(JSONRecordReader2.java:90)
org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:138)
org.apache.drill.exec.physical.impl.producer.ProducerConsumerBatch$Producer.run(ProducerConsumerBatch.java:122)
java.lang.Thread.run(Thread.java:745)
#1:
io.netty.buffer.AdvancedLeakAwareByteBuf.setBytes(AdvancedLeakAwareByteBuf.java:319)
org.apache.drill.exec.vector.complex.fn.JsonReader.writeData(JsonReader.java:136)
org.apache.drill.exec.vector.complex.fn.JsonReader.write(JsonReader.java:65)
org.apache.drill.exec.vector.complex.fn.JsonReaderWithState.write(JsonReaderWithState.java:52)
org.apache.drill.exec.store.easy.json.JSONRecordReader2.next(JSONRecordReader2.java:90)
org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:138)
org.apache.drill.exec.physical.impl.producer.ProducerConsumerBatch$Producer.run(ProducerConsumerBatch.java:122)
java.lang.Thread.run(Thread.java:745)
Created at:
io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:55)
io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:155)
io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:146)
io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:83)
org.apache.drill.exec.vector.complex.fn.JsonReader.writeData(JsonReader.java:135)
org.apache.drill.exec.vector.complex.fn.JsonReader.write(JsonReader.java:65)
org.apache.drill.exec.vector.complex.fn.JsonReaderWithState.write(JsonReaderWithState.java:52)
org.apache.drill.exec.store.easy.json.JSONRecordReader2.next(JSONRecordReader2.java:90)
org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:138)
org.apache.drill.exec.physical.impl.producer.ProducerConsumerBatch$Producer.run(ProducerConsumerBatch.java:122)
java.lang.Thread.run(Thread.java:745)
This happens only on the first query on any json file.
> Resource leak: ByteBuf.release() not called
> -------------------------------------------
>
> Key: DRILL-1093
> URL: https://issues.apache.org/jira/browse/DRILL-1093
> Project: Apache Drill
> Issue Type: Bug
> Affects Versions: 1.0.0-BETA1
> Reporter: Sudheesh Katkam
>
> 0: jdbc:drill:zk=local> SELECT * FROM cp.`employee.json` LIMIT 20;
> 16:10:39.711 [10a4550e-24cc-44dc-96dc-fe38ad9abb0a:frag:0:0 - Producer Thread] ERROR io.netty.util.ResourceLeakDetector - LEAK: ByteBuf.release() was not called before it's garbage-collected. Enable advanced leak reporting to find out where the leak occurred. To enable advanced leak reporting, specify the JVM option '-Dio.netty.leakDetectionLevel=advanced' or call ResourceLeakDetector.setLevel()
> *Here's what I get when I set the level to advanced:*
> 16:02:34.268 [c52b9de5-8043-4ba4-a6bc-57df791b9885:frag:0:0 - Producer Thread] ERROR io.netty.util.ResourceLeakDetector - LEAK: ByteBuf.release() was not called before it's garbage-collected.
> Recent access records: 2
> #2:
> io.netty.buffer.AdvancedLeakAwareByteBuf.getBytes(AdvancedLeakAwareByteBuf.java:211)
> org.apache.drill.exec.vector.VarCharVector$Mutator.setSafe(VarCharVector.java:494)
> org.apache.drill.exec.vector.NullableVarCharVector$Mutator.setSafe(NullableVarCharVector.java:442)
> org.apache.drill.exec.vector.complex.impl.NullableVarCharWriterImpl.write(NullableVarCharWriterImpl.java:115)
> org.apache.drill.exec.vector.complex.fn.JsonReader.writeData(JsonReader.java:140)
> org.apache.drill.exec.vector.complex.fn.JsonReader.write(JsonReader.java:65)
> org.apache.drill.exec.vector.complex.fn.JsonReaderWithState.write(JsonReaderWithState.java:52)
> org.apache.drill.exec.store.easy.json.JSONRecordReader2.next(JSONRecordReader2.java:90)
> org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:138)
> org.apache.drill.exec.physical.impl.producer.ProducerConsumerBatch$Producer.run(ProducerConsumerBatch.java:122)
> java.lang.Thread.run(Thread.java:745)
> #1:
> io.netty.buffer.AdvancedLeakAwareByteBuf.setBytes(AdvancedLeakAwareByteBuf.java:319)
> org.apache.drill.exec.vector.complex.fn.JsonReader.writeData(JsonReader.java:136)
> org.apache.drill.exec.vector.complex.fn.JsonReader.write(JsonReader.java:65)
> org.apache.drill.exec.vector.complex.fn.JsonReaderWithState.write(JsonReaderWithState.java:52)
> org.apache.drill.exec.store.easy.json.JSONRecordReader2.next(JSONRecordReader2.java:90)
> org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:138)
> org.apache.drill.exec.physical.impl.producer.ProducerConsumerBatch$Producer.run(ProducerConsumerBatch.java:122)
> java.lang.Thread.run(Thread.java:745)
> Created at:
> io.netty.buffer.UnpooledByteBufAllocator.newDirectBuffer(UnpooledByteBufAllocator.java:55)
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:155)
> io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:146)
> io.netty.buffer.AbstractByteBufAllocator.buffer(AbstractByteBufAllocator.java:83)
> org.apache.drill.exec.vector.complex.fn.JsonReader.writeData(JsonReader.java:135)
> org.apache.drill.exec.vector.complex.fn.JsonReader.write(JsonReader.java:65)
> org.apache.drill.exec.vector.complex.fn.JsonReaderWithState.write(JsonReaderWithState.java:52)
> org.apache.drill.exec.store.easy.json.JSONRecordReader2.next(JSONRecordReader2.java:90)
> org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:138)
> org.apache.drill.exec.physical.impl.producer.ProducerConsumerBatch$Producer.run(ProducerConsumerBatch.java:122)
> java.lang.Thread.run(Thread.java:745)
> *This happens only on the first query on any json file.*
--
This message was sent by Atlassian JIRA
(v6.2#6252)