You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Min Jiang (JIRA)" <ji...@apache.org> on 2015/08/18 23:55:45 UTC
[jira] [Commented] (FLINK-2089) "Buffer recycled"
IllegalStateException during cancelling
[ https://issues.apache.org/jira/browse/FLINK-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702049#comment-14702049 ]
Min Jiang commented on FLINK-2089:
----------------------------------
The issue seems not resolved. I downloaded the version 0.9 and ran my code. In IDE, my code was working fine with data containing about 300,000 records, each record having 550 fields. But when running the code in linux as client, i got the same error message stack:
08/18/2015 17:30:10 CHAIN DataSource (at main(RWA.java:40) (org.apache.flink.api.java.io.TextInputFormat)) -> Filter (Filter at main(RWA.java:4 0))(1/1) switched to FAILED
java.lang.IllegalStateException: Buffer has already been recycled.
at org.apache.flink.shaded.com.google.common.base.Preconditions.checkState(Preconditions.java:173)
at org.apache.flink.runtime.io.network.buffer.Buffer.ensureNotRecycled(Buffer.java:142)
at org.apache.flink.runtime.io.network.buffer.Buffer.setSize(Buffer.java:105)
at org.apache.flink.runtime.io.network.api.serialization.SpanningRecordSerializer.getCurrentBuffer(SpanningRecordSerializer.java:151)
at org.apache.flink.runtime.io.network.api.writer.RecordWriter.clearBuffers(RecordWriter.java:166)
at org.apache.flink.runtime.operators.RegularPactTask.clearWriters(RegularPactTask.java:1532)
at org.apache.flink.runtime.operators.DataSourceTask.invoke(DataSourceTask.java:220)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559)
at java.lang.Thread.run(Thread.java:745)
> "Buffer recycled" IllegalStateException during cancelling
> ---------------------------------------------------------
>
> Key: FLINK-2089
> URL: https://issues.apache.org/jira/browse/FLINK-2089
> Project: Flink
> Issue Type: Bug
> Components: Distributed Runtime
> Affects Versions: master
> Reporter: Ufuk Celebi
> Assignee: Ufuk Celebi
> Fix For: 0.9
>
>
> [~rmetzger] reported the following stack trace during cancelling of high parallelism jobs:
> {code}
> Error: java.lang.IllegalStateException: Buffer has already been recycled.
> at org.apache.flink.shaded.com.google.common.base.Preconditions.checkState(Preconditions.java:173)
> at org.apache.flink.runtime.io.network.buffer.Buffer.ensureNotRecycled(Buffer.java:142)
> at org.apache.flink.runtime.io.network.buffer.Buffer.getMemorySegment(Buffer.java:78)
> at org.apache.flink.runtime.io.network.api.serialization.SpillingAdaptiveSpanningRecordDeserializer.setNextBuffer(SpillingAdaptiveSpanningRecordDeserializer.java:72)
> at org.apache.flink.runtime.io.network.api.reader.AbstractRecordReader.getNextRecord(AbstractRecordReader.java:80)
> at org.apache.flink.runtime.io.network.api.reader.MutableRecordReader.next(MutableRecordReader.java:34)
> at org.apache.flink.runtime.operators.util.ReaderIterator.next(ReaderIterator.java:73)
> at org.apache.flink.runtime.operators.MapDriver.run(MapDriver.java:96)
> at org.apache.flink.runtime.operators.RegularPactTask.run(RegularPactTask.java:496)
> at org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:362)
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559)
> at java.lang.Thread.run(Thread.java:745)
> {code}
> This looks like a concurrent buffer pool release/buffer usage error. I'm investing this today.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)