[jira] [Comment Edited] (FLINK-2540) LocalBufferPool.requestBuffer gets into infinite loop

["indraneel r (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16811693#comment-16811693 ] 

indraneel r edited comment on FLINK-2540 at 4/6/19 9:18 PM:
------------------------------------------------------------

[~uce] any updates on this? [~RenkaiGe] is right. This issue is not fixed and our flink job gets stuck waiting for `availableMemorySegments` to be non empty. This is in 1.7.2

 


was (Author: indraneelrr):
[~uce] any updates on this? [~RenkaiGe] is right. This issue is not fixed and our flink job gets stuck waiting for `availableMemorySegments` to be non empty

> LocalBufferPool.requestBuffer gets into infinite loop
> -----------------------------------------------------
>
>                 Key: FLINK-2540
>                 URL: https://issues.apache.org/jira/browse/FLINK-2540
>             Project: Flink
>          Issue Type: Bug
>            Reporter: Gabor Gevay
>            Assignee: Ufuk Celebi
>            Priority: Blocker
>             Fix For: 0.9.1, 0.10.0
>
>
> I'm trying to run a complicated computation that looks like this: [1].
> One of the DataSource->Filter->Map chains finishes fine, but the other one freezes. Debugging shows that it is spinning in the while loop in LocalBufferPool.requestBuffer.
> askToRecycle is false. Both numberOfRequestedMemorySegments and currentPoolSize is 128, so it never goes into that if either.
> This is a stack trace: [2]
> And here is the code, if you would like to run it: [3]. Unfortunately, I can't make it more minimal, becuase if I remove some operators, the problem disappears. The class to start is malom.Solver. (On first run, it calculates some lookuptables for a few minutes, and puts them into /tmp/movegen)
> [1] http://compalg.inf.elte.hu/~ggevay/flink/plan.txt
> [2] http://compalg.inf.elte.hu/~ggevay/flink/stacktrace.txt
> [3] https://github.com/ggevay/flink/tree/deadlock-malom



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)