You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Stefan Bunk (JIRA)" <ji...@apache.org> on 2014/09/05 18:49:29 UTC
[jira] [Created] (FLINK-1090) Join deadlocks when used inside Delta
iteration
Stefan Bunk created FLINK-1090:
----------------------------------
Summary: Join deadlocks when used inside Delta iteration
Key: FLINK-1090
URL: https://issues.apache.org/jira/browse/FLINK-1090
Project: Flink
Issue Type: Bug
Components: Distributed Runtime, Iterations, Scala API
Affects Versions: 0.6-incubating
Environment: Ubuntu 14.04, Flink 0.6-incubating
LocalExecutor
JVM 1.7 with 7 GB RAM assigned
Reporter: Stefan Bunk
I have a join inside a delta iteration, which hangs, i.e.I think it's deadlocked.
If I do the join without a delta iteration, it works.
_Why I think it's a deadlock_:
- no output in the logs
- CPU idles
- no IO (measured using iotop)
- stacktrace (when starting in debug mode and stopping at arbitrary points) locks deadlockish !http://i.imgur.com/4TgSK3x.png!
_Join properties_:
- size of the operands: 6.1 GB, 257 MB
- estimated result size: 50 MB
- the deadlock only occurs for big inputs, if I decrease the size of the first operand to something smaller, e.g. 1MB, it works.
I am using the Scala API.
Let me know, which further information you need.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)