You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Patrick Wendell (JIRA)" <ji...@apache.org> on 2015/01/21 21:49:35 UTC
[jira] [Commented] (SPARK-4939) Python updateStateByKey example
hang in local mode
[ https://issues.apache.org/jira/browse/SPARK-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286234#comment-14286234 ]
Patrick Wendell commented on SPARK-4939:
----------------------------------------
[~tdas] [~davies] [~kayousterhout] Because there is still discussion about this, and this is modifying a very complex component in Spark, I'm not going to block on this for 1.2.1. Once we merge a patch we can decide whether to put it into 1.2 based on what the final patch looks like. It is definitely inconvenient that this doesn't work in local mode, but much less of a problem than introducing a bug in the scheduler for production cluster workloads.
As a workaround we could suggest running this example with local-cluster.
> Python updateStateByKey example hang in local mode
> --------------------------------------------------
>
> Key: SPARK-4939
> URL: https://issues.apache.org/jira/browse/SPARK-4939
> Project: Spark
> Issue Type: Bug
> Components: PySpark, Spark Core, Streaming
> Affects Versions: 1.2.0, 1.3.0
> Reporter: Davies Liu
> Assignee: Davies Liu
> Priority: Blocker
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org