[jira] [Commented] (SPARK-4276) Spark streaming requires at least two working thread

["Sean Owen (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-4276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200539#comment-14200539 ] 

Sean Owen commented on SPARK-4276:
----------------------------------

This is basically the same concern addressed already by https://issues.apache.org/jira/browse/SPARK-4040 no?
This code can set a master of, say, "local[2]", but it was my understanding that all examples don't set a master and this is supplied by spark-submit.
Then again SPARK-4040 changed the doc example to set a local[2] master. hm.


> Spark streaming requires at least two working thread
> ----------------------------------------------------
>
>                 Key: SPARK-4276
>                 URL: https://issues.apache.org/jira/browse/SPARK-4276
>             Project: Spark
>          Issue Type: Bug
>          Components: Streaming
>    Affects Versions: 1.1.0
>            Reporter: varun sharma
>             Fix For: 1.1.0
>
>
> Spark streaming requires at least two working threads.But example in spark/examples/src/main/scala/org/apache/spark/examples/streaming/NetworkWordCount.scala 
> has
> // Create the context with a 1 second batch size
> val sparkConf = new SparkConf().setAppName("NetworkWordCount")
> val ssc = new StreamingContext(sparkConf, Seconds(1))
> which creates only 1 thread.
> It should have atleast 2 threads:
> http://spark.apache.org/docs/latest/streaming-programming-guide.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org