You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Genmao Yu (JIRA)" <ji...@apache.org> on 2017/03/03 01:28:45 UTC

[jira] [Closed] (SPARK-19349) Check resource ready to avoid multiple receivers to be scheduled on the same node.

     [ https://issues.apache.org/jira/browse/SPARK-19349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Genmao Yu closed SPARK-19349.
-----------------------------
    Resolution: Won't Fix

> Check resource ready to avoid multiple receivers to be scheduled on the same node.
> ----------------------------------------------------------------------------------
>
>                 Key: SPARK-19349
>                 URL: https://issues.apache.org/jira/browse/SPARK-19349
>             Project: Spark
>          Issue Type: Improvement
>          Components: DStreams
>    Affects Versions: 2.0.2, 2.1.0
>            Reporter: Genmao Yu
>
> Currently,  we can only ensure registered resource satisfy the "spark.scheduler.minRegisteredResourcesRatio". But if "spark.scheduler.minRegisteredResourcesRatio" is set too small, receivers may still be scheduled to few nodes. In fact, we can give once more chance to wait for sufficient resource to schedule receiver evenly.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org