[jira] [Closed] (SPARK-2154) Worker goes down.

["siva venkat gogineni (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

siva venkat gogineni closed SPARK-2154.
---------------------------------------


Fixed in the future releases

> Worker goes down.
> -----------------
>
>                 Key: SPARK-2154
>                 URL: https://issues.apache.org/jira/browse/SPARK-2154
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 0.8.1, 0.9.0, 1.0.0
>         Environment: Spark on cluster of three nodes on Ubuntu 12.04.4 LTS
>            Reporter: siva venkat gogineni
>            Assignee: Aaron Davidson
>              Labels: patch
>             Fix For: 1.1.0, 1.0.2
>
>         Attachments: Sccreenhot at various states of driver ..jpg
>
>
> Worker dies when i try to submit drivers more than the allocated cores. When I submit 9 drivers with one core for each driver on a cluster having 8 cores all together the worker dies as soon as i submit the 9 the driver. It works fine until it reaches 8 cores, As soon as i submit 9th driver the driver status remains "Submitted" and the worker crashes. I understand that we cannot run  drivers more than the allocated cores but the problem here is instead of the 9th driver being in queue it is being executed and as a result it is crashing the worker. Let me know if there is a way to get around this issue or is it being fixed in the upcoming version?
> Cluster Details:
> Spark 1.00
> 2 nodes with 4 cores each.



--
This message was sent by Atlassian JIRA
(v6.2#6252)