You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/05/21 04:23:22 UTC
[jira] [Updated] (SPARK-10928) Spark Mesos finegrain mode with
single core CPUs, rendered useless
[ https://issues.apache.org/jira/browse/SPARK-10928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon updated SPARK-10928:
---------------------------------
Labels: bulk-closed (was: )
> Spark Mesos finegrain mode with single core CPUs, rendered useless
> ------------------------------------------------------------------
>
> Key: SPARK-10928
> URL: https://issues.apache.org/jira/browse/SPARK-10928
> Project: Spark
> Issue Type: Bug
> Components: Mesos
> Reporter: Ravi Sanwal
> Priority: Major
> Labels: bulk-closed
>
> If we run spark on Mesos cluster with only single core CPUs with coarse grained mode it runs fine. Although when we try to do the same using fine grained mode, it fails, because the required number of CPUs on any node is >1 (1 for task and at least 0.1 for executor overhead).
> So there is inherently a mismatch in configuration where same set of environment renders one mode useless.
> Steps to reproduce.
> Create a mesos cluster with cpu resources on each node limited to 1.
> Submit a task in coarse grained mode -> runs fine.
> Submit a task in fine grained mode -> does not run.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org