You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "wuyi (Jira)" <ji...@apache.org> on 2020/04/21 13:40:00 UTC
[jira] [Updated] (SPARK-31509) Recommend user to disable delay
scheduling for barrier taskset
[ https://issues.apache.org/jira/browse/SPARK-31509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
wuyi updated SPARK-31509:
-------------------------
Description:
Currently, barrier taskset can only be scheduled when all tasks are launched at the same time. As a result, delay scheduling becomes the biggest obstacle for the barrier taskset to get scheduled. And the application can be easily fail with barrier taskset when delay scheduling is on. So, probably, we should recommend user to disable delay scheduling while using barrier execution.
BTW, we could still support delay scheduling with barrier taskset if we could resolve SPARK-24818
was:
Currently, barrier taskset can only be scheduled when all tasks are launched at same time. As a result, delay scheduling becomes the biggest obstacle for the barrier taskset to get scheduled. And the application can be easily fail with barrier taskset when delay scheduling is on. So, probably, we should recommend user to disable delay scheduling.
BTW, we could still support delay scheduling with barrier taskset if we could resolve SPARK-24818
> Recommend user to disable delay scheduling for barrier taskset
> --------------------------------------------------------------
>
> Key: SPARK-31509
> URL: https://issues.apache.org/jira/browse/SPARK-31509
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 3.1.0
> Reporter: wuyi
> Priority: Major
>
> Currently, barrier taskset can only be scheduled when all tasks are launched at the same time. As a result, delay scheduling becomes the biggest obstacle for the barrier taskset to get scheduled. And the application can be easily fail with barrier taskset when delay scheduling is on. So, probably, we should recommend user to disable delay scheduling while using barrier execution.
>
> BTW, we could still support delay scheduling with barrier taskset if we could resolve SPARK-24818
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org