You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "t oo (Jira)" <ji...@apache.org> on 2019/12/11 10:32:00 UTC

[jira] [Created] (AIRFLOW-6229) SparkSubmitOperator polls forever if status json can't find driver id

t oo created AIRFLOW-6229:
-----------------------------

             Summary: SparkSubmitOperator polls forever if status json can't find driver id
                 Key: AIRFLOW-6229
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-6229
             Project: Apache Airflow
          Issue Type: New Feature
          Components: scheduler
    Affects Versions: 1.10.6
            Reporter: t oo


Right now each task instance can consume 1 slot inside a pool, but some tasks are bigger/smaller than others. For tasks that I know are 'big' i want to be able to say consume say 4 slots from a pool



--
This message was sent by Atlassian Jira
(v8.3.4#803005)