You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Victor Vianna (JIRA)" <ji...@apache.org> on 2018/08/22 10:20:00 UTC

[jira] [Commented] (AIRFLOW-2934) Pools not respected for internal subdag tasks

    [ https://issues.apache.org/jira/browse/AIRFLOW-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588664#comment-16588664 ] 

Victor Vianna commented on AIRFLOW-2934:
----------------------------------------

I added a DummyOperator at the beggining of each subgraph and now it got even stranger, it will execute only one of the subgraphs and then hang

> Pools not respected for internal subdag tasks
> ---------------------------------------------
>
>                 Key: AIRFLOW-2934
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2934
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: pools, subdag
>    Affects Versions: 1.9.0
>         Environment: Linux victorvianna 4.14.65-1-MANJARO #1 SMP PREEMPT Sat Aug 18 13:29:56 UTC 2018 x86_64 GNU/Linux
>            Reporter: Victor Vianna
>            Priority: Blocker
>         Attachments: dag_pool.py
>
>
> I'm trying to have some subdags execute one task at a time. The way I found was to create a first pool for the SubdagOperators (pool1 in the attached code file) and a second one for the internal tasks (pool2). However, it appears that pools for subdag elements are not being respected. Running airflow 1.9.0.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)