You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Aizhamal Nurmamat kyzy (JIRA)" <ji...@apache.org> on 2019/05/17 22:19:04 UTC
[jira] [Updated] (AIRFLOW-2934) Pools not respected for internal
subdag tasks
[ https://issues.apache.org/jira/browse/AIRFLOW-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aizhamal Nurmamat kyzy updated AIRFLOW-2934:
--------------------------------------------
Component/s: operators
Adding 'operators' component and 'subdag' label for component refactor.
> Pools not respected for internal subdag tasks
> ---------------------------------------------
>
> Key: AIRFLOW-2934
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2934
> Project: Apache Airflow
> Issue Type: Bug
> Components: operators, pools, subdag
> Affects Versions: 1.9.0
> Environment: Linux victorvianna 4.14.65-1-MANJARO #1 SMP PREEMPT Sat Aug 18 13:29:56 UTC 2018 x86_64 GNU/Linux
> Python 3.6.6
> Reporter: Victor Vianna
> Priority: Blocker
> Labels: pool, subdag
> Attachments: Screenshot from 2018-08-22 12-32-32.png, dag_pool.py
>
>
> I'm trying to have some subdags execute one task at a time. The way I found was to create a first pool for the SubdagOperators (pool1 in the attached code file) and a second one for the internal tasks (pool2). However, it appears that pools for subdag elements are not being respected. Running airflow 1.9.0 with LocalExecutor.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)