You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/01/15 14:48:10 UTC

[GitHub] [airflow] marcusianlevine opened a new issue #13700: Partial subset DAGs do not update task group's used_group_ids

marcusianlevine opened a new issue #13700:
URL: https://github.com/apache/airflow/issues/13700


   **Apache Airflow version**: 2.0.0
   
   **Environment**:
   
   - **Cloud provider or hardware configuration**: Docker container
   - **OS** (e.g. from /etc/os-release): Debian Stretch
   
   **What happened**:
   
   When working on some custom DAG override logic, I noticed that invoking `DAG.partial_subset` does not properly update the corresponding `_task_group.used_group_ids` on the returned subset DAG, such that adding back a task which was excluded during the `partial_subset` operation fails.
   
   **What you expected to happen**:
   
   Tasks that had already been added to the original DAG can be added again to the subset DAG returned by `DAG.partial_subset`
   
   **How to reproduce it**:
   Create any DAG with a single task called, e.g. `my-task`, then invoke `dag.partial_subset(['not-my-task'], False, False)`
   
   Note that the returned subset DAG's `_task_group.used_group_ids` still contains `my-task` even though it was not included in the subset DAG itself
   
   **Anything else we need to know**:
   
   I was able to work around this by adding logic to update the new partial subset DAG's `_task_group.used_group_ids` manually, but this should really be done as part of the `DAG.partial_subset` logic


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] kaxil closed issue #13700: Partial subset DAGs do not update task group's used_group_ids

Posted by GitBox <gi...@apache.org>.
kaxil closed issue #13700:
URL: https://github.com/apache/airflow/issues/13700


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org