You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/09/15 08:32:58 UTC

[GitHub] [airflow] ed-sparkes opened a new issue, #26412: Airflow api `dags/{dag_id}/tasks/{task_id}` only returning direct descendants in `downstream_task_ids` in response

ed-sparkes opened a new issue, #26412:
URL: https://github.com/apache/airflow/issues/26412

   ### Apache Airflow version
   
   2.3.4
   
   ### What happened
   
   We are trying to find a solution to clear a task and all its downstream tasks via the REST api. We tested a solution that included the following 
   
   - use `dags/{dag_id}/tasks/{task_id}` to get downstream_task_ids 
   - pass the failed task and the list of downstream_task_ids to `dags/{dag_id}/clearTaskInstances`
   
   However it appears that the first call only returns a subset of downstream tasks, probably just direct descendants? Is there a way to get the full list of descendants. This seems to be very simple from the UI but unclear how to achieve the same via the api. 
   
   
   
   ### What you think should happen instead
   
   Should return all downstream task ids. Or if not is there a way to achieve the same without recursively calling the get task endpoint? Aim is to be able clear task and all its downstreams. This is simple from the UI but seemingly difficult via the api? 
   
   ### How to reproduce
   
   _No response_
   
   ### Operating System
   
   Debian GNU/Linux 11 (bullseye)
   
   ### Versions of Apache Airflow Providers
   
   _No response_
   
   ### Deployment
   
   Official Apache Airflow Helm Chart
   
   ### Deployment details
   
   _No response_
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk closed issue #26412: Return non-direct descendants from `dags/{dag_id}/tasks/{task_id}`

Posted by GitBox <gi...@apache.org>.
potiuk closed issue #26412: Return non-direct descendants from `dags/{dag_id}/tasks/{task_id}`
URL: https://github.com/apache/airflow/issues/26412


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] uranusjr commented on issue #26412: Return non-direct descendants from `dags/{dag_id}/tasks/{task_id}`

Posted by GitBox <gi...@apache.org>.
uranusjr commented on issue #26412:
URL: https://github.com/apache/airflow/issues/26412#issuecomment-1248875395

   This is expected since “downstream” in Airflow is defined as direct descendants. A flag on the API to find all descendants can be added. There’s already code for this (`get_flat_relatives`) but it’s comparatively expensive and likely shouldn’t be called by default.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] boring-cyborg[bot] commented on issue #26412: Airflow api `dags/{dag_id}/tasks/{task_id}` only returning direct descendants in `downstream_task_ids` in response

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #26412:
URL: https://github.com/apache/airflow/issues/26412#issuecomment-1247768095

   Thanks for opening your first issue here! Be sure to follow the issue template!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] chenglongyan commented on issue #26412: Return non-direct descendants from `dags/{dag_id}/tasks/{task_id}`

Posted by GitBox <gi...@apache.org>.
chenglongyan commented on issue #26412:
URL: https://github.com/apache/airflow/issues/26412#issuecomment-1248887747

   Use ”include_downstream" as parameter of clearTaskInstances ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org