You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "fritz-astronomer (via GitHub)" <gi...@apache.org> on 2023/09/21 22:48:52 UTC
[GitHub] [airflow] fritz-astronomer opened a new issue, #34535: Unable to retrieve logs for nested task group when parent is mapped
fritz-astronomer opened a new issue, #34535:
URL: https://github.com/apache/airflow/issues/34535
### Apache Airflow version
2.7.1
### What happened
Unable to retrieve logs for task inside task group inside mapped task group.
Got `404 "TaskInstance not found"` in network requests
### What you think should happen instead
_No response_
### How to reproduce
```
from datetime import datetime
from airflow import DAG
from airflow.decorators import task, task_group
from airflow.operators.bash import BashOperator
from airflow.utils.task_group import TaskGroup
with DAG("mapped_task_group_bug", schedule=None, start_date=datetime(1970, 1, 1)):
@task
def foo():
return ["a", "b", "c"]
@task_group
def bar(x):
with TaskGroup("baz"):
# If child task group exists, task fails, logs 404
# "TaskInstance not found"
# http://localhost:8080/api/v1/dags/mapped_task_group_bug/dagRuns/manual__2023-09-21T22:31:56.863704+00:00/taskInstances/bar.baz.bop/logs/2?full_content=false
# if it is removed, the task succeeds and logs appear
BashOperator(task_id="bop", bash_command="echo hi $x", env={"x": x})
bar.partial().expand(x=foo())
```
### Operating System
debian 11 / `astro dev start`
### Versions of Apache Airflow Providers
_No response_
### Deployment
Astronomer
### Deployment details
_No response_
### Anything else
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] bbovenzi closed issue #34535: Unable to retrieve logs for nested task group when parent is mapped
Posted by "bbovenzi (via GitHub)" <gi...@apache.org>.
bbovenzi closed issue #34535: Unable to retrieve logs for nested task group when parent is mapped
URL: https://github.com/apache/airflow/issues/34535
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] hussein-awala commented on issue #34535: Unable to retrieve logs for nested task group when parent is mapped
Posted by "hussein-awala (via GitHub)" <gi...@apache.org>.
hussein-awala commented on issue #34535:
URL: https://github.com/apache/airflow/issues/34535#issuecomment-1732664354
I found that the log exists and available in the TaskInstance view, but the problem is in the GridView which should consider the TI as mapped TI and try to get the log for the selected index.
I tested #34587 and it fixed the issue on the dag your provided, and I tested with a more complex case (5 nested levels) and everything looks good, could you check it?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] fritz-astronomer commented on issue #34535: Unable to retrieve logs for nested task group when parent is mapped
Posted by "fritz-astronomer (via GitHub)" <gi...@apache.org>.
fritz-astronomer commented on issue #34535:
URL: https://github.com/apache/airflow/issues/34535#issuecomment-1730450973
If this is known/expected behavior, I don't see mention of it here:
https://airflow.apache.org/docs/apache-airflow/stable/core-concepts/dags.html#taskgroups
or here:
https://airflow.apache.org/docs/apache-airflow/stable/authoring-and-scheduling/dynamic-task-mapping.html#mapping-over-a-task-group
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org