You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/09/14 15:58:10 UTC
[GitHub] [airflow] zachliu edited a comment on issue #8541: "TypeError: can't pickle _thread.RLock objects" on usage of BigQueryOperator
zachliu edited a comment on issue #8541:
URL: https://github.com/apache/airflow/issues/8541#issuecomment-919232720
in my case, on `composer 1.13.0 airflow 1.10.12`, this error occurs when i use a for-loop:
```python
downstream_task_1 = SomeOperator()
downstream_task_2 = SomeOperator()
for i in range(x):
task = SomeOperator(
task_id=f"task_{i}"
)
task >> downstream_task_1 >> downstream_task_2
```
strangely, i had to
```python
downstream_task_1 = SomeOperator()
downstream_task_2 = SomeOperator()
for i in range(x):
task = SomeOperator(
task_id=f"task_{i}"
)
task >> downstream_task_1
downstream_task_1 >> downstream_task_2
```
otherwise `downstream_task_2` will give me the nuke.
to be more specific:
* any upstream tasks of `downstream_task_2` can't be cleared with `Downstream` option checked
* any downstream tasks (including `downstream_task_2` itself) can't be cleared with or without `Downstream` option checked
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org