You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/09/14 15:58:10 UTC

[GitHub] [airflow] zachliu edited a comment on issue #8541: "TypeError: can't pickle _thread.RLock objects" on usage of BigQueryOperator

zachliu edited a comment on issue #8541:
URL: https://github.com/apache/airflow/issues/8541#issuecomment-919232720


   in my case, on `composer 1.13.0 airflow 1.10.12`, this error occurs when i use a for-loop:
   ```python
   downstream_task_1 = SomeOperator()
   downstream_task_2 = SomeOperator()
   for i in range(x):
       task = SomeOperator(
           task_id=f"task_{i}"
       )
       task >> downstream_task_1 >> downstream_task_2
   ```
   strangely, i had to
   ```python
   downstream_task_1 = SomeOperator()
   downstream_task_2 = SomeOperator()
   for i in range(x):
       task = SomeOperator(
           task_id=f"task_{i}"
       )
       task >> downstream_task_1
   downstream_task_1 >> downstream_task_2
   ```
   otherwise `downstream_task_2` will give me the nuke.
   to be more specific:
   * any upstream tasks of `downstream_task_2` can't be cleared with `Downstream` option checked
   * any downstream tasks (including `downstream_task_2` itself) can't be cleared with or without `Downstream` option checked


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org